The actual blog post on this is more interesting.
Cloudflare’s blog posts are always more interesting. They have a really good postmortem process.
Thats wild. The last part about using the savings for their cache, did they mean the CDN type stuff or was that something related to the 1.1.1.1 stuff?
Either way their plans to use the new excess for the cache will further make things faster for everyone.
thank you for sharing this. very cool read
One silver lining about the component restraints, hopefully it drives people to start creating efficient software again. Actually optimizing what you’re doing to save on RAM rather than a gig per tab in Chrome.
Doubtful. Google doesn’t give a shit if you have 8 gigs or 64 gigs, they’ll keep shoving more functionality into Chrome and force the W3 specs that nobody asked for. Some of the worst offending websites when it comes to performance also want you to use their mobile apps anyway (think reddit, facebook).
Anyway, there’s a saying that I heard as a backend dev at a company using Java and Spring: RAM is cheap, devs are expensive. RAM going up 5x hasn’t REALLY changed that… Unless you’re at Cloudflare’s scale, where a small change amounts for 100 TB total across a bunch of servers on multiple continents, which would’ve been expensive even before the prices went up. But in their case, that’s across a bunch of machines so it won’t necessarily mean a big enough decrease in RAM usage per server to spec less RAM on future servers. Rather, they have a bit of extra RAM to play with.
Oh wow, now that’s some powerful wishful thinking!
Sure, who knows, it could happen!
“Claude, make this software more efficient.”
“Claude, analyze this software’s memory usage to see if there’s anything that could be trimmed without a major rewrite”
“Yes, I can drop truncate the DB for reduction in RAM and memory usage.”
Wish that was the case for a lot of new video games instead of relying on DLSS or FSR to cover up their poor optimisation
Picture the level of quality and performance we could have if we had both traditional optimization AND upscaling optimization AND frame gen optimization.
Cause holy fuck the number of times I’ve seen fsr/dlss slaped onto a game and no effort put into making it perform well.
Cause there IS work you can do to make fsr/dlss actually look good and perform better.
What makes you think nobody does traditional optimization anymore? UE5 is so hard to get to run well, you do need to do all kinds of shit to make a game run well. I suspect most of the games you’ve noticed not running very well, are UE5 games.
Do you know of any games where this is the case? I would love to see a case study where an optimized game benefits from DLSS/FSR in a way that makes it get ridiculous amounts of FPS.
I’m in a community making open source firmware for the Centauri Carbon 3d printer. The thing has 128MB of of RAM. The smarter people in the community worked some magic getting Klipper working on these things, and we’re still fighting to shave off a couple more MB in average use to get things working smoother.
Fellow OpenCentauri member 🤝
Hell yeah! I’m Ember in the server
A Lemmy community? Mjnd sharing the addy?
Discord server, sorry
Farts. Well. Have fun, then! You can have my fun, too lol
Talk to the folks running Linux on sn esp32! That’s some shrinking
Seems to me like everything is instead becoming even more bloated with AI stuff. A Google chat tab uses 2 GIGABYTES on my work computer.
Yes!
stupid RAM price benefit: reduce bloat
AI IS THE GREATEST THING TO HAPPEN TO MANKIND (ignore literally everything else)
I never even thought about this before, but what kind of hardware is a root level DNS server like 1.1.1.1 or quad 8 run on? Are they all roughly the same, or do they take different approaches to the load?
Bit of a nitpick, but these providers are not running root servers. They’re just recursive caching servers, probably running unbound.
If you want to find out root servers - dig for
.- that’s a dot. A full stop. That’s the root. Those can then answer where to find your .coms, .nets, etc. Those, in turn, handle the domain you rent; so on and so forth.Look up how Cloudflare does anycast BGP. They have servers in data centers everywhere and leverage the fact that they can all be 1.1.1.1 so people’s queries only hit the physically closest server, it’s pretty cool
Most probably off-the-shelf hardware, but with software optimized out the wazoo. Like, reading directly from SSDs instead of using a filesystem. Or more likely using an in-memory database like Redis, perhaps with custom additions.
I knew a guy who went on to work for CloudFlare. Back at that job, he made a write-only static-file storage in Node.js, dumping the contents into a giant file bypassing the filesystem and its metadata overhead. That’s the kind of optimization you want — pretty similar to what database engines like MySQL/PostgreSQL do (iirc one of them does in fact support using a plain disk partition for the database).
Back in early-mid 2010s I’ve read an article on Pornhub’s architecture. They ran Redis behind Haproxy load balancers. An in-memory database, behind load balancers. Some people say that it’s normal, but I’ve never had conditions calling for such a thing instead of sharding harder.
Dang. They do it all in one Pizza box. I figured it would be a whole rack per unit.
I’m actually surprised that they use some beefy servers. Like, Google famously use shitty and cheap commonplace hardware, but in large numbers, so it’s easy to replace when it croaks.
40 bytes are saved, exactly this amount.
40 bytes, per record. 533 bytes per entry. 3-4 GB total savings on an instance.
