• boonhet@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    6
    ·
    4 hours ago

    This makes it official, I’m skipping DDR5. I have ryzen 5700 and 32 GiB of DDR4, it’ll hold me over for a few more years. When I finally upgrade, it’s going to be at least 128 GiB.

    • KeithD@lemmy.nz
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 hours ago

      I’m probably skipping DDR5 as well at this rate. My Ryzen 2700 could use an upgrade, but I think I can survive with it until memory prices regain a little sanity. And I expect DDR6 will hit before that happens.

  • Not_mikey@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    16
    ·
    5 hours ago

    One good thing about the AI boom is that it’s flooding capital into ram development and ram production. Once the bubble pops all these ram companies will have a glut of cheap high performance memory to sell to anyone who can buy it in cash. The question is if the bubble popping triggers a full blown recession will anyone have any cash to buy.

  • Sam_Bass@lemmy.world
    link
    fedilink
    English
    arrow-up
    19
    ·
    9 hours ago

    when will they go back to optimizing software to run in the available ram, rather than continuing to increase ram size?

    • marzhall@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      7 hours ago

      When the devs run out of available RAM.

      Or if you’re 100 Rabbits and you live on a boat powered by solar so you’re actively limited by available electricity so you write tools based on your home-made tiny VM.

    • gigaqps@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      2
      ·
      4 hours ago

      If you’re able to optimize AI tools to run larger models in less RAM, you’ll have a lucrative future ahead of you.

      • Sam_Bass@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        3 hours ago

        i would not use ai for anything. too many errors and falsehoods come from them. and theyre now out there hacking other systems because nobody reins them in

      • boonhet@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 hours ago

        It’s KINDA being done in the ways we run MoE models. Strata makes more efficient use of limited VRAM if you have a decent amount of RAM, but you don’t even need to keep the entire model in RAM with it, it can keep the least frequently used experts on disk instead (it being an NVMe SSD hopefully, otherwise if you hit those experts, good luck)

  • varyingExpertise@feddit.org
    link
    fedilink
    English
    arrow-up
    20
    ·
    10 hours ago

    I hope that one day I can afford a ticket to an exhibition where we all gather around a security-glass display case with a stick of one of those in it and bask in its presence.

  • InnerScientist@lemmy.world
    link
    fedilink
    English
    arrow-up
    29
    ·
    13 hours ago

    DDR6 has no official launch date. Many believe 2029 is a realistic target for commercialization. However, in the current state of things, it would be a miracle if DDR6 had no setbacks.

    One can only hope the bubble pops before 2029.

    • Corkyskog@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      4
      ·
      11 hours ago

      It will, it’s coming next summer/fall unless it comes earlier. If the AI industry continues on in its current state until 2029 without popping, then it won’t pop. It means they stabilized their debt and financing.

        • Corkyskog@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 hours ago

          I firmly believe it will based on the financials. I am just saying if it’s 2029 and it “hasn’t happened yet” then it won’t happen. It’s coming within the next year, I would bet money on it. Not my life savings, but a chunk. In fact I have bet some money on it.

  • Wildmimic@anarchist.nexus
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    1
    ·
    11 hours ago

    Since limited waver space (because HBM takes so much of it at the same capacity) is one of the main driving factors for the Ram-apocalyse, this might actually help. And the performance looks actually great (the comparison to the DDR4 i am running shows some parameters being 10x better, this is actually a meaningful upgrade), meaning that some applications that currently use HBM might be able to just use DDR6 instead, causing a greater allocation of wavers towards that.

    • brucethemoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      5 hours ago

      Generative ML inference isn’t so dramatically bandwidth limited anymore, either, so the “demand” for HBM isn’t as clear.

      • boonhet@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        3
        ·
        4 hours ago

        Eh the really big models want a lot of bandwidth still, otherwise you just don’t make use of all the compute power you have.

        • deadbeef79000@lemmy.nz
          link
          fedilink
          English
          arrow-up
          1
          ·
          3 hours ago

          I generally edit my comments like this:

          Since limited waver wafer space

          So that is fixed for the next reader but the comment chain still makes sense.

  • DupaCycki@lemmy.world
    link
    fedilink
    English
    arrow-up
    24
    ·
    14 hours ago

    Great how real RAM development starts the moment nobody but a handful of billionaires can afford it.

      • brucethemoose@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        ·
        6 hours ago

        GDDR versioning doesn’t necessarily line up like that. For instance, GDDR7 is technologically akin to LPDDR5X, just with a different set of configuration tradeoffs.

  • Mihies@programming.dev
    link
    fedilink
    English
    arrow-up
    33
    arrow-down
    1
    ·
    15 hours ago

    At this point it doesn’t matter anymore if it were DDR99 with 578644.7 GT/s modules as we, consumers, won’t see them again in real life

  • dorumon@lemmy.cafe
    link
    fedilink
    English
    arrow-up
    24
    arrow-down
    1
    ·
    15 hours ago

    Cool the world is going back to ddr4 and ddr3. Who cares at this point? If it’s not going to be affordable and we already have all these pre existing computers that are working just fine anyway.

    • boonhet@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      3
      ·
      14 hours ago

      Nobody is going back to ddr3 except maybe the 3rd world and a few home servers. DDR4 maybe, but I imagine most people aren’t buying new machines just for cheaper RAM, can you really say “going back to DDR4” if you were never on DDR5?

      DDR6 will get you much better performance for models that don’t fit entirely in your VRAM so it’s going to be very helpful for people running local models.

      And when the memory market normalises, which could be pretty soon if nvidia stops ordering a ton of HBM it doesn’t even need, we should get back to the price per GB going down over time. CXMT is now apparently getting 90% yield on DDR5 which is excellent and the big 3 should be getting their first new foundries up next year since they started building them in around 2022 when the LLM boom started and they take about 4-5 years to finish.

      So any time you see a headline saying the memory crisis is only getting worse, it’s because the members of the memory cartel REALLY want you to buy right now. Because they can’t keep up the grift for much longer.

      • stoy@lemmy.zip
        link
        fedilink
        English
        arrow-up
        13
        ·
        14 hours ago

        DDR6 will get you much better performance for models that don’t fit entirely in your VRAM so it’s going to be very helpful for people running local models.

        For those of us who are not running after AI shit, DDR4 is fine.

        • boonhet@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          1
          ·
          6 hours ago

          I mean DDR2 is fine too, it’ll do everything you NEED to do and is available in big enough capacity, DDR would probably not offer enough capacity on a standard 4 slot desktop motherboard.

          Anything above that is for your own enjoyment (speeding things up).

      • cardfire@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        1
        ·
        14 hours ago

        Raises hand

        Two of my Pc’s run ddr5, and the rest of the Armada are on ddr4. DDR3 still exists in plenty of Appliance devices and reliably running Legacy systems, and I keep a handful of DDR3 sticks around just in case I get to revive something older.

        • boonhet@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          1
          ·
          6 hours ago

          two of my PC’s run ddr5

          and I keep a handful of DDR3 sticks around

          Sounds like you didn’t start buying DDR3 to replace DDR5, so can you really say you “went back to” DDR3?

        • ripcord@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          6 hours ago

          And howich of that have you bought in the last, say, 2 years?

          “Going back to” implies switching to.

    • Allero@lemmy.today
      link
      fedilink
      English
      arrow-up
      2
      ·
      14 hours ago

      The progress must go on, supply will catch up eventually - hopefully, at least.