Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • tl;dr; This is existing production being redirected to HBM. Which means consumer market is going to get a lot worse.

    And the worst thing is that is the best possible strategy for them. It's essentially win-win for everyone but consumers.

    - Buyer (AI) has crazy money, so will pay whatever

    - Seller doesn't have to build anything new, as the buyer is willing to pay whatever

    - Generate ridiculous profits from crazy money

    - No oversupply risk in case of reversal

    - Return from producing HBM to DDR5 in a single quarter if reversal does happen.

    Hold on to your existing hardware, people, and be on lookout for your local deals.

    by glub
  • Right now, every company that can is ramping up their RAM production as much as humanly possible. There is such outrageous and growing demand, that it's like printing money if you can manufacture more RAM chips. And that massive financial incentive is driving huge investment in manufacturing capacity.

    But someday, that demand will stop rising.

    At some point, most people will have enough RAM. And they just won't need to buy more.

    The inventories of RAM will become overfull, in warehouses and stores. And suddenly the manufacturers, middlemen, and even retailers will all find the price they can sell at keeps dropping.

    But you can't shut down a huge manufacturing facility overnight. You can't shut down a years-in-the-making retail distribution system overnight, either. You can't even shut down a facility that is halfway finished with construction. They'll keep producing and selling RAM at lower and lower profit margins, until the day comes they finally accept they're losing money with each sale.

    And when that happens, we'll all have more RAM than we know what to do with. It'll be cheaper than we have all ever experienced in our lifetimes.

    I don't expect this to happen soon. But demand cannot keep exponentially rising forever. There will come a point, probably in the next 5 years, when demand at least levels off, even as production capacity is still rising.

    And it will be interesting to see what's possible at that point. We'll be able to create software that is not doable right now, because it will no longer be constrained by memory. And even cheap laptops will massive amounts.

  • Will consumers actually get to purchase it though? Or are they just doubling it for frontier AI labs?
  • A shame that this should if anything, lead to consumer DRAM prices getting even worse.
    by gs17
  • What's the main blocker (other than the current inflated cost) for using HBM instead of DRAM as the primary memory for consumer electronics?
  • On a related note, I was reading yesterday that apparently the real bottleneck for Chinese production of AI accelerators is HBM production, not processors or ASML equipment.

    The lack of ASML EUV machines certainly hurts, and pushing DUV so hard results in abysmal yields of good chips, but you can compensate by running more wafers or making smaller chips, and the net result is that Huawei's Ascend production volume is limited by CXMT's HBM capacity not processor dies.

    The problem is that HBM manufacture requires many steps (die thinning, via drilling, plating, alignment) where the equipment used by everyone else (Samsung, SK Hynix, Micron) is also blocked by sanctions, so the Chinese are having to develop all of this themselves too, which they have, but yields are currently low, even when using shorter HBM stacks.

  • I’ve often wondered about die thinning. I mean just looking at sd cards and micro sd etc, it was clear that there had to be a thinning step (or many steps) and it seemed amazing to me that such a complex step could be economically viable. And yet it clearly is. All a matter of being able to operate at scale I guess.

    It’s not a step I’ve seen discussed very much, so it was kind of neat to see it discussed front and center in a lay article like this.

    by y1n0
  • The article features a truck that the chips get loaded onto. This quote from Tanenbaum immediately jumped into mind:

    "Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway."

Explore Birbla archives

Samsung is expected to more than double output of its HBM4 and HBM4E DRAM · Birbla