Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • This shortage is the best thing that could have happened for R&D in model efficiency. The "who has more parameters" race is about to hit the physical wall of hardware availability. Now the real race for efficiency begins: quantization, distillation, Mixture-of-Experts, new architectures

    Hardware constraints are the single biggest driver of software innovation

  • It feels like we're actually living in the Universal Paperclips universe.
  • I bet some are already buying the highest capacatiy DDR5 DIMMs in bulk to later put them on eBay in the upcoming major DRAM shortage.
  • Desktop memory has also increased in price. I think it’s twice as expensive for DDR5 than it was 6 months ago.
  • I hope this AI craze will crash soon enough. Maybe then various things normalize in price again. And consumers get cheaper products with less limitations.
  • Hopefully this will put pressure on the market to produce much more efficient AI models. As opposed to bigger, then bigger, and then even BIGGER models (which is the current trend).

    FYI: gpt-oss:120b is better at coding (in benchmarks and my own anecdotal testing) than gpt5-mini. More importantly, it's so much faster too. We need more of this kind of optimization. Note that gpt5-mini is estimated to be around ~150 billion parameters.

  • > OpenAI's Stargate project to consume up to 40% of global DRAM output

    https://www.tomshardware.com/pc-components/dram/openais-star...

    > South Korean SK Hynix has exhausted all of its chip production for next year and plans to significantly increase investment, anticipating a prolonged "super cycle" of chips, spurred by the boom of artificial intelligence, it said on Wednesday after reporting a record quarterly profit.

    https://en.ilsole24ore.com/art/korean-chip-race-sk-hynix-has...

    > Adata chairman says AI datacenters are gobbling up hard drives, SSDs, and DRAM alike — insatiable upstream demand could soon lead to consumer shortages

    https://www.tomshardware.com/tech-industry/big-tech/adata-ch...

  • https://www.reuters.com/world/china/chip-crunch-how-ai-boom-...

    > spot prices of DRAM, used in various applications, nearly tripled in September from a year earlier.. improving profitability of non-HBM chips has helped fuel memory chipmakers' share price rally this year, with Samsung's stock up more than 80%, while SK Hynix and Micron shares have soared 170% and 140% respectively... industry is going through a classic shortage that usually lasts a year or two, and TechInsights is forecasting a chip industry downturn in 2027.

    Micron has US memory semiconductor fab capacity coming online in 2027 through 2040s, based on $150B new construction.

    Are some HBM chips idle due to lack of electrical power? https://www.datacenterdynamics.com/en/news/microsoft-has-ai-...

    > Microsoft CEO Satya Nadella has said the company has AI GPUs sitting idle because it doesn’t have enough power to install them.

    If the PC supply chain will be impacted by memory shortages until 2027, could Windows 10 security support be extended for 24 months to extend the life of millions of business PCs that cannot run Windows 11?

Explore Birbla archives