Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- Exactly my machine 64GB M1 Max So happy about this! ♡
idk how people access (soldout) and even afford 512GB RAM MacStudio's. Isn't it $40k or so?
by ALLTaken - Would be interesting to see how fast it would be on 4x mac studio 512gb machines.by mips_avatar
- Going to try this on my M1 Ultra 128gb.
The point of these engineering tricks is to see the envelope of what's possible. You can use these tricks to both run a bigger model on smaller hardware or run a smaller model on smaller hardware.
by mannyv - Anyone who knows the state of NVMe hardware more than me know if this would obliterate the lifespan of your drive? Seems like the biggest limitation to me (some people are probably fine with letting their Macs churn over the weekend).by nlessard
- The title should probably be edited to specify "M1 Max" instead of "M1 Mac". You aren't running K3 on a base M1 anytime soon. Either way, still a very impressive project.by acmnrs
- 0.01 tk/s is unusable for anything, you would wait a whole day for just 1000 token of output, what is the point of projects like this?by Azantys
- SSD streaming on an M5 Max 128GB: https://x.com/antirez/status/2082136334160818528
Soon decent speed across two Mac Studios with 512GB of RAM.
by antirez