Comments
Hacker News
under 0.02 tok/s
by lostmsu
0.01 tk/s is unusable for anything, you would wait a whole day for just 1000 token of output, what is the point of projects like this?
by Azantys
Says it requires a 2TB disk? Must it be internal NVMe?
by als0
Will it fit on ESP32??
by piterrro
SSD streaming on an M5 Max 128GB: https://x.com/antirez/status/2082136334160818528
Soon decent speed across two Mac Studios with 512GB of RAM.
by antirez
Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- under 0.02 tok/sby lostmsu
- 0.01 tk/s is unusable for anything, you would wait a whole day for just 1000 token of output, what is the point of projects like this?by Azantys
- Says it requires a 2TB disk? Must it be internal NVMe?by als0
- Will it fit on ESP32??by piterrro
- SSD streaming on an M5 Max 128GB: https://x.com/antirez/status/2082136334160818528
Soon decent speed across two Mac Studios with 512GB of RAM.
by antirez