Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- That is ≈0.043 token p/s. Impressive!by gbraad
- That's 23 seconds for 1 token. Unusable, in other words. The title seems to be intentional written to obfuscate that.by esperent
- Nice! Totally different subject but, have you tried Ling-mini on it? It's really good for how small it is and you can run it on damn near anything and be useably quick.
- You almost got me, it’s 2.6 tokens/minuteby a012
- I did a task that cost about $1.5 on API. It was 4 million tokens. That will take about 2.9 years at this rate.
Estimating an electricity cost in the three digits