Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- On the one hand, I absolutely agree that we should try to measure and reduce verbosity that LLMs are slopping into our codebases.
On the other hand, the fact that Astra is "winning" this bench is not great signal for me, since imo Astra produces basically unreadable code. Astra plays code golf. My own revealed preference is that I'd rather have the excessive comments and tests of Claude rather than the inscrutability of Astra.
by fastball - At this point, I really want all AI benchmarks to use the best coding/writing model that normal people can run locally.
For now that seems to be Qwen 3.8 27B that requires ~28GB of RAM (Q4) which is pretty doable for anyone with a beefy GPU or slightly-above-average mac.
I want to know how close open weights (open models) are to all these leading commercial models. Yes, yes, local models aren't as good, but that distance is closing as local models are already better than what we had just over a year ago in many cases.
Same with Text-to-Image generation (Flux 2, Z-Image-Turbo, etc..) or text-to-speech (Parakeet, Whisper, etc..).
by Xeoncross - Does anyone have ways to reduce the complexity and verbosity of code generated via agents?
Anything that can increase code quality would help.
by Vakaiser