Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- Utter disrespect for using the term "biology" relating to LLM. No one would call the analysis of a mechanical engine "car biology". It's an artificial system, call it system analysis.by lccerina
- It makes sense if you define "biology" as "incredibly complicated system not designed by humans that we kind of poke at to try to understand it."by UltraSane
- The analogy stems from the notion that neural nets are "grown" rather than "engineered". Chris Olah has an old, but good post with some specific examples: https://colah.github.io/notes/bio-analogies/by lewtun
- A superior LLM for line length optimization:by djoldman
- > The task we study is linebreaking in fixed-width text.
I wonder why they focused specifically on a task that is already solved algorithmically. The paper does not seem to address this, and the references do not include any mentions of non-LLM approaches to the line-breaking problem.
by Rygian - There's also a lot of analogising of this to visual/spatial reasoning, even to the point of talking about "visual illusions", when its clearly a counting task as the title says.
It makes it tedious to figure out what they actually did (which sounds interesting) when it's couched in such terms and presented in such an LLMified style.
by omnicognate - They study it because it already has a known solution.
The point is to see how LLMs implement algorithms internally, starting with this simple easily understood algorithm.
by Legend2440