Comments
Hacker News
curious how it handles tool call schemas, those can be surprisingly token-heavy, sometimes dwarfing the actual prompt content.
by chonghaoju
The repo would be more helpful if it had, or linked to, any kind of quantified data on how this affects the LLM output quality or task completion.
> Why
> System prompts are 50-200k tokens. …
1. Are system prompts really the primary purpose for this?
2. As of five months ago, Claude’s prompt was 12-65k tokens depending on enabled tools [1]. Does “50-“ refer to 50K? The repo should link their source for the 50-200K range.
by no-name-here
Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- curious how it handles tool call schemas, those can be surprisingly token-heavy, sometimes dwarfing the actual prompt content.by chonghaoju
- The repo would be more helpful if it had, or linked to, any kind of quantified data on how this affects the LLM output quality or task completion.
> Why
> System prompts are 50-200k tokens. …
1. Are system prompts really the primary purpose for this?
2. As of five months ago, Claude’s prompt was 12-65k tokens depending on enabled tools [1]. Does “50-“ refer to 50K? The repo should link their source for the 50-200K range.
by no-name-here