Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- Do they cache results so users can receive already generated answers?
If the resellers cache results, how it is done? I am aware it's possible with a KV cache, but those resellers do not have access to Claude's KV memory?
If they do not cache results, how does this work?
by JPLeRouzic