Birbla

Comments

Hacker News

Is the 5-minute expiration correct? I thought it was more like ~1 hour.

by jonas21

If you're running the subscription, by default you are paying 2x for cache writes and you're getting an hour for expiry. So refreshing based on 5 min is wasteful. You need to detect whether you are in 5 min or 1 hour mode.

by leemoore

this is so cool. claude should actually opensource part of their harness so the community can improve it

context windows and sessions already get maxed out faster with fable and opus 5 and cost a ton. this should lead to significant savings. checking it out

*(and ingesting into mer personal ai builder /hamzaish. opensource)

by hamza_ali_shah

Interested in how the critics of approaches like this defend an agentic session (with Fable, for example) that stops and runs a multi-hour ML training session. It's a script, so the actual LLM convo goes stale, but then when the results get returned to the main thread you get an expensive cache hit without doing anything.

You would have avoided that cache hit if the LLM session was kept "alive" for those few hours. Why not automate the part where you keep the large main thread alive until you're ready to analyze the results?

by boc

Feels like will be shut down real quick

by alukin

I've directly inspected calls for pro/Max plans and as of today they have 1hr cache expiries. This has definitely degraded to 5 min in the past but that's the behavior today.

If you're paying API rates, you can choose 5m or 1hr yourself (and pay different rates).

Keeping a 1hr cache warm could still be useful, sure, but outside that, I don't see much use of this today.

by unholiness

This is just making it more expensive for everyone else, right?

How Claude handles its sessions is none of my business. I'm going to let them do the best they can to provide good service for everyone, and if they can't/won't, I'll switch to a provider that can.

Using these massive models is already pretty danged extravagant, I'm not going to demand to be at the front of the queue at all times, too.

by SwellJoe

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • Is the 5-minute expiration correct? I thought it was more like ~1 hour.
    by jonas21
  • If you're running the subscription, by default you are paying 2x for cache writes and you're getting an hour for expiry. So refreshing based on 5 min is wasteful. You need to detect whether you are in 5 min or 1 hour mode.
    by leemoore
  • this is so cool. claude should actually opensource part of their harness so the community can improve it

    context windows and sessions already get maxed out faster with fable and opus 5 and cost a ton. this should lead to significant savings. checking it out

    *(and ingesting into mer personal ai builder /hamzaish. opensource)

    by hamza_ali_shah
  • Interested in how the critics of approaches like this defend an agentic session (with Fable, for example) that stops and runs a multi-hour ML training session. It's a script, so the actual LLM convo goes stale, but then when the results get returned to the main thread you get an expensive cache hit without doing anything.

    You would have avoided that cache hit if the LLM session was kept "alive" for those few hours. Why not automate the part where you keep the large main thread alive until you're ready to analyze the results?

    by boc
  • Feels like will be shut down real quick
    by alukin
  • FYI, on Pro and Max plans caching lasts for one hour, not five minutes, unless you're currently using Extra Usage.

    https://code.claude.com/docs/en/prompt-caching#on-a-claude-s...

    (Thank you to EliasWatson for giving me this link just a few days ago, as I was previously confused too.)

    by Wowfunhappy
  • I've directly inspected calls for pro/Max plans and as of today they have 1hr cache expiries. This has definitely degraded to 5 min in the past but that's the behavior today.

    If you're paying API rates, you can choose 5m or 1hr yourself (and pay different rates).

    Keeping a 1hr cache warm could still be useful, sure, but outside that, I don't see much use of this today.

    by unholiness
  • This is just making it more expensive for everyone else, right?

    How Claude handles its sessions is none of my business. I'm going to let them do the best they can to provide good service for everyone, and if they can't/won't, I'll switch to a provider that can.

    Using these massive models is already pretty danged extravagant, I'm not going to demand to be at the front of the queue at all times, too.

    by SwellJoe