Why don't we talk about context window size anymore?

Why don't we talk about context window size anymore?

3 pointsby rce1231 comments

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • The models have reached, on average, the 256k/1M window size and that is more than enough for them to complete most tasks without losing attention. I suspect more people are using fresh sessions and markdown between them, than trying to keep fewer long running sessions - this works better overall. We are moving more into the quality >>> quantity realm.
Why don't we talk about context window size anymore? · Birbla