Comments
Hacker News
my initials = LLM :(
by llarota
The issue remains the context window. I haven't seem any example of a "memories" system that the agent can update over time without it devolving into slop. The magic of the human brain is that we seem to have decently sophisticated heuristics parsing/saving memories as well as for letting memories that aren't accessed decay.
It depends on what you mean by continual learning. Do you just mean some form of memorization, or something more/different?
Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- my initials = LLM :(by llarota
- The issue remains the context window. I haven't seem any example of a "memories" system that the agent can update over time without it devolving into slop. The magic of the human brain is that we seem to have decently sophisticated heuristics parsing/saving memories as well as for letting memories that aren't accessed decay.
- It depends on what you mean by continual learning. Do you just mean some form of memorization, or something more/different?