Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- Well, it was nice to have a functional models for a bit. Shame it didn't last long.
- Feels like a good thing to give an update on right before you launch a new version of Fable.by lukaswthoms
- Well, it's good that they didn't completely forget that We Must Pace The Frontier ever existed, even though OpenAI doesn't look like it's going to join in. Some stuff I noticed:
- they still use the concerningly precise term "employee-like access", which can mean anything, rather than e.g. "employee-level". Similarly, the evaluators get tools "roughly on par" (?) with the ones actual employees use.
- they get to redact secrets from METR's reports, but METR is otherwise free to publish and whistleblow. Seems fine.
- they are going to get a separate dedicated evaluator specifically for bioweapon risks
by stratos123