Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- I think we should design a "Bullshit Benchmark" that tests for sycophancy and fluff like Opus 5 "two X, but only Y matters" color commentaryby muddi900
- Closest I know of are SycEval and the sycophancy evals in Anthropic's 2023 paper, both built on a user pushing back at a correct answer.by tomveber