Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- measuring humor might be halfway to measuring taste. congrats on this... really original contribution. wonder if you're planning to evolve the benchmark to incorporate a multi-language dimension. would love to see how Mistral and models built outside the US would perform.by rafaepta
- I can’t imagine how to correctly assess the ability to humor, because this is a very subjective and relative phenomenon. The work ahead is seriousby maxzhdev
- Can you also measure how often the LLM response makes people laugh? Sometimes the responses that aren't attempting a joke are the funniest, and I'd be more interested in stats of which LLM succeed in that metric.by dlcarrier