Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • How much time did it take to build this? Loved it! What problem does this solve?
  • Emrah, it seems that EDX does not offer any edge over GCX, when paired with an agent like Claude?
  • It looks a very interesting project that benchmarks AI SRE Agents
  • Cool, as I see your product react proactively rather than Claude being reactive so that with your tools automated investigations happens without me asking explicitly the problem and root cause as I understand? Do you guys also have mitigations?
  • Cool that you guys created this, but interpreting the results: why wouldn't I just use Claude instead of an AI SRE tool?

    Or if there are some features of an AI SRE tool that make it better than Claude + some MCPs, should those be captured in this same benchmark?

  • More benchmarks comparing effectiveness of various AI SREs is welcome and overdue: especially vendor-vs-vendor comparisons. One area that I think is going to be really interesting and important is the best way to emulate complex IT environments for evals.

    Some related work I recommend checking out: - https://arxiv.org/abs/2609.33023 (new last week!) - https://github.com/SREGym/SREGym - https://github.com/hyperdxio/hyperdx/tree/main/packages/hdx-... (Clickstack's version) - https://github.com/grafana/o11y-bench (Grafana's version)

Explore Birbla archives