Birbla

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

Sign in
  • Hacker News
  • Recalling their recent misuse report [0], I kind of agree with them. And performance/intelligence wise I think we are already at quite a nice local optima.

    [0]: https://www.anthropic.com/threat-intelligence-report-septemb...

    by 5555watch
  • This is just regulatory capture talk that every CEO does. Zuck is guilty of it too. This is the first time that I really support it though. If things had fractured more by now, I might not care but the wealth concentration needs to be scrutinized and I think we can slow down and maybe not keep replacing rural hospitals with data centers, and still lead the globe in ai.
    by zilfedie
  • The devil’s own horseman, whipping the horses on: “faster, faster, more compute! But I might also just ride this carriage over the cliff!”. Laughing maniacally as he goes.

    Which one is it, Dario?

    by Biologist123
  • Is this to strengthen financials? Less burn on training?
    by throw03172019
  • If they do this, it will just give China time to catch up.
    by elmer2
  • I think the speed of improvement is somewhat overstated, and I think this is all cool, valuable fundamental research. Rather than slowing down I would like to talk about how we can make it easier for people to harden their systems using their tools - like just using the $20/month OpenAI or Claude accounts, they need to make it easy for people to harden their systems against these kinds of problems.

    Instead of shutting down at any discussion of hacking they need to be giving out free credits for hardening. That's going to make it easier to use these tools for hacking, because hacking requires hardening. But the alternative is huge numbers of intrusions, and a slowdown won't fix that, we already have far too much poorly secured stuff, and the models are way too good at exploiting obvious problems.

    I also think they need to do a better job of safeguarding end-user privacy. I've seen some things with Claude that make me very concerned it's possible for Claude to hack my local network, then for one of their classifiers to trip, hide the log of how I was hacked from me, but beam all of the information about the hack back to Anthropic to use. And this is totally reasonable, they want to train their models not to hack. Except now details of how they have a foothold on my local network only exist in training data that they may never read but will use to train their models. This is very avoidable but Anthropic has to treat alignment with the end-user's goals as more important than treating the end-user as an adversary.

    by lukeschlather
  • Meaning: slow his competitors; mainly because anthropic stopped focusing on product and quality. Instead their big push right now is preventing others from catching up.
    by exabrial
  • Meaning they realized they hit a wall. The next new model isn't that much better than the last in quality.
    by conqrr

Explore Birbla archives