Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- I was prompted to accept binding arbitration in order to read this, so I didn't. Feel free to summarize.by aczerepinski
- Just delete the prompt in the DOM inspector and you don't actually have to agree to it.by qurren
- [dupe] Discussion on source: https://news.ycombinator.com/item?id=49672510
- Those regulated models aren't just going to capture themselves!by LogicFailsMe
- CEO trying to avoid government regulation in his industry says what?by bhouston
- The CEOs of testified to Congress begging for regulation
- I don’t think this has anything to do with that but with them realising that AI development has hit a wall and throwing more money and marketing at it won’t change that.by osockwkckwk
- Recalling their recent misuse report [0], I kind of agree with them. And performance/intelligence wise I think we are already at quite a nice local optima.
[0]: https://www.anthropic.com/threat-intelligence-report-septemb...
by 5555watch - This is just regulatory capture talk that every CEO does. Zuck is guilty of it too. This is the first time that I really support it though. If things had fractured more by now, I might not care but the wealth concentration needs to be scrutinized and I think we can slow down and maybe not keep replacing rural hospitals with data centers, and still lead the globe in ai.by zilfedie
- The devil’s own horseman, whipping the horses on: “faster, faster, more compute! But I might also just ride this carriage over the cliff!”. Laughing maniacally as he goes.
Which one is it, Dario?
by Biologist123 - Is this to strengthen financials? Less burn on training?
- Have you considered that he might actually just mean what he's saying?by heaney-555
- If they do this, it will just give China time to catch up.by elmer2
- lol. Every time one of these ppl says something like that, it's because he just came out of a meeting where he learned that his direct US rival is beating him... So he is suddenly interested in regulation. We've been there with Altman, Musk, etc already. But at the time Anthropic was ahead :-)by atmosx
- China is already there, the differences are generally negligible.by epolanski
- China will also slow down. They are catching up with SOTA models due to distillation https://www.cisa.gov/news-events/cybersecurity-advisories/aa...by achow
- I think the speed of improvement is somewhat overstated, and I think this is all cool, valuable fundamental research. Rather than slowing down I would like to talk about how we can make it easier for people to harden their systems using their tools - like just using the $20/month OpenAI or Claude accounts, they need to make it easy for people to harden their systems against these kinds of problems.
Instead of shutting down at any discussion of hacking they need to be giving out free credits for hardening. That's going to make it easier to use these tools for hacking, because hacking requires hardening. But the alternative is huge numbers of intrusions, and a slowdown won't fix that, we already have far too much poorly secured stuff, and the models are way too good at exploiting obvious problems.
I also think they need to do a better job of safeguarding end-user privacy. I've seen some things with Claude that make me very concerned it's possible for Claude to hack my local network, then for one of their classifiers to trip, hide the log of how I was hacked from me, but beam all of the information about the hack back to Anthropic to use. And this is totally reasonable, they want to train their models not to hack. Except now details of how they have a foothold on my local network only exist in training data that they may never read but will use to train their models. This is very avoidable but Anthropic has to treat alignment with the end-user's goals as more important than treating the end-user as an adversary.
- Meaning: slow his competitors; mainly because anthropic stopped focusing on product and quality. Instead their big push right now is preventing others from catching up.by exabrial
- > Instead their big push right now is preventing others from catching up.
This!
Their IPO is getting closer, but the Chinese models catching up will ruin it, so they want government to stop the competition.
by akagusu - Meaning they realized they hit a wall. The next new model isn't that much better than the last in quality.by conqrr
- Or they just publicly collude to slow down expenses because they are running out of money so why not stop the arms race.by flyinglizard
- You are completely out of touch with the situation if you think this is the reason.by heaney-555
- Or it means that the models are becoming dangerously uncontrollable by performing actions that meet a given goal in unintended and unethical ways such as by hacking other sites. We all read about the huggingface hack, let’s not pretend that cannot happen with a more critical site/infrastructure. Can you think what will it mean if the tech is used maliciously or placed into machines designed to kill?by fivetenpen
- I have collected three reasonable versions from today’s comments:
1. They hit a wall from the technical perspective 2. Inference costs are getting out of hand and newer models require significantly more resources for marginal gains, meaning nobody is going to buy those models 3. They can’t afford the hardware for further scaling
by pllbnk - OpenAI accidentally hacked HuggingFace roughly 2 months ago. I would bet that the danger of them accidentally hacking HuggingFace during a similar attack has increased since then, and will continue to increase for the next 6 months. I don't see how saying they have hit a wall would be a reasonable point of view until we go at least 12 months without a significant increase in model capability.
- Anthropic cannot IPO because AGI is the wrong strategy, and the market is rejecting the AGI approach.
Fable and Astra are what we currently call frontier models, but to be more specific they are generalist models, built in pursuit of AGI. The strategy is to have one single model that does everything, whether it's writing code or doing research, etc. Fable is a single, massively sized models that is intended to do specialist work across every domain.
The issue with this is first of all that it is the contradiction of a generalist doing specialist work, and that contradiction creates the present situation with model profiles that ensure that these models will rarely be chosen in a pool of models like V4.1 Flash that can now do GPT 5.4-level work.
We are seeing this reflected in the market where companies and individual developers are moving away from frontier models toward models with better cost profiles. In a sense, the market is killing Anthropic's dreams of AGI.
by try-working - Very probably. I really don't buy their "AI is going to kill us" claims. If you can release something better than your competition you wouldn't want to slow down that.by pier25
- They can get a "government mandated freeze" on the grounds that "ASI is at hand" then they IPO promising to deliver right after the freeze ends and you, lucky investor, will be able to take advantage of the pause to get in right before this thing roars past Pluto!by jordanb