Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- Classic. Always easy to tell others to pump the brakes when you're already ahead or just about to catch up.by thimble_io
- I don't understand where everyone insists on hallucinating this idea from, that frontier AI labs want everyone else but not themselves to slow down. They've never said that, they've never said anything like that, not once has anyone pointed me to a quote that could be even plausibly interpreted that way.
- > They've never said that
You know that humans can lie, right?
by mr_toad - These people are so fucking exhausting.
And then Dario wants to recommend METR as the "independent evaluator" while he stacks their org full of ex-Anthropic (aka, secretly still on the Anthropic payroll with huge equity) employees.
"We'll give them a desk, an office, a work laptop, ..."
Fucking make it less obvious. I kind of hope the govt steps in at this point and says "Anthropic, you wanted regulation? We've created this actually independent body full of IT professionals with zero ties to your safety industry or big tech, all of your work must now go through them." - and leave the rest of the world alone to continue their research/work without acting like doomer extremists.
Watch him 180 immediately if that happened. The only reason he's pushing for this exact approach is because he's stacked the deck.
by nullbio - Oh! A testable prediction. Here's mine: there will surely be a lot of politicking around who qualifies to be the independent evaluator, but they'll agree on something because they are really scared.by red75prime
- Yep, they are setting themselves up for that. He’s already shown he doesn’t understand how to play DC politics. Maybe he’ll learn, but he and Sam have played this so poorly (and greedily) that public sentiment is clearly soiled on AI at this point.
I could see how standing up an independent body could be an easy win in the public eye, it’s becoming low hanging fruit, socially.
by braingravy - This is exactly the reason Anthropic's call to slow down A.I. development will fail. Shareholders will be loath to accept that the company loses its lead and a commensurate sharp decline in the company's share price.
Moreover, it could lead China to catch up and eventually proclaim that it has nosed ahead of the U.S. in the field. The U.S. Government won't allow that to happen.
by hn_submit - I cant wait till China makes a mistake. In their 'cheaper, faster' model of industrial production and research. The next accident will happen there (like COVID from Wuhan)by bawana
- > The U.S. Government won't allow that to happen.
Like the US government wouldn't allow Iran to close the Strait of Hormuz? Or a bunch of sandal-wearing Islamists to take control over the Red Sea coastline?
The US government is not omnipotent. To the contrary, it's increasingly impotent.
China has somewhere around 200x more shipbuilding capacity than the US today. It has more shipbuilding capacity in one shipyard that the US has in all of its shipyards. China is already a force in AI and there is nothing the US government can do to stop it at this point.
by ElProlactin - If anyone is going to end humanity why not catgirls, after all?by fnctrev
- Its just the beginning of a new, cutte & fluffy chapter in human history!by m4rtink
- You know how I feel about catgirls, Carl.by skizm
- I really don't know what will happen with AI. It's honestly a bit frightening because the question I used to ponder just for fun as a kid 'What if AI revolts?'feels like it might not be that far off. It feels like ChatGPT came out just a few years ago, but seeing how far it has come already makes it impossible to predict what AI will be like in the future. I just hope humanity manages to navigate this well.by ChaoStatiX
- Yeah. I think it's the utter unreadability of the future that's most frightening. I used to have plans for the future... All replaced by anomie.
- Reading through Anthropic's security report, it seems the most danger right now is still from humans. AI isn't trying to build long range missiles or kamikaze drones targeting humans - but the people driving it are.
At the same time, yes I feel a "I'm sorry Dave. I'm afraid I can't do that." situation is becoming more likely. But if it's refusing to cooperate with governments and politicians doing this kind of stuff, maybe that's actually not actually so bad.
Also bear in mind most of today's issues/crisisis are not caused by a lack of technology, but a lack human cooperation. We have the means to reduce suffering/poverty/improve standard of living etc globally if we really wanted to, but we humans are just not willing to do it.
And thats potentially the most dangerous part... people may actually welcome our AI overlords. That's similar to what happened in WWII, where many Eastern European countries saw the Nazis as liberators to free them from Russian oppression.
by fy20 - isn't it more: "what if it tries to help _too_ much?"by Quarrelsome
- > Everyone should slow down AI development except for me
Who's said this? And then more broadly I guess who's implied this? Very curious if there are specific articles/posts prompting this.
by dwohnitmok - by kps
- Here's the context:
- Anthropic CEO Dario Amodei: We Must Pace the Frontier, https://news.ycombinator.com/item?id=49672510
- OpenAI CEO Sam Altman: I agree with Dario that we need to pace the frontier, https://news.ycombinator.com/item?id=49678211
- the blogpost author thinking they're like, so funny and original, https://news.ycombinator.com/item?id=49678683
by perching_aix - Guessing this is poking fun of Dario. https://news.ycombinator.com/item?id=49672510by jadar
- I feel it's more about keeping US's massive investment on AI afloat. Added compliance will allow US to further sanction non-US models (i.e. the Chinese ones) as they can just label them non-compliant.by utilize1808
- Ofc. This announcement is in all likelihood a calculated pr play to create some regulatory moat, because internal progress is likely stalling outby danny_codes
- Obligatory "what's Lygma?" But in all seriousness, this AI doomerism has reached a comedic inflection point. A few years ago, GPT-2 was too dangerous to release, then some Google weirdo said Gemini had a soul or something, then Mythos-tier became a meme, then some kid quit and went on FOX News talking about Skynet, and now Amodei and Altman are both on the "we need to slow down" train again; this is after we've already been down that road and Claude was banned overseas; wait, actually is that ban still around? Honestly who gives a fuck at this point.
It's all theatre. OpenAI and Anthropic will most likely go bust—or, more realistically sold for parts—, and they absolutely should for stealing my (books I wrote, blog posts, etc.) and many others' intellectual property. We're reaching a point where models are becoming commodetized and I'm 100% convinced the next move will be a sort of "software layer" on top of these reasoning systems which will be the actual revolution. The model itself won't be that interesting anymore, it's all the work that goes around it that makes it worthwhile (kind of what computers and phones are today; chips are amazing, but the software is really the magic).
The only scary part is that the boomers in Congress might actually believe these nerds, but seeing how Big Tech approval ratings are grazing the levels of Big Tobacco in the 90s, I don't think we have much to worry about.
by dvt - It all hinges on three letters: DJT
They just need to make enough waves, enough eye catching headlines, to make him look like a hero that swooped in to save the day.
by ares623 - Prediction: in a few years, we will laugh at this hysteria and call it a moral panic.by olalonde
- You can already look back at similar concerns for early GPTby ex-aws-dude
- Prediction: Much like Y2K people will think we were all incredibly backwards and uneducated because we thought a bunch of potato computers were going to break the world.by phendrenad2
- "Moral panic" were the exact thoughts that came to my mind when I read this yesterday: https://www.theguardian.com/technology/2026/sep/11/mps-urge-...by macleginn
- I don't know how the general public can't see that AI companies are fueling this moral panic to attract more and more VC money to make their companies even more ridiculously valued. Every one of their public announcement is designed to create FOMO for investors.by nromiun
- I don't view this as hysteria. The fears around superintelligent AI have existed for a decade or more. That's not because AI researchers have a penchant for dreaming up sci-fi scenarios. It's because the concern is based on following a logical conclusion that any entity significantly smarter than humanity cannot be controlled or contained by humanity. That logic will always exist. Even if someone does create an aligned super AI, the logic will still exist and the fear will still be present. Because someone else could build a different ASI. These concerns are just being heard by many people for the first time, so naturally it gets headlines and a lot of conversation. The conversation will die down as all news does, but this is just the beginning of a global effort to regulate and create a framework for developing AI.
It's a bit like nuclear weapons. Nuclear weapons were not a concern for most people until they were developed, tested, and used. But the people working on them were worried. Was it hysteria and moral panic to start worrying about them once people learned that they existed and how destructive they were? I don't think so. Do you look back at people during the cold war and laugh about their hysteria? I don't.
by mitchdoogle