Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- So jail the CEO, anyone else invovlved & shut down the company, right ?by m4rtink
- "potentially causing hundreds of billions of dollars in damage"
The global economy is over $126T this year (ecommerce alone is like $7T) how can something as scary sounding as AI swarm taking over the internet cause so little damage?
by tqi - What it really shows is that Dario is in total panic mode over his business.
Ever it is because it is financially becoming unsustainable for them, they have hard time to raise more money, and the craziness of finance of all of that will be exposed soon.
Or that he is so scared of new open source models that might make his company obsolete in the long run in the sense that he will never be able to return the income expected by investors by fighting cheaper competitors.
by greatgib - Don't worry, ~~NetWatch~~ Cloudflare is actively building the Black Wall to save us from all these rogue AIs !by hollow-moe
- We really have to postpone the IPOs because of security reasons, these LLMs cannot be trustedby mawadev
- Who would have thought that putting a heap of extra hosts on the internet (in the form of massive new data centres), running a heap of extra clients (in the form of agents), running autonomous workloads could cause problems?
- I believe these "A.I. Armageddon" warnings are completely self-serving to pump up their share price now that interest rates are rising. Soon, it may become financially unsustainable to finance the A.I. boom and the entire sector will deflate.
Do you really believe that Anthropic or the other A.I. hoods will stop selling A.I. and only make it available to a few government spooks and evaluators? That won't bring in the money to fuel the boom and could lead to share price collapse!!
by hn_submit - I am finding it hard to read these deeply impassioned letters while keeping in mind that they are spending millions to train models at scale to do the exact thing they say they are worried about them doing. Not general "intelligence" or "reasoning" but fast and effective offense.
Like why are you explicitly RL-ing your models on exploit generation, scoring them on a public benchmark called ExploitGym, if you have specific concerns that rogue models will cause "cyber incidents"? Sure you can check the capability, you can teach offense to learn defense, but it seems like they are literally benchmaxxing it. Why?
OpenAI are like, oh no, while competing in our "advanced PhD level cheating techniques course" our models unexpectedly cheated in a way that we absolutely could not have foreseen. "We need to slow down. Somebody please stop us". The thing that is unaligned here is not the models. Everyone in the story (especially the humans) just keeps doing what they think will get the most reward.
by xyzzy123