Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • With a new model every couple of months this can only be triggered if it happens all at once.

    What is the average damage caused by OpenAI/Anthropic hacks? I feel like we should aim at lowering that number, not increasing it.

    What's the rule for fully autonomous cars?

    Should we allow this as unsupervised at all if we are really afraid of deaths, while there are practically no states that allow 100% autonomous cars (where we are actually afraid of deaths)?

    If "an independent third party registered with the Department of Commerce would periodically evaluate the lab", will this turn into an expensive certification/insurance that cuts off smaller competition (totally by mistake, I'm sure)?

    I am also very very sure this is most definitely not at all going to become like product certification if EU, where there are literally 2 companies certifying various standards: they police each other and a stupid electric fan can cost you tens of thousands of euros to certify.

  • If a life is only worth $20m, by their own calculus: saving > 50k lives is worth more than Anthropic. Tobacco causes ~8m deaths a year, so banning tobacco (easy intervention) should be worth ~160 Anthropic sized labs. :D
  • I don't think this is avoidable even at the present day. Anyone with sufficient capital could download a leading open-source model and run it on ~$10-25K hardware. They could align it to their own interest, including making a biological weapon. This law is akin to blocking Torrent downloads. Sure, you can slow them, but there will always be back channels.
  • One day an Anthropic Agent will kill me only using bash and curl
  • The next step is demanding anyone who wishes to release a Certified Safe AI™ model to prove they can insure the $1B in damages and pass a compliance audit for how they will prevent the LTM death count from reaching 50, effectively making it so that only big labs can serve government and enterprise.
  • This seems to be a case where Anthropic just can't win in the public court, and the other big ones (Google, Microsoft) have realized it / don't care enough, so they are rather quiet. Anthropic constantly gets accused of trying to lobby for regulation in order to lock out smaller competitors, but they've consistently lobbied for regulation aimed at frontier labs with exceptions for smaller labs. That's what this bill is about as well.
  • All these "safety" bills are to stop open source models by painting them as "dangerous". Regulatory capture.

    Companies are responsible for their agents; you don't blame the car for running over the person.

  • Proposal:

    1. Prosecute and lock people up over known instances of AI-enabled hacking, so companies playing fast and loose know “oops my AI did it” isn’t a useful defense.

    2. If you’re actually worried about AI killing lots of people, you immediately stop training AI specifically at the art of killing people, like selecting bombing targets, flying fighter jets, etc.

    Of course we all know none of these will happen.

Explore Birbla archives