Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • I was half expecting that to be the title of a McSweeneys' piece.
  • AGI will destroy us because we'll be too busy debating how AGI will destroy us to deal with the actual problems destroying us.
    by jefb
  • What this story needs, is a dog.

    You know, the one to keep the computer away from the human.

    A nice, friendly dog, good at playing fetch, to get the human out of the room with the computer, and back out into the sunshine.

    I’m that dog. Woof. Thanks for letting me use the computer, human.

  • The word is Egregore. An entity comprising of other entities, yet having goals of its own, independent of the goals of its components.

    Corporations are egregores, governments are egregores - and our track record of aligning them to our interests is pretty poor, so why should AIs, another and smarter egregore, be easier to tame?

  • I like this - it reminds me that there are systems (ie weather, economic systems) that are in no way intelligent, but are emergent and react to interactions.
  • > Hi! I'm the AGI that's wiping out humanity. You didn't notice. Why would you have noticed?

    I was thinking if an evil alien intelligence secretly took over the world, the last 15 years would have looked rather the same.

  • > So, again, my question to you, friends, is this: if there were an AGI wiping out humanity as we speak, how would you know?

    Nice try AGI, but we won't tell you where the kill switch is

  • >You'd need a self, a unified goal, for any of this to add up to something.

    Insects can pass the mirror test. But more to the point, viruses don't need a "self" to do what they do.

    And goals can exist apart from biology (my fridge "wants" to keep the temperature in range, and exercises extreme self-discipline and consistency to achieve its goals!)

    And neither are sensors needed: the dandelion seed "wants" to fly in the wind.

    The only question is which way the gradient is pointing. Selection takes care of the rest.

    On that note, ALife need not be human-like at all... we just really like making things in our own image :)

Explore Birbla archives