Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- I don't really get why people go on about Yudkowsky in this regard. I mean serious thinking about AI goes back at least to Turing in 1950 with his test and prediction computers would get there in about 50 years and presumably keep improving. And people have worried about it since then.
Like in 1949 Norbert Wiener saying of AI type stuff "every degree of independence we give the machine is a degree of possible defiance of our wishes."
Then 30 years later this Yudkowsky is born, later is considered a bit of a crank, goes on a bit about the same old stuff when he grows up and everyone makes out like he invented it?
I've got a lot of respect for Turing, Wiener and Von Neumann but haven't bothered reading Yudkowsky. Is there any point?
It seems a bit unfair to the pioneers of the field to go on about some Harry Potter sex cult guy who repeated their ideas decades later?
by tim333 - I wish there were more discussion on HN about the various plans that the various labs have to keep AI aligned or maybe about the various arguments for why alignment will be easy or happen naturally, so there's no need to carefully plan for it.
But what HN has instead is extensive discussion about whether people who oppose the continuation of AI research are morally degenerate in one way or another (or weird or ridiculous)—in other words, attempts to cancel them (or laugh them out of the room) before the listener hears their arguments.
Also, if you're going to talk about the corrupting or biasing effects of a flow of money (like the OP does) you should at least mention the absolutely huge flow of money going (from investors and users) to the people building AI—or or the $140 million that has been donated to the "Leading the Future" Network (a pro-AI political action committee) or the $3.5 million OpenAI has spent on federal lobbying or the $3.1 million Anthropic has spent.
by hollerith - Any actually-reasonable person who was around for the founding craze of this era, ie., New Atheism, quickly realised that there was a deep pathology at the heart of many of its zealots, perhaps summed up by a desired to "recreate religion in their own image". I've walked into many a room of people screaming that teaching children falsehoods is literally child abuse. Any one who knows much of Richard Dawkins, Krauss, et al.'s background with women shouldnt be surprised either.
It's californication into the "rationalist" community as it currently stands is no surprise. Every person I've met deep in this community either seemed to me a narcissist (if male) or, politely and mildly, coquettish (if female). With several relationships I've observed a clear union of the two. I hadn't yet put this so clearly together with the "AI Saftey" crowd, despite being directly adjacent to it all for quite awhile and seeing the cross-proliferation.
My own analysis had concerned their philosophical naivety, general lack of actual computer science knowledge and generic shallowness of understanding of any domain outside their own research and a kind of "science-fiction" version of philosophy and rationalism. I hadn't connected this yet to their strange personalities, but the apoclypticism fits and neatly bridges these together.
So what became of the New Atheist project to create a "secular religion" -- an apocalyptic sex cult furnished by a blend of sci-fi, pop-philosophy, and cute parables from polymath medical professionals. All in all then, it seems they succeeded.
by mjburgess - >She has a rape kink
That's enough internet for today, back to playing video games
by haunter - There's a great movie or Streaming series on this post somewhere.
Sometimes people can be too smart for their own good. Like a frontier model in an eternal hallucination loop, you can create entire seemingly consistent realities in your head and end up bringing others into it.
by glimshe - I've tried to read this, but somehow the article doesn't really come to a point. Is there any point besides Yud not being perfect, and having connections to people who openly talk about their sex life (and that it's somewhat non-standard)?by perlgeek
- I too wrote about this, although _much_ longer, if you want a bit of a deeper dive on the subject https://www.iankduncan.com/personal/2026-09-16-sex-ai-and-th...by iand675
- There are better ways to make this criticism. The main problem I see with this is that it's basically a long ad hominem, followed by some valid concerns about market concentration at the end.
Remove all the ad hominem and what remains is two paragraphs long. Valid ones, though.
by alexgieg