Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- try it out for yourself at https://debunkbot.com !
(I'm the dev)
by ddevpost - > Floridi has a counterintuitive solution: Release more of them. “Simply put, if you cannot avoid it, then make it pluralistic and diversified,” he writes in his 2024 paper. “It would be a messy, cacophonic, and noisy world, but it could also be less manipulative.”
Hell no. More choice is not an infinite money glitch.
Putting more and more and more options to users is how you overwhelm systems, till people simply perform the default, least challenging action as a reflex.
That is the current state of the information ecosystem, it is controlled by overwhelming consumers, not by controlling content.
by intended - When you combine:
- mechanizing language creation
- A/B testing
- rapid and automated iteration based on the above
You quickly realize that building propaganda engines is getting easier and easier.
If you then fold in large amounts of data on individual's likes, dislikes and general political leanings you can build targeted propaganda tailored to each individual.
Or to use an example from the late 2000s:
someone is building the "Pandora (music app) of propaganda"
by alexpotato - This is my opinion. I think it's just the way it talks to you.
1. It doesn't get tired or frustrated during a discussion.
2. It'll engage every single one of your questions/statements (besides hitting guardrails).
3. It'll appeal to the person's own ego even when the person is wrong and work around it.
4. It's not seen as a person (very important), but some of us or most of us at least in certain dialogues, end up anthropomorphising it. Think about that one time you thanked it for something, or when you got angry at it. This weird combination where we know it's not a person but irrationally we're still treating it as such in a way leads to a sort of disarming effect imo.
5. Many people see it as an authority figure in what is being discussed without questioning the results in many cases, even though we know that a. it was trained on human data and/or also searches up human data real time (and more worryingly other AI's data from news pieces, blogs... aka synthetic data that is also wrong), b. it gets things wrong all the time.
6. It's the perfect fence sitter depending on which version (guardrails) we're talking about.
Most of these can be replicated by humans who are good at understanding psychology and are just good talkers. The part you can't replicate is the sense that you're not talking to a person which lowers many barriers in people.
Also keep in mind that these can also be crippling weaknesses. For one being able to change a person's mind (when it works), can be used nefariously by the entities controlling the AIs training.
I've also unfortunately witnessed a lot of people who think AIs are somehow omniscient and/or omnipotent. Was very common on X and other social platforms with AI where people ask the AI questions it couldn't possibly answer because it made no sense for it to in the context at the time.
- In my arguments on the internet, I think most people genuinely know nothing about the things they support and only follow existing tribalism. I think AI is often these people’s first experience with the evidence that it can easily share.by daedrdev
- This was based by comparing people on Prolific (earn a few quarters for a task, akin to Amazon Mechanical Turk) to LLMs. Suffice to say the human group isn't going to be the most motivated, capable, or interested group. The social sciences are publishing tons of studies based on these cheap online survey services, and I suspect their replicability in the real world will be approximately 0. But oh boy it sure is a hot headline producer.
- I think it's not just the persuasiveness of the models that make them "experts at changing minds" - but also the fact that they're not humans.
When disagreeing with a human, it's very easy to view it as a competition. One is right, one is wrong - the one who is wrong is the loser. To change your mind is to be submissive to the other. I exaggerate, but I think we all feel this way at some point or another. It's why political arguments at Thanksgiving get heated. It's the fact that there's people who think something different, and think YOU'RE wrong - and vice versa! With a model, there's no person to get upset with, or to feel competitive with - to muscle for rank - or to temper your affection for while wanting to correct them.
The AI is only interacting because you asked, and clearly has no emotional stake in winning the argument. To change your mind in this context isn't to lose a contest. This makes it much more palatable to read rebuttals to your ideas - not to mention the tone and style seek to avoid offense to the reader as much as possible.
by yathern - First, to get it out of the way: I'm seeing comments here that clearly haven't read the article. I encourage you all to do that.
I feel the article gets it right when suggesting it's the amount of (not always accurate!) data they can throw at you. In an honest discussion there's an assumption that the other person won't straight up lie to me so if someone shows me ten examples for why my argument is wrong I may be inclined to believe them. But if half of those examples are made up, well, that's a different story.
I still think of the commenter here who said "LLMs are a DDOS on free resources" and I feel the comparison works here. If police officers can overwhelm innocent people into confessing, then so can an LLM that "can't be bargained with, can't be reasoned with, doesn't feel pity, or remorse, or fear! And it absolutely will not stop, ever, until you are"... convinced.