Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- I see this at work. People are "writing" specs and design proposals with bots. This is noticeable and is a huge turn off. I don't have issues with using bots to aid research, but I'm not reading the doc you slopped together.by jimbobimbo
- I was so optimistic about using LLMs for "write once, read many" English language documents, but the more I've used the tools, the more pessimistic I get.
More and more, I try to ask it for low prose responses because its writing just seems like such a low signal to noise ratio
I'm curious about why LLM writing fails. Particularly whether LLM writing is fundamentally flawed, or if it's just distinctive and since it often reflects low effort, that distinctive voice is associated with low quality.
I find its reliance on extremely consistent rhetorical patterns concerning. The fact that it always finds a way to talk about how "It's not the X, it's the Y Z" no matter what topic you feed it, makes me concerned that the tail is wagging the dog
by ahepp - I enjoyed the piece. Yet, what I don't understand is the author's endorsement of Pangram ... I don't like that without interacting with authors they just labeled texts (articles, novels etc.) as AI generated (they got a lot of publicity with it). Yet, given that the work is probabilistic and there's never 100 %, I find that irresponsible. I would have expected that they would have had at least the decency to tell the authors before they published their "accusations" publicly.
Also, there are relatively easy ways to prevent being recognized and I assume as now the use of LLMs changes our way of writing and speaking, it will get harder and harder for these detection tools. We will see more false positives (as for the future there will be no text 100 % authored by humans to train on).
https://www.lesswrong.com/posts/hrpQxfYvF6CBGWfJX/pangram-ai...
As English is my second language, I find the help of an LLM in editing text very useful. Yet, I agree with others that I don't want to read completely LLM generated texts.
by kgarten - For me it’s AI videos or music / narration that is beyond off putting. What’s worse now it seems people are writing their YouTube scripts with Claude et al. so at times even if it is a human creator you can clearly and immediately tell the words are not their own. To those creators I have but one message: IT SUCKS. I’d rather have you ramble incoherently in your mic then reading an LLM script and I will remove you from my feed immediately. I concur with the author on all accounts. We all can tell the BS people are selling us, unoriginal ideas, shallow concepts, open ended questions that hint at exactly nothing. Don’t be an LLM echo
- Disclaimer: I do not like to read LLM-generated text any more than anyone else.
IMHO a big problem with Pangram in particular is that they market it as a reliable tool that can be used to catch students cheating. This can obviously have disastrous effects on young lives, because it is not as reliable as they suggest.
Per their own benchmarks, they do not achieve 100% accuracy even on text that is published on the Internet, and which is likely encoded into the models themselves.
There is validity to their goals, but that is overshadowed by the irresponsible way in which it is marketed.
(All of this, swirling in a context where students are being told that they absolutely must become proficient at using LLMs to do exactly this kind of work by the highest levels of state and federal governments, faculty leadership, as well as the leaders of the workforce into which they hope to graduate. The message to youth is extremely muddled at best.)
by runako - Someone should make a browser extension to label HN posts with Pangram results of the top 100 posts, so I don't waste my time reading crap.
Always a pleasure reading Bryan's writing; it's like Bryan is sitting there with you and saying the words (hard to convey the feeling).
by duhhhhh1212 - I would love to use Pangram but they simply don’t allow signing up with my custom email domain. The error was “This email address can't be used for signup. Please use a different email.” I’m not about to create a Gmail is to use your service. To me the attack on the decentralized nature on Internet infrastructure is no less serious than the attack on the human provenance of writing itself.by kccqzy
- My revolt is against the cognitive stress of reading generated text. A trope typically indicates I’m in for an uphill read.
I recently read this William Zinsser quote that inspired a nickname for this: Clotted Claude [1].
> Nobody has made the point better than George Orwell in his translation into modern bureaucratic fuzz of this famous verse from Ecclesiastes:
> > I returned and saw under the sun, that the race is not to the swift, nor the battle to the strong, neither yet bread to the wise, nor yet riches to men of understanding, nor yet favor to men of skill; but time and chance happeneth to them all.
> Orwell's version goes:
> > Objective consideration of contemporary phenomena compels the conclusion that success or failure in competitive activities exhibits no tendency to be commensurate with innate capacity, but that a considerable element of the unpredictable must invariably be taken into account.
> First notice how the two passages look. The first one at the top invites us to read it. The words are short and have air around them; they convey the rhythms of human speech. The second one is clotted with long words. It tells us instantly that a ponderous mind is at work. We don't want to go anywhere with a mind that expresses itself in such suffocating language. We don't even start to read.
by kierangill