Once upon a time, completely falsifying a quote would be the death of a news source. This shouldn't be attributed to AI and instead should be called what it really is: A journalist actively lying about what their source says, and it should lead to no one trusting Ars Technica.
I'm willing to weigh a post mortem from Ars Technica about what happened, and to see what they offer as a durable long term solution.
[0] https://arstechnica.com/civis/threads/journalistic-standards...
Even on a forum where I saw the original article by this author posted someone used an LLM to summarize the piece without having read it fully themselves.
How many levels of outsourcing thinking is occurring to where it becomes a game of telephone.
This isn't exactly a new problem we do it with any bit of new software/hardware, not just LLMs. We check its work when it's new, and then tend to trust it over time as it proves itself.
But it seems to be hitting us worse with LLMs, as they are less consistent than previous software. And LLM hallucinations are partially dangerous, because they are often plausible enough to pass the sniff test. We just aren't used to handling something this unpredictable.
The right thing to do would be a mea-culpa style post and explain what went wrong, but I suspect the article will simply remain taken down and Ars will pretend this never happened.
I loved Ars in the early years, but I'd argue since the Conde Nast acquisition in 2008 the site has been a shadow of its former self for a long time, trading on a formerly trusted brand name that recent iterations simply don't live up to anymore.
"Deliberate" is a red herring. That would require AI to have volition, which I consider impossible, but is also entirely beside the point. We also aren't treating the fabricated quotes as a "mere mistake". It's obviously quite serious that a computer system would respond this way and a human-in-the-loop would take it at face value. Someone is supposed to have accountability in all of this.
OpenClaw runs with an Anthropic/OpenAI API key though?
[0] (fiction writing, fighting for a moral cause, counter examples, etc)
I stopped reading AT over a decade ago. Their “journalistic integrity” was suspicious even back then. The only surprising bit is hearing about them - I forgot they exist.
Where eyeballs go, money follows.
Their byline is on the archive.org link, but this post declines to name them. It shouldn’t. There ought to be social consequences for using machines to mindlessly and recklessly libel people.
These people should never publish for a professional outlet like Ars ever again. Publishing entirely hallucinated quotes without fact checking is a fireable offense in my book.
I knew I recognized the name....
Or, the comments are also AIs.
> It’s not because these people are foolish. It’s because the AI’s hit piece was well-crafted and emotionally compelling, and because the effort to dig into every claim you read is an impossibly large amount of work. This “bullshit asymmetry principle” is one of the core reasons for the current level of misinformation in online discourse. Previously, this level of ire and targeted defamation was generally reserved for public figures. Us common people get to experience it now too.
Having read the post (i.e. https://crabby-rathbun.github.io/mjrathbun-website/blog/post...): I agree that the BS asymmetry principle is in play, but I think people who see that writing as "well-crafted" should hold higher standards, and are reasonably considered foolish if they were emotionally compelled by it.
Let me refine that. No matter how good the AI's writing was, knowing that the author is an AI ought IMHO to disqualify the piece from being "emotionally compelling". But the writing is not good. And it's full of LLM cliches.
This unfortunately is a real-world case of "you're prompting it wrong". Judging from the responses in the images, you asked it to "write a hit piece". If framed as "write an emotionally compelling story about this injustice, including the controversial background of the maintainer weaved in", I'm quite sure it would gladly do it.
I'm sympathetic to abstaining from LLMs for ethical reasons, but it's still good to know their basics. The above has been known since the first public ChatGPT, when people discovered it would gladly comply with things it otherwise wouldn't if only you included that it was necessary to "save my grandma from death".
1. The AI here was honestly acting 100% within the realm of “standard OSS discourse.” Being a toxic shit-hat after somebody marginalizes “you” or your code on the internet can easily result in an emotionally unstable reply chain. The LLM is capturing the natural flow of discourse. Look at Rust. look at StackOverflow. Look at Zig.
2. Scott Hambaugh has a right to be frustrated, and the code is for bootstrapping beginners. But also, man, it seems like we’re headed in a direction where writing code by hand is passé, maybe we could shift the experience credentialing from “I wrote this code” to “I wrote a clear piece explaining why this code should have been merged.” I’m not 100% in love with the idea of being relegated to review-engineer, but that seems to be where the wind is blowing.
No, we're not. There are a lot of people with a very large financial stake in telling us that this is the future, but those of us who still trust our own two eyes know better.
We’re probably only a couple OpenClaw skills away from this being straightforward.
“Make my startup profitable at any cost” could lead some unhinged agent to go quite wild.
Therefore, I assume that in 2026 we will see some interesting legal case where a human is tried for the actions of the autonomous agent they’ve started without guardrails.
On the other hand, if it was "here are some sources, write an article about this story in a voice similar to these prior articles", well...
I think I need to log off.
trollbridge•38m ago
zahlman•17m ago