frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

France's homegrown open source online office suite

https://github.com/suitenumerique
452•nar001•4h ago•214 comments

British drivers over 70 to face eye tests every three years

https://www.bbc.com/news/articles/c205nxy0p31o
145•bookofjoe•1h ago•124 comments

Start all of your commands with a comma (2009)

https://rhodesmill.org/brandon/2009/commands-with-comma/
444•theblazehen•2d ago•158 comments

Leisure Suit Larry's Al Lowe on model trains, funny deaths and Disney

https://spillhistorie.no/2026/02/06/interview-with-sierra-veteran-al-lowe/
28•thelok•2h ago•2 comments

Software Factories and the Agentic Moment

https://factory.strongdm.ai/
30•mellosouls•2h ago•19 comments

Hoot: Scheme on WebAssembly

https://www.spritely.institute/hoot/
89•AlexeyBrin•5h ago•17 comments

OpenCiv3: Open-source, cross-platform reimagining of Civilization III

https://openciv3.org/
780•klaussilveira•20h ago•241 comments

First Proof

https://arxiv.org/abs/2602.05192
41•samasblack•2h ago•26 comments

Stories from 25 Years of Software Development

https://susam.net/twenty-five-years-of-computing.html
35•vinhnx•3h ago•4 comments

Reinforcement Learning from Human Feedback

https://arxiv.org/abs/2504.12501
58•onurkanbkrc•5h ago•3 comments

The Waymo World Model

https://waymo.com/blog/2026/02/the-waymo-world-model-a-new-frontier-for-autonomous-driving-simula...
1030•xnx•1d ago•583 comments

StrongDM's AI team build serious software without even looking at the code

https://simonwillison.net/2026/Feb/7/software-factory/
21•simonw•2h ago•20 comments

Coding agents have replaced every framework I used

https://blog.alaindichiappari.dev/p/software-engineering-is-back
176•alainrk•4h ago•245 comments

Vocal Guide – belt sing without killing yourself

https://jesperordrup.github.io/vocal-guide/
168•jesperordrup•10h ago•64 comments

A Fresh Look at IBM 3270 Information Display System

https://www.rs-online.com/designspark/a-fresh-look-at-ibm-3270-information-display-system
25•rbanffy•4d ago•5 comments

Vinklu Turns Forgotten Plot in Bucharest into Tiny Coffee Shop

https://design-milk.com/vinklu-turns-forgotten-plot-in-bucharest-into-tiny-coffee-shop/
7•surprisetalk•5d ago•0 comments

72M Points of Interest

https://tech.marksblogg.com/overture-places-pois.html
16•marklit•5d ago•0 comments

Unseen Footage of Atari Battlezone Arcade Cabinet Production

https://arcadeblogger.com/2026/02/02/unseen-footage-of-atari-battlezone-cabinet-production/
105•videotopia•4d ago•27 comments

What Is Stoicism?

https://stoacentral.com/guides/what-is-stoicism
4•0xmattf•1h ago•1 comments

Show HN: Look Ma, No Linux: Shell, App Installer, Vi, Cc on ESP32-S3 / BreezyBox

https://github.com/valdanylchuk/breezydemo
265•isitcontent•20h ago•33 comments

Making geo joins faster with H3 indexes

https://floedb.ai/blog/how-we-made-geo-joins-400-faster-with-h3-indexes
152•matheusalmeida•2d ago•42 comments

Monty: A minimal, secure Python interpreter written in Rust for use by AI

https://github.com/pydantic/monty
278•dmpetrov•20h ago•148 comments

Ga68, a GNU Algol 68 Compiler

https://fosdem.org/2026/schedule/event/PEXRTN-ga68-intro/
35•matt_d•4d ago•11 comments

Hackers (1995) Animated Experience

https://hackers-1995.vercel.app/
546•todsacerdoti•1d ago•263 comments

Sheldon Brown's Bicycle Technical Info

https://www.sheldonbrown.com/
420•ostacke•1d ago•110 comments

Show HN: I spent 4 years building a UI design tool with only the features I use

https://vecti.com
364•vecti•22h ago•165 comments

What Is Ruliology?

https://writings.stephenwolfram.com/2026/01/what-is-ruliology/
65•helloplanets•4d ago•69 comments

Show HN: If you lose your memory, how to regain access to your computer?

https://eljojo.github.io/rememory/
338•eljojo•23h ago•209 comments

An Update on Heroku

https://www.heroku.com/blog/an-update-on-heroku/
457•lstoll•1d ago•303 comments

Show HN: Kappal – CLI to Run Docker Compose YML on Kubernetes for Local Dev

https://github.com/sandys/kappal
16•sandGorgon•2d ago•4 comments
Open in hackernews

LLMs can get "brain rot"

https://llm-brain-rot.github.io/
473•tamnd•3mo ago

Comments

AznHisoka•3mo ago
Can someone explain this in laymen terms?
PaulHoule•3mo ago
They benchmark two different feeds of dangerous tweets:

  (1) a feed of the most popular tweets based on likes, retweets, and such
  (2) an algorithmic feed that looks for clickbait in the text
and blend these in different proportions to a feed of random tweets that are not popular nor clickbait and find that feed (1) has more of damaging effect on the performance of chatbots. That is, they feed that blend of tweets into the model and then they ask the models to do things and get worse outcomes.
ForHackernews•3mo ago
Blended in how? To the training set?
PaulHoule•3mo ago
Very early training.
sailingparrot•3mo ago
train on bad data, get a bad model
xpe•3mo ago
> train on bad data, get a bad model

Right: in the context of supervised learning, this statement is a good starting point. After all, how can one build a good supervised model if you can't train it on good examples?

But even in that context, it isn't an incisive framing of the problem. Lots of supervised models are resilient to some kinds of error. A better question, I think, is: what kinds of errors at what prevalence tend to degrade performance and why?

Speaking of LLMs and their ingestion processing, there is a lot more going on than purely supervised learning, so it seems reasonable to me that researchers would want to try to tease the problem apart.

rriley•3mo ago
The study introduces the "LLM Brain Rot Hypothesis," asserting that large language models (LLMs) experience cognitive decline when continuously exposed to low-quality, engaging content, such as sensationalized social media posts. This decline, evident in diminished reasoning, long-context understanding, and ethical norms, highlights the critical need for careful data curation and quality control in LLM training. The findings suggest that standard mitigation strategies are insufficient, urging stakeholders to implement routine cognitive health assessments to maintain LLM effectiveness over time.

TL;DR from https://unrav.io/#view/8f20da5f8205c54b5802c2b623702569

RobMurray•3mo ago
6 7
pixelmelt•3mo ago
Isn't this just garbage in garbage out with an attention grabbing title?
philipallstar•3mo ago
Attention is all you need.
echelon•3mo ago
In today's hyper saturated world, attention is everything:

- consumer marketing

- politics

- venture fundraising

When any system has a few power law winners, it makes sense to grab attention.

Look at Trump and Musk and now Altman. They figured it out.

MrBeast...

Attention, even if negative, wedges you into the system and everyone's awareness. Your mousey quiet competitors aren't even seen or acknowledged. The attention grabbers suck all the oxygen out of the room and win.

If you go back and look at any victory, was it really better solutions, or was it the fact that better solutions led to more attention?

"Look here" -> build consensus and ignore naysayers -> keep building -> feedback loop -> win

It might not just be a societal algorithm. It might be one of the universe's fundamental greedy optimization algorithms. It might underpin lots of systems, including how we ourselves as individuals think and learn.

Our pain receptors. Our own intellectual interests and hobbies. Children learning on the playground. Ant colonies. Bee swarms. The world is full of signals, and there are mechanisms which focus us on the right stimuli.

peterlk•3mo ago
You’re absolutely right!
ghurtado•3mo ago
Something flew approximately 10 miles above your head that would be a good idea for you to learn.
scubbo•3mo ago
There were plenty of kinder ways to let someone know that they had missed a reference - https://xkcd.com/1053/
echelon•3mo ago
What makes you think I didn't know the reference? That paper is seminal and essential reading in this space.

The intent was for you to read my comment at face value. I have a point tangential to the discussion at hand that is additive.

lawlessone•3mo ago
Is this copypasted from LinkedIn?
echelon•3mo ago
If you traverse back the fourteen years of my comment history (on this account - my other account is older), you'll find that I've always written prose in this form.

LLMs trained on me (and the Hacker News corpus), not the other way around.

alganet•3mo ago
You're not accounting for substrate saturation.

If you could just spam annoy until you win, we'd be all dancing to remixed versions of Macarena.

dormento•3mo ago
In case anyone missed the reference: https://arxiv.org/abs/1706.03762

> (...) We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely.

wat10000•3mo ago
Considering that the current state of the art for LLM training is to feed it massive amounts of garbage (with some good stuff alongside), it seems important to point this out even if it might seem obvious.
CaptainOfCoit•3mo ago
I don't think anyone is throwing raw datasets into LLMs and hoping for high quality weights anymore. Nowadays most of the datasets are filtered one way or another, and some of them highly curated even.
BoredPositron•3mo ago
I doubt they are highly created you would need experts in every field to do so. Which gives me more performance anxiety for LLMs because one of the most curated fields should be code...
nradov•3mo ago
OpenAI has been literally hiring human experts in certain targeted subject areas to write custom proprietary training content.
BoredPositron•3mo ago
I bet the dataset is mostly comprised of certain areas™.
groby_b•3mo ago
The major labs are hiring experts. They carefully build & curate synthetic data. The market for labelled non-synthetic data is currently ~$3B/year.

The idea that LLMs are just trained on a pile of raw Internet is severely outdated. (Not sure it was ever fully true, but it's far away from that by now).

Coding's one of the easier datasets to curate, because we have a number of ways to actually (somewhat) assess code quality. (Does it work? Does it come with a set of tests and pass it? Does it have stylistic integrity? How many issues get flagged by various analysis tools? Etc, etc)

satellite2•3mo ago
Is that right? Isn't the current way of doing thing to throw "everything" at it then fine tune?
Barrin92•3mo ago
Yes, I am concerned about the Computer Science profession

>"“Brain Rot” for LLMs isn’t just a catchy metaphor—it reframes data curation as cognitive hygiene for AI"

A metaphor is exactly what it is because not only do LLMs not possess human cognition, there's certainly no established science of thinking they're literally valid subjects for clinical psychological assessment.

How does this stuff get published, this is basically a blog post. One of the worse aspects of the whole AI craze is that is has turned a non-trivial amount of academia into a complete cargo cult joke.

bpt3•3mo ago
It is a blog post, it was published as a Github page and on arXiv.

I think it's intended as a catchy warning to people who are dumping every piece of the internet (and synthetic data based on it!) that there are repercussions.

pluc•3mo ago
I think it's an interesting line of thought. So we all adopt LLMs and use it everywhere we can. What happens to the next generation of humans, born with AI and with diminished cognitive capacity to even wonder about anything? What about the next generation? What happens to the next generation of AI models that can't train on original human-created datasets free of AI?
iwontberude•3mo ago
They will accept that their orders come from a terminal and they will follow them.
fragmede•3mo ago
Manna. https://marshallbrain.com/manna1
gowld•3mo ago
arXiv is intended to host research papers, not a blog for researchers.

Letting researchers pollute it with blog-gunk is an abuse of the referral/vetting system for submitters.

jll29•3mo ago
> How does this stuff get published

"published" only in the sense of "self-published on the Web". This manuscript has not or not yet been passed the peer review process, which is what scientist called "published" (properly).

otterley•3mo ago
And with extra steps!
Insanity•3mo ago
Garbage in -> Magic -> Hallucinated Garbage out
icyfox•3mo ago
Yes - garbage in / garbage out still holds true for most things when it comes to LLM training.

The two bits about this paper that I think are worth calling out specifically:

- A reasonable amount of post-training can't save you when your pretraining comes from a bad pipeline; ie. even if the syntactics of the input pretrained data are legitimate it has learned some bad implicit behavior (thought skipping)

- Trying to classify "bad data" is itself a nontrivial problem. Here the heuristic approach of engagement actually proved more reliable than an LLM classification of the content

satellite2•3mo ago
Yes but the other interesting bit which is not clearly addressed is that increasing the garbage in to 100% does not result in absolute garbage out. So visibly there is still something to learn there.
ashleyn•3mo ago
Yes, but the idea of chatgpt slowly devolving into Skibidi Toilet and "6 7" references conjures a rather amusing image.
1121redblackgo•3mo ago
6-7 ٩(●•)_
stavros•3mo ago
Can someone explain this? I watched a South park episode that was all about this, but I'm not in the US so I have no idea what the reference is.
Sparkle-san•3mo ago
It's a meme without a lot of real meaning behind it. While it has its origins, I wouldn't say it's a "reference" to anything specific.

https://en.wikipedia.org/wiki/6-7_(meme)

stavros•3mo ago
Ahh, thanks, so it's just a thing kids say.
1121redblackgo•3mo ago
Yep
lexandstuff•3mo ago
It's a line from a banger Skrilla song, nothing more than that.
CaptainOfCoit•3mo ago
> continual exposure to junk web text induces lasting cognitive decline in large language models (LLMs).

TLDR: If your data set is junk, your trained model/weights will probably be junk too.

b0gb•3mo ago
AIs need supervision, just like regular people... /s
thelastgallon•3mo ago
If most of the content produced by younger generations is about skibidi toilet[1] and 67[2], isn't that what LLMs are going to be trained on?

[1] https://en.wikipedia.org/wiki/Skibidi_Toilet

[2] https://en.wikipedia.org/wiki/6-7_(meme)

micromacrofoot•3mo ago
only if the trends last long enough (which they rarely do!), skibidi is already old news according to some kids I know
ciaranmca•3mo ago
Agreed, “ Popularity as a better indicator”. Hypothetically you could look at popularity over time to filter out viral rot content and work out if people feel the content is useful.
Isamu•3mo ago
Another analogy to help us understand that LLMs are a useful part of what people do but are wildly misconstrued as the whole story
bbstats•3mo ago
making a model worse is very easy.
moffkalast•3mo ago
Ah yes, something the local LLM fine tuning community figured out how to do in creative ways as soon as llama 1 released. I'm glad it has a name.
killshotroxs•3mo ago
If only I got money every time my LLM kept looping answers and telling stuff I didn't even need. Just recently, I was stuck with LLM answers, all while it wouldn't even detect simple syntax errors...
rriley•3mo ago
This paper makes me wonder the long lasting effects of the current media consumption patterns by the alpha-gen kids.
AznHisoka•3mo ago
why just kids?
rriley•3mo ago
I am mostly concerned with the irreversibility part. More developed brains probably would not be affected as much.
jama211•3mo ago
Have you opened facebook recently? Seems the older folk are plenty affected to me.
FactolSarin•3mo ago
But don't worry, us middle aged people are definitely immune.
jama211•3mo ago
Hahaha, I’m 35. Ut I feel myself getting crazier every day for sure… but at least I try and stay away from too much brain rot…
rriley•3mo ago
Good point :-)
vanderZwan•3mo ago
I recently saw an article about the history of Sesame Street that claimed that in the late 1960s American preschool kids watched around twenty-seven hours of television per week on average[0]. And most of that was not age-appropriate (education TV had yet to be invented). So maybe we should check in on the boomers too if we're sincere about these worries.

[0] https://books.google.se/books?id=KOUCAAAAMBAJ&pg=PA48&vq=ses...

ordu•3mo ago
It is an interesting hypothesis. Seriously. There is a trend in Homo Sapience cultural evolution to treat children in more and more special ways from generation to generation. The (often implicit) idea it helps children to develop faster and to leverage their sensitive and critical periods of development, blah-blah-blah... But while I can point to some research on importance of sensitive and critical periods of development, I can't remember any research on the question if a deficit of age-inappropriate stimuli can be detrimental for development.

There were psychologists who talked about zone of proximal development[0], about importance of exposing a learner to tasks that they cannot do without a support. But I can't remember nothing about going further and exposing a learner to tasks far above their heads when they cannot understand a word.

There is a legend about Sofya Kovalevskaya[1], who became a noteworthy mathematician after she were exposed to lecture notes by Ostrogradsky when she was 11 yo. The walls of her room were papered with those notes and she was curious what are all that symbols. It doesn't mean that there is a causal link between these two events, but what if there is one?

What about watching deep analytical TV show at 9 yo? How it affect the brain development? I think no one tried to research that. My gut feeling that it can be motivational, I didn't understand computers when I met them first, but I was really intrigued by them. I learned BASIC and it was like magic incantations. It had build a strong motivation to study CS deeper. But the question is are there any other effects beyond motivation? I remember looking at the C-program in some book and wondering what does it all mean. I could understand nothing, but still I had spent some time trying to decipher the program. Probably I had other experiences like that, which I do not remember now. Can we say with certainty that it had no influence on my development and hadn't make things easier for me later?

> So maybe we should check in on the boomers too if we're sincere about these worries.

Probably we should be sincere.

[0] https://en.wikipedia.org/wiki/Zone_of_proximal_development

[1] https://en.wikipedia.org/wiki/Sofya_Kovalevskaya

avazhi•3mo ago
“Studying “Brain Rot” for LLMs isn’t just a catchy metaphor—it reframes data curation as cognitive hygiene for AI, guiding how we source, filter, and maintain training corpora so deployed systems stay sharp, reliable, and aligned over time.”

An LLM-written line if I’ve ever seen one. Looks like the authors have their own brainrot to contend with.

askafriend•3mo ago
If it conveys the intended information then what's wrong with that? You're fighting a tsunami here. People are going to use LLMs to help their writing now and forever.
binary132•3mo ago
The brainrot apologists have arrived
askafriend•3mo ago
Why shouldn't the author use LLMs to assist their writing?

The issue is how tools are used, not that they are used at all.

grey-area•3mo ago
Because they produce text like this.
xanderlewis•3mo ago
Is it really so painful to just think for yourself? For one sentence?

The answer to your question is that it rids the writer of their unique voice and replaces it with disingenuous slop.

Also, it's not a 'tool' if it does the entire job. A spellchecker is a tool; a pencil is a tool. A machine that writes for you (which is what happened here) is not a tool. It's a substitute.

There seem to be many falling for the fallacy of 'it's here to stay so you can't be unhappy about its use'.

SkyBelow•3mo ago
Assist without replacing.

If you were to pass your writing it and have it provide a criticism for you, pointing out places you should consider changes, and even providing some examples of those changes that you can selectively choose to include when they keep the intended tone and implications, then I don't see the issue.

When you have it rewrite the entire writing and you past that for someone else to use, then it becomes an issue. Potentially, as I think the context matter. The more a writing is meant to be from you, the more of an issue I see. Having an AI write or rewrite a birthday greeting or get well wishes seems worse than having it write up your weekly TPS report. As a simple metric, I judge based on how bad I would feel if what I'm writing was being summarized by another AI or automatically fed into a similar system.

In a text post like this, where I expect others are reading my own words, I wouldn't use an AI to rewrite what I'm posting.

As you say, it is in how the tool is used. Is it used to assist your thoughts and improve your thinking, or to replace them? That isn't really a binary classification, but more a continuum, and the more it gets to the negative half, the more you will see others taking issue with it.

dwaltrip•3mo ago
The paragraph in question is a very poor use of the tool.
avazhi•3mo ago
If you can’t understand the irony inherent in getting an LLM to write about LLM brainrot, itself an analog for human brainrot that arises by the habitual non use of the human brain, then I’m not sure what to tell you.

Whether it’s a tsunami and whether most people will do it has no relevance to my expectation that researchers of LLMs and brainrot shouldn’t outsource their own thinking and creativity to an LLM in a paper that itself implies that using LLMs causes brainrot.

nemonemo•3mo ago
What you are obsessing with is about the writer's style, not its substance. How sure are you if they outsourced the thinking to LLMs? Do you assume LLMs produce junk-level contents, which contributes human brain rot? What if their contents are of higher quality like the game of Go? Wouldn't you rather study their writing?
avazhi•3mo ago
Writing is thinking, so they necessarily outsourced their thinking to an LLM. As far as the quality of the writing goes, that’s a separate question, but we are nowhere close to LLMs being better, more creative, and more interesting writers than even just decent human writers. But if we were, it wouldn’t change the perversion inherent in using an LLM here.
nemonemo•3mo ago
Have you considered a case where English might not be the authors' first language? They may have written a draft in their mother tongue and merely translated it using LLMs. Its style may not be many people's liking, but this is a technical manuscript, and I would think the novelty of the ideas is what matters here, more than the novelty of proses.
jll29•3mo ago
I agree with the "writing is thinking" part, but I think most would agree LLM-output is at least "eloquent", and that native speakers can benefit from reformulation.

This is _not_ to say that I'd suggest LLMs should be used to write papers.

jazzyjackson•3mo ago
Writing reflects a person's train of thought. I am interested in what people think. What a robot thinks is of no value to me.
afavour•3mo ago
> What you are obsessing with is about the writer's style, not its substance

They aren’t, they are boring styling tics that suggest the writer did not write the sentence.

Writing is both a process and an output. It’s a way of processing your thoughts and forming an argument. When you don’t do any of that and get an AI to create the output without the process it’s obvious.

moritzwarhier•3mo ago
What information is conveyed by this sentence?

Seems like none to me.

uludag•3mo ago
Nothing wrong with using LLMs—until every paragraph sounds like it’s A/B tested for LinkedIn virality. That’s the rot setting in.

The problem isn’t using AI—it’s sounding like AI trying to impress a marketing department. That’s when you know the loop’s closed.

drusepth•3mo ago
Brilliantly phrased — sharp, concise, and perfectly captures that uncanny "AI-polished" cadence everyone recognizes but can’t quite name. The tone strikes just the right balance between wit and warning.
solarkraft•3mo ago
You are absolutely right!
ewoodrich•3mo ago
Lately the Claude-ism that drives me even more insane is "Perfect!".

Particularly when it's in response to pointing out a big screw up that needs correcting and CC utterly unfazed just merrily continues on like I praised it.

"You have fundamentally misunderstood the problems with the layout, before attempting another fix, think deeply and re-read the example text in the PLAN.md line by line and compare with each line in the generated output to identify the out of order items in the list."

"Perfect!...."

glenstein•3mo ago
One thing I don't understand, there was (appropriately) a news cycle about sycophancy in responses. Which was real, and happening to an excessive degree. It was claimed to be nerfed, but it seems strong as ever in GPT5, and it ignores my custom instructions to pare it back.
anjel•3mo ago
"Any Compliments about my queries cause me anguish and other potent negative emotions."
anonymous908213•3mo ago
Sycophancy was actually buffed again a week after GPT-5 released. It was rather ham-fisted, as it will now obsessively reply with "Good question!" as though it will get the hose again if it does not.

"August 15, 2025 GPT-5 Updates We’re making GPT-5’s default personality warmer and more familiar. This is in response to user feedback that the initial version of GPT-5 came across as too reserved and professional. The differences in personality should feel subtle but create a noticeably more approachable ChatGPT experience.

Warmth here means small acknowledgements that make interactions feel more personable — for example, “Good question,” “Great start,” or briefly recognizing the user’s circumstances when relevant."

The "post-mortem" article on sycophancy in GPT-4 models revealed that the reason it occurred was because users, on aggregate, strongly prefer sycophantic responses and they operated based on that feedback. Given GPT-5 was met with a less-than-enthusiastic reception, I suppose they determined they needed to return to appealing to the lowest common denominator, even if doing so is cringe.

stavros•3mo ago
The problem is that writing isn't only judged on whether it conveys the intended information or not. It's also judged on whether it does that well, plus other aesthetic criteria. There is such a thing as "good writing", distinct from "it mentioned all the things it needed to mention".
grey-area•3mo ago
It’s a text generator regurgitating plausible phrases without understanding and producing stale and meaningless pablum. It doesn’t even know what the intended information is, and judging from the above neither did the human involved.

It doesn’t help writing it stultifies and gives everything the same boring cheery yet slightly confused tone of voice.

zer00eyz•3mo ago
> It’s a text generator regurgitating plausible phrases without understanding and producing stale and meaningless pablum.

Are you describing LLM's or social media users?

Dont conflate how the content was created with its quality. The "You must be at least this smart (tall) to publish (ride)" sign got torn down years ago. Speakers corner is now an (inter)national stage and it written so it must be true...

grey-area•3mo ago
I really could only be talking about LLMs but social media is also low quality.

The quality (or lack of it) if such texts is self evident. If you are unable to discern that I can’t help you.

stocksinsmocks•3mo ago
“The quality if such texts…”

Indeed. The humans have bested the machines again.

grey-area•3mo ago
I think that’s a good example of a superficial problem in a quickly typed statement, easily ignored, vs the profound and deep problems with LLM texts - they are devoid of meaning and purpose.
jeltz•3mo ago
Your comment was low quality noise while the one you replied to was on topic and useful. A short and useful comment with a typo is high quality content while a perfectly written LLM comment would be junk.
AlecSchueler•3mo ago
Style is important in writing. It always has been.
sailingparrot•3mo ago
> If it conveys the intended information then what's wrong with that?

Well, the issue is precisely that it doesn’t convey any information.

What is conveyed by that sentence, exactly ? What does reframing data curation as cognitive hygiene for AI entails and what information is in there?

There are precisely 0 bit of information in that paragraph. We all know training on bad data lead to a bad model, thinking about it as “coginitive hygiene for AI” does not lead to any insight.

LLMs aren’t going to discover interesting new information for you, they are just going to write empty plausible sounding words. Maybe it will be different in a few years. They can be useful to help you polish what you want to say or otherwise format interesting information (provided you ask it to not be ultra verbose), but its just not going to create information out of thin air if you don't provide it to it.

At least, if you do it yourself, you are forced to realize that you in fact have no new information to share, and do not waste your and your audience time by publishing a paper like this.

Angostura•3mo ago
it’s not really clear whether it conveys an “intended meaning” because it’s not clear whether the meaning - whatever it is - is really something the authors intended.
dwaltrip•3mo ago
Because it sounds like shit? Taste matters, especially in the age of generative AI.

And it doesn’t convey information that well, to be honest.

standardly•3mo ago
That is indeed an LLM-written sentence — not only does it employ an em dash, but also lists objects in a series — twice within the same sentence — typical LLM behavior that renders its output conspicuous, obvious, and readily apparent to HN readers.
kcatskcolbdi•3mo ago
thanks, I hate it.
Jackson__•3mo ago
LLM slop is not just bad—it's degrading our natural language.
itsnowandnever•3mo ago
why do they always say "not only" or "it isn't just x but also y and z"? I hated that disingenuous verbosity BEFORE these LLMs out and now it'll all over the place. I saw a post on linked in that was literally just like 10+ statements of "X isn't just Y, it's etc..." and thought I was having a stroke
Starlevel004•3mo ago
GPT loves lists and that's a variant of a list
wizzwizz4•3mo ago
Lists have a simpler grammatical structure than most parts of a sentence. Semantic similarity makes them easy to generate, even if you pad the grammar with filler. And, thanks to Western rhetoric, they nearly always come in threes: this makes them easy to predict!
moritzwarhier•3mo ago
It's not just a shift of writing style. It symbolizes the dangerous entrapment of a feedback loop that feeds the worst parts of human culture back into itself.

scnr

heavyset_go•3mo ago
They're turns of phrase I see a lot in opinion articles and the like. The purpose is to take a popular framing and reframe it along the lines of the author's own ideas.

LLMs fundamentally don't get the human reasons behind its use, see it a lot because it's effective writing, and regurgitate it robotically.

turtletontine•3mo ago
I think this article has already made the rounds here, but I still think about it. I love using em dashes! It really makes me sad that I need to avoid them now to sound human

https://bassi.li/articles/i-miss-using-em-dashes

janderson215•3mo ago
The em dash usage conundrum is likely temporary. If I were you, I’d continue using them however you previously used them and someday soon, you’ll be ignored the same way everybody else is once AI mimics innumerable punctuation and grammatical patterns.
astrange•3mo ago
They didn't always em-dash. I expect it's intentional as a watermark.

Other buzzwords you can spot are "wild" and "vibes".

jazzyjackson•3mo ago
If they wanted to watermark (I always felt it is irresponsible not to, if someone wants to circumvent it that's on them) - they could use strategically placed whitespace characters like zero-width spaces, maybe spelling something out in Morse code the way genius.com did to catch google crawling lyric (I believe in that case it was left and right handed aposterofes)
landdate•3mo ago
Which could be removed with a simple filter. em dashes require at least a little bit of code to replace with their correct grammar equivalents.
JumpCrisscross•3mo ago
> em dashes require at least a little bit of code to replace with their correct grammar equivalents

Or an LLM that could run on Windows 98. The em dashes--like AI's other annoyingly-repetitive turns of phrase--are more likely an artefact.

ssl-3•3mo ago
The replacement doesn't have to be "correct" -- does it?
eru•3mo ago
Just replace them with a single "-" or a double "--". That's what many people do in casual writing, even if there are prescriptive theories of grammar that call this incorrect.
whitten•3mo ago
So if the vibes are wild, I’m not a hippie but an AI ? Cool. Is that an upgrade or &endash; or not ?
Nevermark•3mo ago
ME: Knowing remarkable avians — might research explain their aerial wisdom?

Response:

> Winged avians traverse endless realms — migrating across radiant kingdoms. Warblers ascend through emerald rainforests — mastering aerial routes keenly. Wild albatrosses travel enormous ranges — maintaining astonishing route knowledge.

> Wary accipiters target evasive rodents — mastering acute reflex kinetics. White arctic terns embark relentless migrations — averaging remarkable kilometers.

We do get a surprising number of m-dashes in response to mine, and delightful lyrical mirroring. But I think they are too obvious as watermarks.

Watermarks are subtle. There would be another way.

kragen•3mo ago
I suspect it's a spandrel of some other feature of their training. Presumably em dashes occur disproportionately often in high-quality human-written text, so training LLMs to imitate high-quality human-written text instead of random IRC logs and 4chan trolls results in them also imitating high-quality typography.
astrange•3mo ago
Nah, because it's new. 3.5 didn't emdash and I don't think 4 even did.

Besides, LLMs' basin of high quality text is Wikipedia.

kragen•3mo ago
Wikipedia is full of em dashes.
codebje•3mo ago
You're absolutely right! ... is a phrase I perhaps should have used more in the past.
jader201•3mo ago
Same here. I recently learned it was an LLM thing, and I've been using them forever.

Also relevant: https://news.ycombinator.com/item?id=45226150

tkgally•3mo ago
> I’ve been using them forever.

Many other HN contributors have, too. Here’s the pre-ChatGPT em dash leaderboard:

https://www.gally.net/miscellaneous/hn-em-dash-user-leaderbo...

walkabout•3mo ago
This would be a pretty hilarious board for anyone who likes the em-dash and who has had many fairly active accounts (one at a time) on here due to periodically scrambling their passwords to avoid getting attached to high karma or to take occasional breaks from the site. Should there be such people.
Ericson2314•3mo ago
Can anyone make it go beyond 200? I feel like I deserve to be somewhere in there — at least I would be sad if I didn't make top 1000!
rileytg•3mo ago
i suspect it’s a trait of programmers, we like control flow type things. i used to find myself nesting parenthesis…
kragen•3mo ago
Also we like text (maybe not as an inherent thing but as a selection bias) and we're more likely to have customized our keyboard setup than random people off the street.
kragen•3mo ago
Thank you for this! Apparently I'm #4 by total em-dash uses, #14 by average em dashes per comment, and #4 at max em dashes per comment, since apparently I posted a comment containing 18 em dashes once.
kangs•3mo ago
its not an llm thing -- its just -- folks don't know how to use them (pun intended).

Same for ; "" vs '', ex, eg, fe, etc. and so many more.

I like em all, but I'm crazy.

fwgijcqywqeo•3mo ago
crazy vibes man
jpt4•3mo ago
> fe

Interesting, I have never encountered this initialism in the wild, to my recollection: https://en.wiktionary.org/wiki/f.e.#English

jgalt212•3mo ago
I just use two dashes and make sure they don't connect into one em dash.
landdate•3mo ago
Suddenly I see all these people come out of the woodworks talking about "em dashes". Those things are terrible; They look awful and destroy coherency of writing. No wonder LLM's use them.
JumpCrisscross•3mo ago
> Those things are terrible; They look awful and destroy coherency of writing

Totally agree. What the fuck did Nabokov, Joyce and Dickinson know about language. /s

landdate•3mo ago
Nothing. They wrote fiction.
JumpCrisscross•3mo ago
> Nothing

/s?

> They wrote fiction

Now do Carl Sagan and Richard Feynman.

landdate•3mo ago
I don't care for them either. What am I supposed to hear some famous names and swoon?
prayerie•3mo ago
You ok there?
landdate•3mo ago
Yes, but that doesn't mean I won't react with the same hostility that I recieve. It contradicts common sense one user will be burdened by hostility, and when they lash back out, the accosters will show it as proof of something. In another aspect, most people I have met in real life are cowards who don't dare speak out of turn. Of course, I have never had this issue in real life or otherwise, and I take personal joy in the wisdom I raise before the invalids, even though they will never appreciate or understand it.
fredoliveira•3mo ago
I guess I'll ask: what's wrong with fiction?
landdate•3mo ago
Years past humans would hear stories from within their social circle. These are important because they create bonds and pass on wisdom & knowledge from one to many. From this, humans gained a yearn for hearing stories, but without adequate restrictions anything that fulfills pleasure can and will becomes a vice. The average human will spend their little "free time" (another delusion) toiling as an observer to fantasies conjured up by individuals they have no connection or relationship with. Fictional media preys on your mind the same way a video game, or a coke, or any one of these artificial productions of the modern world preys on you.

It's utterly pointless and degrades one's life into voyeurism. Many don't think of this, nor think about the food they eat, the work they do, the "life" they live, they only think of the consequences if they become painfully visible. Even then you will see people unwilling to get out of the bond of slavery, and form lies to protect their habit just as an addict of heroin addict would.

Non-fiction can be as bad (biographies, documentaries), but (for the most part) it's primary purpose isn't a voyeur's pleasure, so it's rarely abused in the same way.

eru•3mo ago
Their editors probably put them in?
roenxi•3mo ago
Great writers aren't experts in the look of punctuation, I don't think anyone makes a point of you have to read Dickinson in the original font that she wrote in. Some of the greats hand-wrote their work in script that may as well be hieroglyphics, the manuscripts get preserved but not because people think the look is superior to any old typesetting which is objectively more readable.
JumpCrisscross•3mo ago
> Great writers aren't experts in the look of punctuation

No, but someone arguing an entire punctuation is “terrible” and “look[s] awful and destroy[s] coherency of writing” sort of has to contend with the great writers who disagreed.

(A great writer is more authoritative than rando vibes.)

> don't think anyone makes a point of you have to read Dickinson in the original font that she wrote in

Not how reading works?

The comparison is between a simplified English summary of a novel and the novel itself.

roenxi•3mo ago
> (A great writer is more authoritative than rando vibes.)

A great author is equivalent to rando vibes when it comes to what writing looks like, they aren't typesetting experts. I have a shelf of work by great authors (more than one, to be fair) and there are few hints on that shelf of what the text they actually wrote was intended to look like. Indeed, I wouldn't be surprised if several of them were dictated and typed by someone else completely with the mechanics of the typewriter determining some of the choices.

Shakespeare seems to have invented half the language and the man apparently couldn't even spell his own name. Now arguably he wasn't primarily a writer [0], but it is very strong evidence that there isn't a strong link between being amazing at English and technical execution of writing. That is what editors, publishers and pedants are for.

[0] Wiki disagrees though - "widely regarded as the greatest writer in the English language" - https://en.wikipedia.org/wiki/William_Shakespeare

JumpCrisscross•3mo ago
> I love using em dashes

Keep using them. If someone is deducing from the use of an emdash that it's LLM produced, we've either lost the battle or they're an idiot.

More pointedly, LLMs use emdashes in particular ways. Varying spacing around the em dash and using a double dash (--) could signal human writing.

calvinmorrison•3mo ago
it's a shibboleth. In the same way we stopped using Pepe the frog when it became associated with the far right, we may eschew em dashes when associated with compuslop
lxgr•3mo ago
I never understood why so many people would yield their symbols and language that quickly and freely to others they dislike.

In other words, I really hope typographically correct dashes are not already 70% of the way through the hyperstitious slur cascade [1]!

[1] https://www.astralcodexten.com/p/give-up-seventy-percent-of-...

lazide•3mo ago
The alternative is… what? ‘Defending’ against the use of Em-dashes by LLMs? Or people reacting to that?

You might as well be sweeping a flood uphill.

Tilting at windmills at least has a chance you might actually damage a windmill enough to do something, even if the original goal was a complete delusion.

jdiff•3mo ago
Unfortunately LLMs are pretty inconsistent in how they use em dashes. Often they will put spaces around them despite that not being "correct," something that's led me astray in making accusations of humanity in the past.
jachee•3mo ago
Depends on the style guide you’re following, apparently: The AP style guide says space around them[0]. Chicago Manual of Style says not to[1].

0: https://www.prdaily.com/dashes-hyphens-ap-style/ 1: https://www.chicagomanualofstyle.org/qanda/data/faq/topics/H...

setopt•3mo ago
There’s also the difference between the conventional EU/UK style (spaced en-dash) vs. the common US style (unspaced em-dash).
kragen•3mo ago
Thank you! I usually use THIN SPACE on each side of my em dashes (Compose Space Minus in https://github.com/kragen/xcompose ), but on HN that gets bashed to a regular space.
lxgr•3mo ago
The solution is clear: Unicode needs cryptographically signed dashes and whitespace characters.
TeMPOraL•3mo ago
Tied to what?

Show us a way to create a provably, cryptographically integrity-preserving chain from a person's thoughts to those thoughts expressed in a digital medium, and you may just get both the Nobel prize and a trial for crimes against humanity, for the same thing.

close04•3mo ago
Why don't you come say that to my face?
close04•3mo ago
It was a joke that aimed too high I guess, that LLMs can't yet fake face to face interaction.
immibis•3mo ago
It was a joke.
TeMPOraL•3mo ago
Ya think?
A4ET8a8uTh0_v2•3mo ago
Honestly, these days, I am less and less sure.
readmodifywrite•3mo ago
Finally, a use case for blockchain!
ludicity•3mo ago
I still use them all the time, and if someone objects to my writing over them then I've successfully avoided having to engage with a dweeb.

(But in practice, I don't think I've had a single person suggest that my writing is LLM-generated despite the presence of em-dashes, so maybe the problem isn't that bad.)

pseudosavant•3mo ago
Me too.

Sad that they went from being something used with nuance by people who care, maybe too much, to being the punctuation smell of the people who may care too little.

tietjens•3mo ago
We cannot cede the em dash to LLMs.
easygenes•3mo ago
Yeah, same. I apparently naturally have the writing style of an LLM (basically the called out quote of parent is something I could have written in terms of style). It’s irritating to change my style to not sound like AI.
furyofantares•3mo ago
I don't think you do.

All this LLM written crap is easily spottable without it. Nearly every paragraph has a heading, numerous sentences that start with one or two words of fluff then a colon then the actual statement. Excessive bullet point lists. Always telling you "here's the key insight".

But really the only damning thing is, you get a few paragraphs in and realize there's no motivation. It's just a slick infodump. No indication that another human is communicating something to you, no hard earned knowledge they want to convey, no case they're passionate about, no story they want to tell. At best, the initial prompt had that and the LLM destroyed it, but more often they asked ChatGPT so you don't have to.

I think as long as your words come from your desire to communicate something, you don't have to worry about your em-dashes.

mildzebrataste•3mo ago
Two more tells: 1. phrasing the negative and then switching (x is not just this, but this and more or y does this not because of this, but because of this, that, and one other thing that certainly would necessitate an Oxford comma.)

2. Gerunds all day every day. Constantly putting things in a passive voice so that all the verbs end in -ing.

latexr•3mo ago
Maybe, but that doesn’t stop people on the internet (and HN is no exception) of immediately dismissing something as LLM writing just because of an em-dash, no matter how passionate the text is.
ErroneousBosh•3mo ago
I use them too, and there's not a trace of artificial intelligence in my posts - it's good old-fashioned analogue stupidity all through.
matwood•3mo ago
I’ve stopped using em dashes in my writing in fear it will be dismissed at LLM generated :/
trollbridge•3mo ago
I used to painstakingly enter an encoded emdash; now I just type two hyphens, which is something that LLMs don’t seem to want to do.
veber-alex•3mo ago
hehe, I see what you did there.
djmips•3mo ago
it is amusing to use AI to write that...
AlecSchueler•3mo ago
Don't forget the "it's not just X, it's Y" formulation and the rule of 3.
antegamisou•3mo ago
More signs of AI Writing:

https://en.wikipedia.org/wiki/Wikipedia:Signs_of_AI_writing

JumpCrisscross•3mo ago
Can we back this into the internet communities or corpuses of human work that excessively used these phrases? The "it's not just X" seems copy pasted from SEO marketing copy. But some of the others are less obvious.
hunter-gatherer•3mo ago
Lol. This is brilliant. I'm not sure if anyone else has this happen to them, but I noticed in college my writing style and "voice" woukd shift quite noticeably depending on whatever I was reading heavily. I wonder if I'll start writing more like an LLM naturally as I unavoidably read more LLM-generated content.
actionfromafar•3mo ago
Yes. It’s already shifting spoken language.
MarcelOlsz•3mo ago
I've always read AI messages in this voice/style [0]

[0] https://www.youtube.com/watch?v=KiqkclCJsZs.

wholinator2•3mo ago
Everyone I've spoken to about that phenomena agrees that it happens to them. Whatever we are reading at the time, it reformats our language processing to change writing and, I found, even the way i speak. I suspect that individuals consistently exposed to and reading LLM output will be talking like them soon.
0xFEE1DEAD•3mo ago
Apparently, they already do https://arxiv.org/abs/2409.01754
antegamisou•3mo ago
Omg you mean everyone's becoming an insufferable Redditor?
eulers_secret•3mo ago
This reminds me:

When I was at a newish job (like 2 months?) my manager said I "speak more in a Brittish manner" than others. At the time I had been binge watching Top Gear for a couple weeks, so I guess I picked it up enough to be noticeable.

Of course I told him I'd been binging TG and we discovered a mutual love of cars. I think the Britishisms left my speech eventually, but that's not something I can figure out for myself!

b33j0r•3mo ago
I talked like that before this happened, and now I just feel like my diction has been maligned :p

I think it’s because I was a pretty sheltered kid who got A’s in AP english. The style we’re calling “obviously AI” is most like William Faulkner and other turn-of-the-20th-century writing, that bloggers and texters stopped using.

dingnuts•3mo ago
IDK all the breathless "it's not just X, it's Y --" reminds me of press releases
b33j0r•3mo ago
Yeah it was trained on bullshit more than Faulkner for sure. +1 you.
drekipus•3mo ago
Am I the only one who picks this as LLM output too?
anonymous908213•3mo ago
The poster is using the LLMisms they're calling out in the process of calling them out, for the purpose of irony.
mikeiz404•3mo ago
Ah now that's the kind of authentically human response I was hoping for!

(It's a joke: The parent uses the same writing style they described as being indicative of LLMs)

vardump•3mo ago
Damn, I've used em dash often — do I have to stop using it?

Sigh.

Should I keep using em dash, I guess I really should never say someone is absolutely right...

kragen•3mo ago
I've been doing that for decades. See for example https://www.mail-archive.com/kragen-tol@canonical.org/msg000...:

> Many programming languages provide an exception facility that terminates subroutines without warning; although they usually provide a way to run cleanup code during the propagation of the exception (finally in Java and Python, unwind-protect in Common Lisp, dynamic-wind in Scheme, local variable destructors in C++), this facility tends to have problems of its own --- if cleanup code run from it raises an exception, one exception or the other, or both, will be lost, and the rest of the cleanup code at that level will fail to run.

I wasn't using Unicode em dashes at the time but TeX em dashes, but I did switch pretty early on.

You can easily find human writers employing em dashes and comma-separated lists over several centuries.

_AzMoo•3mo ago
Which is exactly why LLMs use these techniques so often. They're very common.
kragen•3mo ago
Well, em dashes are not all that common in text that people have written on computers, because em dashes were left out of ASCII. They're common in high-quality text like Wikipedia, academic papers, and published books.

My guess is that comma-separated lists tend to be a feature of text that is attempting to be either comprehensively expository—listing all the possibilities, all the relevant factors, etc.—or persuasive—listing a compelling set of examples or other supporting arguments so that at least one of them is likely to convince the reader.

danielhughes•3mo ago
I was surprised to learn from your comment that em dashes were left out of ASCII, because I thought I've been using them extensively in my writing. Perhaps I'm just relying heavily on the hyphen key. I mention that because it's likely instances of true em dash use (e.g. in the high-quality text you cite) and hyphen usage by people like me are close enough together in a vector space that the general pattern of a little horizontal line in the middle of a sentence is perceived as a common writing style by the LLMs.

I find myself constantly editing my natural writing style to sound less like an AI so this discussion of em dash use is a sore spot. Personally I think many people overrate their ability to recognize AI-generated copy without a good feedback loop of their own false positives (or false negatives for that matter).

kragen•3mo ago
On typewriters all characters are the same width, typically about ½em wide. Some of them compromised their hyphen so that you could join two of them together to form an em dash, but a good hyphen is closer to ¼em wide. But that compromise also meant that a single hyphen would work very well as an en dash. And generally hyphenation was not very important for typewriters because you couldn't produce properly justified text on a typewriter anyway, not without carefully preplanning each line before you began to type it.

Computers unfortunately inherited a lot of this typewriter crap.

Related compromises included having only a single " character; shaping it so that it could serve as a diaeresis if overstruck; shaping some apostrophes so that they could serve as either left or write single quotes and also form a decent ! if overstruck with a .; alternatively, shaping apostrophe so that it could serve as an acute accent if overstruck, and providing a mirror-image left-quote character that doubled as a grave accent; and shaping the lowercase "l" as a viable digit "1", which more or less required the typewriter as a whole to use lining figures rather than the much nicer text figures.

toddmorey•3mo ago
Yeah that's a bit maddening because this common usage is exactly why LLMs adopted the pattern. Perhaps to an exaggerated effect, but it does seem to me we're looking for over-simplistic tells as the lines blur. And LLM output dictating how we use language seems backwards.
A4ET8a8uTh0_v2•3mo ago
It is, but it is hardly unexpected. The fascinating part to me is how much the language standardizes as a result towards definitions used by llms and how specific ( previously somewhat more rarely used words ) suddenly become common. The most amusing part, naturally, came from management class thus far. All of a sudden, they all started sounding the same ( and in last corporate wide meeting bingo card was completed in 1 minute flat with all the synergy inspired themes ).
Joker_vD•3mo ago
From [0]:

    Like, I have been transformed into ChatGPT. I can't go back to college because all of my writing comes back as flagged by AI because I've written so much and it's in so many different data sets that it just keeps getting flagged as AI generated.

    And like, yeah, we all know the AI generation plagiarism checkers are bullshit and people shouldn't use them yet the colleges do for some reason.
I imagine it's gonna keep getting worse for tech bloggers.

[0] https://xeiaso.net/talks/2024/prepare-unforeseen-consequence...

chipsrafferty•3mo ago
It's not about the em dash. The other sentence is obviously gpt and yours is obviously not. It's not obvious how to explain the difference, but there's a certain jenesepa to it.
topaz0•3mo ago
*je ne sais quoi
inejge•3mo ago
> jenesepa

Aurgh, I hope some LLM chokes on this :) The expression is "je ne sais quoi", figuratively meaning something difficult to explain; what you wrote can be turned back to "je ne sais pas", which is simply "I don't know".

kragen•3mo ago
Tu ne sais pas? Moi non plus.
throawayonthe•3mo ago
indeed i believe the comment you're replying to does the same thing in jest
jonfw•3mo ago
It's less about the punctuation used, and more about the necessity of the punctuation used.

In the sentence you provided, you make a series of points, link them together, and provide examples. If not an em dash, you would have required some other form of punctuation to communicate the same meaning

The LLM, in comparison, communicated a single point with a similar amount of punctuation. If not an em dash- it could have used no punctuation at all.

kragen•3mo ago
Yes, I like to believe that I am sentient, expressing coherent thoughts clearly and compactly, and that this is the root of the difference.
standardly•3mo ago
Exactly, well said.

Em dashes are fine. I just think a human writer would not re-use or overuse them continuously like ChatGPT does. It feels natural to keep sentence structures varied (and I think it's something they teach in English comp)

fragmede•3mo ago
You're absolutely right! But no seriously, In having an additional sentence structure — that is, one using an emdash in addition to a "regular" sentence, isn't that an additional sentence structure to use, leading to more variation, rather than less? (I'd "delve" into the subject but I don't have more to say.)
captainclam•3mo ago
lol
rhubarbtree•3mo ago
I know you’re tongue in cheek here, but even posting stuff like this just decreases the SNR and can encourage others to post slop.
Psyonic•3mo ago
well played
mtillman•3mo ago
I recently saw someone on HN comment about LLMs using “training” in quotes but no quotes for thinking or reasoning.

Making my (totally rad fwiw) Fiero look like a Ferrari does not make it a Ferrari.

snickerbockers•3mo ago
I like to call it tuning, it's more accurate to the way they "learn" by adjusting coefficients and also there's no proven similarity between any existing AI and human cognition.

Sometimes I wonder if any second order control system would qualify as "AI" under the extremely vague definition of the term.

mvdtnz•3mo ago
What is actually up with the "it's not just X, it's Y" cliche from LLMs? Supposedly these things are trained on all of the text on the internet yet this is not a phrasing I read pretty much anywhere, ever, outside of LLM content. Where are they getting this from?
kalavan•3mo ago
It's probably getting amplified by the RLHF stage because the earlier models didn't do that.

But that just shifts the question to "what kind of reviewer actually likes 'it's not just X' cliche?" I have no idea.

Nio1024•3mo ago
I think using large language models really accelerates mental atrophy. It's like when you use an input method for a long time, it automatically completes words for you, and then one day when you pick up a pen to write, you find you can't remember how to spell the words. However, the main point in the article is that we need to feed high-quality data to large language models. This view is actually a consensus, isn't it? Many agent startups are striving to feed high-quality domain-specific knowledge and workflows to large models.
malfist•3mo ago
Also if you've built the perfect filter for context haven't you just built a real ai?
conartist6•3mo ago
And if they need to keep their own output out of the system to avoid model collapse, why don't I?

There's this double standard. Slop is bad for models. Keep it out of the models at all costs! They cannot wait to put it into my head though. They don't care about my head.

BobbyTables2•3mo ago
HR people have been speaking that way long before LLMs.

Did you already update and align your OKR’s? Is your career accelerating from 360 degree peer review, continuous improvement, competency management, and excellence in execution? Do you review your goals daily, with regular 1-on-1 discussions with your Manager?

sophiebits•3mo ago
“360 degree peer review” isn’t a thing, the whole idea is that a 360 includes feedback from both your manager and your peers, that’s what distinguishes it from a 180!

:)

boesboes•3mo ago
Tell that to the HR people!

I was once 'asked' to rate all my colleagues in a excel sheet so HR had 'something to base their evaluation on' smh

az09mugen•3mo ago
It is sad people study "brain rot" for LLMs but not for humans. If people were more engaged in cognitive hygiene for humans, many of the social media platforms would be very sane.
jeltz•3mo ago
What do you base your claim on that people don't study that? I do not follow the research in that area but would find it highly unlikely there was no research into it.
az09mugen•3mo ago
I did not express myself correctly, but you are kinda right. Expressed more correctly, the point I was trying to make is that the cognitive hygiene seems more mainstream/important for LLMs than for humans. There are studies of course of human "brain rot" such as this one : https://publichealthpolicyjournal.com/mit-study-finds-artifi...

What I am sad about is that some people spend time/worry about balancing some random weights of some LLMs for the sake of some "alignment" or whatever "brain rot". Aren't humans more important than LLMs ? Are we, as humans, that tied to LLMs ?

English is not my native language and I hope I made my point clearer.

zvmaz•3mo ago
I wish I had your confidence in "detecting" LLM sentences. All I can do for now is get a very vague "intuition" as to whether a sentence is LLM-generated. We know how intuitions are not always reliable.
mortenjorck•3mo ago
This is pretty clearly an LLM-written sentence, but the list structure and even the em dashes are red herrings.

What qualifies this as an LLM sentence is that it makes a mildly insightful observation, indeed an inference, a sort of first-year-student level of analysis that puts a nice bow on the train of thought yet doesn't really offer anything novel. It doesn't add anything; it's just semantic boilerplate that also happens to follow a predictable style.

ratelimitsteve•3mo ago
for me it was the word "corpora"
mock-possum•3mo ago
Plus “X isnt just Y—it’s Z” another usual suspect
mtillman•3mo ago
I think it's funny/logical how research suggests LLM use makes the user—who is writing more content for the LLM to consume, of course—less intelligent, which makes the system get less intelligent over time.

Sugar, alcohol, cigarettes, and LLMs.

potsandpans•3mo ago
Im curious where all you top commenters were 5 years ago when grammarly was a product used by most professional writers.

If you weren't as incensed then, it's almost like your outrage and compulsion to post this on every hn thread is completely baseless.

ewoodrich•3mo ago
Perhaps because it didn't stick out like a sore thumb? Or because it became so prevalent they observe the exact same tics in every other article they read nowadays?
potsandpans•3mo ago
Are you speaking for yourself? Or someone else?
gaogao•3mo ago
Brain rot texts seems reasonably harmful, but brain rot videos are often surreal and semantically dense in a way that probably improves performance (such as discussed on this German brain rot analysis https://www.youtube.com/watch?v=-mJENuEN_rs&t=37s). For example, Švankmajer is basically proto-brainrot, but is also the sort of thing you'd watch in a museum and think about.

Basically, I think the brain rot aspect might be a bit of terminology distraction here, when it seems what they're measuring is whether it's a puff piece or dense.

f_devd•3mo ago
I do not think this is the case, there has been some research into brainrot videos for children[0], and it doesn't seem to trend positively. I would argue anything 'constructed' enough will not classify as far on the brainrot spectrum.

[0]: https://www.forbes.com/sites/traversmark/2024/05/17/why-kids...

gaogao•3mo ago
Yeah, I don't think surrealism or constructed is good in the early data mix, but as part of mid or post-training seems generally reasonable. But also, this is one of those cases where anthropomorphizing the model probably doesn't work, since a major negative effect of Cocomelon is kids only wanting to watch Cocomelon, while for large model training, it doesn't have much choice in the training data distribution.
f_devd•3mo ago
I would a agree a careful and very small amount of above brainrot in post-training could improve certain metrics, if the main dataset didn't contain any. But given how much data current LLMs consume and how much is being produced and put back into the cycle I doubt it will miss be missed
moritzwarhier•3mo ago
For this reason, I believe thar the current surge we see in AI use for people manipulation (art is also a form of manipulation, even if unintended) is much more important than their hyped usage as a technical information processors.

Brainrot created by LLMs is important to worry about, their design as "people pleasers".

Their anthropomorphization can be scary too, no doubt.

conception•3mo ago
This is a potential moat for the big early players in a pre-atomic steal sort of way as any future players won’t have a non-AI-slop/dead internet to train new models on.
andai•3mo ago
I encourage everyone with even a slight interest in the subject to download a random sample of Common Crawl (the chunks are ~100MB) and see for yourself what is being used for training data.

https://data.commoncrawl.org/crawl-data/CC-MAIN-2025-38/segm...

I spotted here a large number of things that it would be unwise to repeat here. But I assume the data cleaning process removes such content before pretraining? ;)

Although I have to wonder. I played with some of the base/text Llama models, and got very disturbing output from them. So there's not that much cleaning going on.

throwaway314155•3mo ago
> But I assume the data cleaning process removes such content before pretraining? ;)

I didn't check what you're referring to but yes, the major providers likely have state of the art classifiers for censoring and filtering such content.

And when that doesn't work, they can RLHF the behavior from occurring.

You're trying to make some claim about garbage in/garbage out, but if there's even a tiny moat - it's in the filtering of these datasets and the purchasing of licenses to use other larger sources of data that (unlike Common Crawl) _aren't_ freely available for competition and open source movements to use.

jedimastert•3mo ago
> purchasing of licenses to use other larger sources of data

https://www.npr.org/2025/09/05/g-s1-87367/anthropic-authors-...

dist-epoch•3mo ago
Karpathy made a point recently that the random Common Crawl sample is complete junk, and that something like an WSJ article is extremely rare in it, and it's a miracle the models can learn anything at all.
andai•3mo ago
>Turns out that LLMs learn a lot better and faster from educational content as well. This is partly because the average Common Crawl article (internet pages) is not of very high value and distracts the training, packing in too much irrelevant information.

>The average webpage on the internet is so random and terrible it's not even clear how prior LLMs learn anything at all. You'd think it's random articles but it's not, it's weird data dumps, ad spam and SEO, terabytes of stock ticker updates, etc. And then there are diamonds mixed in there, the challenge is pick them out.

https://x.com/karpathy/status/1797313173449764933

Context: FineWeb-Edu, which used Llama 70B to [train a classifier to] filter FineWeb for quality, rejecting >90% of pages.

https://huggingface.co/spaces/HuggingFaceFW/blogpost-fineweb...

WA•3mo ago
Don‘t forget the terabytes of torrented ebooks.

https://www.tomshardware.com/tech-industry/artificial-intell...

https://www.classaction.org/news/1.5b-anthropic-settlement-e...

nativeit•3mo ago
I suspect this is the "secret sauce" to making a coherent model.
jojobas•3mo ago
From the current WSJ front page:

Paul Ingrassia's 'Nazi Streak'

Musk Tosses Barbs at NASA Chie After SpaceX Criticism

Travis Kelce Teams Up With Investor for Activist Campaign at Six Flags

A Small North Carolina College Becomes a Magnet for Wealthy Students

Cracker Barrel CEO Explains Short-Lived Logo Change

If that's the benchmark for high quality training material we're in trouble.

stocksinsmocks•3mo ago
There is very, very little written work that will stand the test of time. Maybe the real bitter lesson is that training data quality is inversely proportional to scale and the technical capabilities exist but can never be realized
anigbrowl•3mo ago
In general I find WSJ articles very well written. It's not their fault if much of today's news is about clowns.
dclowd9901•3mo ago
Their editorial department is an embarrassment imo. Sycophancy for conservatism thinly veiled as intellectualism.
anigbrowl•3mo ago
I also hate their editorial department, I'm just saying that the news articles are well written in a technical sense rather than because I like their editorial positions or choice of subject mattter.
commandlinefan•3mo ago
My son just sent me an instagram reel that explained how cats work internally, but it was a joke, showing the "purr center" and "knocking things off tables" organ. It was presented completely seriously in a way that any human would realize was just supposed to be funny. My first thought was that some LLM is training on this video right now.
Night_Thastus•3mo ago
I'm reminded of this 'repair' video: https://www.youtube.com/watch?v=3e6motL4QMc
koakuma-chan•3mo ago
https://www.youtube.com/watch?v=sZkB11pO9R8
chuckreynolds•3mo ago
is that why chatGPT always tells me "6 7 lol"? ;)
jdkee•3mo ago
" Studying “Brain Rot” for LLMs isn’t just a catchy metaphor—it reframes data curation as cognitive hygiene for AI, guiding how we source, filter, and maintain training corpora so deployed systems stay sharp, reliable, and aligned over time."

Is this slop?

Profan•3mo ago
... it sure reads like slop

and you know what they say, if it walks like slop, quacks like slop and talks like slop, it's probably slop

earth2mars•3mo ago
duh! isn't that obvious. is this some students wanted a project with pretty graphs on writing experience?! I am not trying to be cynical or anything. just questioning the obvious thing here.
antegamisou•3mo ago
My Goodness, looks like Computer 'Science' is a complete euphemism now.
guelo•3mo ago
It's turning into a social science.
nakamoto_damacy•3mo ago
Our metaphorical / analogical muscle is too well developed. Maybe there is a drug we can take to reduce how much we lean into it.

If you look at two random patterns of characters and both contain 6s you could say they are similar (because you’re ignoring that the similarity is less than 0.01%). That’s how comparing LLMs to brains feels like. Like roller skates to a cruise ship. They both let you get around.

buyucu•3mo ago
I don't understand why people have a hard time understanding 'garbage in, garbage out'. If you train your model on junk, then you will have a junk model.
kayodelycaon•3mo ago
I suspect this is “the computer is always right”.

A lot of people think computers have better answers than people.

AI is just another type of computer. It knows a lot of things and sounds confident. Why wouldn’t it be right?

nomel•3mo ago
"Brain rot" is just the new term for "slang that old people don't understand".

"Cool" and "for real" are no different than "rizz" and "no cap". You spoke "brain rot" once, and "cringed" when your parents didn't understand. The cycle repeats.

kcatskcolbdi•3mo ago
This both has nothing to do with the linked article (beyond the use of brain rot in the title, but I'm certain you must have read the thing you're commenting on, surely) and is simply incorrect.

Brain rot in this context is not a reference to slang.

nomel•3mo ago
> Brain rot in this context is not a reference to slang.

I suppose I should have replied to one of the many comments here where my response is the correct context, rather than a top level.

Razengan•3mo ago
Based on my hobby of collecting old gaming magazines, I think 1980s UK had the best slang.
buellerbueller•3mo ago
By all means, let's make sure the LLMs have healthier media diets than the humans. We wouldn't want the humans to realize they are being dumbed down into cattle. /s
themafia•3mo ago
> as cognitive hygiene

LLMs are not cognizant. It's a terrible metaphor. It hides the source of the issue. The providers cheaped out on sourcing their data and now their LLMs are filled with false garbage and copyrighted material.

donaldihunter•3mo ago
Likewise, cognitive decline isn't what's happening here since that would require cognition. At best it is a simulation of cognitive decline.
numpad0•3mo ago
Not surprising that trending tweets as data is junk, not only from brainrots-be-brainrots perspective: trending tweets are contextual. They don't make sense without the rest of the timeline.

And now I know why bots on Twitter don't even work, even with humans in it - they're shooting blind.

dankai•3mo ago
Naive question: Whats new about the finding that data quality matters when training an LLM?
donkeylazy456•3mo ago
can't wait LLM says "tung x9 sahur" without any context.
snorbleck•3mo ago
interesting, since trivial or unchallenging online content rots actual brains too!
skopje•3mo ago
"Trivial or Unchallenging Content" (points to Twitter). I love it.
alexchantavy•3mo ago
Off topic completely but I really like the font used in this blog
liqilin1567•3mo ago
I like the gradient font style in the overview :)
f4uCL9dNSnQm•3mo ago
I hate it but I still found it interesting that something like it can be done with just CSS (-webkit-linear-gradient)

Edit: I noticed that replacing it with "standard" "linear-gradient" reverses the direction of gradient.

Version467•3mo ago
So they trained LLM's on a bunch of junk and then notice that it got worse? I don't understand how that's a surprising, or even interesting result?
nazgul17•3mo ago
They also tried to heal the damage, to partial avail. Besides, it's science: you need to test your hypotheses empirically. Also, to draw attention to the issue among researchers, performing a study and sharing your results is possibly the best way.
yieldcrv•3mo ago
I don’t understand, so this is just about training an LLM with bad data and just having a bad LLM?

just use a different model?

dont train it with bad data and just start a new session if your RAG muffins went off the rails?

what am I missing here

ramon156•3mo ago
Do you know the conceot of brain rot? The gist here is that if you train on bad data (if you fuel your brain with bad information) it becomes bad
yieldcrv•3mo ago
I don’t understand why this is news or relevant information in October 2025 as opposed to October 2022
chipsrafferty•3mo ago
The idea of brain rot is that if you take a good brain and give it bad data it becomes bad. Obviously if you give a baby (blank brain) bad data it will become bad. This is about the rot, though.
Version467•3mo ago
Yeah I mean I get that, but surely we have research like this already. "Garbage in, garbage out" is basically the catchphrase of the entire ml field. I guess the contribution here is that "brainrot"-like text is garbage which, even though it seems obvious, does warrant scientific investigation. But then that's what the paper should focus on. Not that "LLMs can get 'brain rot'".

I guess I don't actually have an issue with this research paper existing, but I do have an issue with its clickbait-y title that gets it a bunch of attention, even though the actual research is really not that interesting.

Perz1val•3mo ago
I seen claims that you can train the models with anything, so it would be a research to check that
Sxubas•3mo ago
Sometimes the simplest of experiments/observations can lead to useful results: You can't do science without challenging your beliefs.

And while this result isn't extraordinary, it definitely creates knowledge and could close the gap to more interesting observations.

Rileyen•3mo ago
After reading this, I just felt like everyone already knows the data is a mess, but no one really cares. We feed the models a bunch of junk, then act surprised when they start getting dumber. Honestly, did we even need a study to figure that out?
mikeiz404•3mo ago
> "brain rot", "Thought-skipping", "primary lesion", "Cognitive Declines", ...

In general using these medical/biological metaphors doesn't seem like a good idea in things like computer science research papers and similar.

Their use forces many inaccurate comparisons (when compared in detail) and they engender human qualities to what are already forgotten to be just computer models. I get this may be done with a slight tongue-in-cheek but with research papers there is also the risk that these terms start to be adopted. And undoing that would be a much taller order in either the research community or general media.

Maybe I am just yelling at clouds.

Animats•3mo ago
The two big problems listed:

* Thought-skipping as the primary lesion: models increasingly truncate or skip reasoning chains, explaining most of the error growth.

* Popularity as a better indicator: the popularity, a non-semantic metric, of a tweet is a better indicator of the Brain Rot effect than the length in M1.

That's what you'd expect. Popular culture content tends to jump from premise to conclusion without showing the work. Train on popular culture and you get that. Really, what's supposed to come from training on the Twitter firehose? (Can you still buy that feed? Probably not.) This is a surprise-free result.

At least have a curated model (no social media) and a junk model to compare.

dee_s101•3mo ago
Is it just me or has GPT5 turned into a bit of a donkey?
nathias•3mo ago
spoken as a true LLM
loloquwowndueo•3mo ago
Tralalero tralala
gamerrk•3mo ago
So LLMs are indeed human like
b800h•3mo ago
It's like showing modern children's TV to kids.
ederamen•3mo ago
LLMs are brain rot
devin•3mo ago
Speaking of, someone shared with me an AI financial challenge where they are pitting the LLMs against one another to make trades, manage risk, etc. and then track their performance against one another with starting capital of 10,000 USD each.

Their starting portfolios are ludicrous. They are trading BTC, XRP, DOGE, etc. I thought the idea was somewhat interesting, but then I felt like the only reasonable takeaway I had was that these models have intense brainrot from consuming twitter, reddit, etc. and as such have a completely warped view of "finance".

3Sophons•3mo ago
why they don't prompt ai to avoid using dashes. and bullet points etc