frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

LLMs Can Get "Brain Rot"

https://llm-brain-rot.github.io/
3•nnx•3h ago

Comments

davydm•2h ago
good old GIGO (garbage in, garbage out), but what I think most people are forgetting here is that outputs from these LLMs end up back in the input side, so the effect will strengthen across the board over time, as we keep training from the same cesspools people are dumping ai slop into.
jyhong•1h ago
Paper link: https://arxiv.org/abs/2510.13928

TL;DR: We show that continued training on junk social posts makes LLMs think worse. This big concern here is that because many teams keep topping up models with web crawls. Feeding highly popular or shallow posts can cause lasting, hard to undo damage.

Abstract We propose and test the LLM Brain Rot Hypothesis: continual exposure to junk web text induces lasting cognitive decline in large language models (LLMs). To causally isolate data quality, we run controlled experiments on real Twitter/X corpora, constructing junk and reversely controlled datasets via two orthogonal operationalizations: M1 (engagement degree) and M2 (semantic quality), with matched token scale and training operations across conditions. Contrary to the control group, continual pre-training of 4 LLMs on the junk dataset causes non-trivial declines (Hedges' g>0.3) on reasoning, long-context understanding, safety, and inflating "dark traits" (e.g., psychopathy, narcissism). The gradual mixtures of junk and control datasets also yield dose-response cognition decay: for example, under M1, ARC-Challenge with Chain Of Thoughts drops 74.9→57.2 and RULER-CWE 84.4→52.3 as junk ratio rises from 0% to 100%.

Error forensics reveal several key insights. First, we identify thought-skipping as the primary lesion: models increasingly truncate or skip reasoning chains, explaining most of the error growth. Second, partial but incomplete healing is observed: scaling instruction tuning and clean data pre-training improve the declined cognition yet cannot restore baseline capability, suggesting persistent representational drift rather than format mismatch. Finally, we discover that the popularity, a non-semantic metric, of a tweet is a better indicator of the Brain Rot effect than the length in M1. Together, the results provide significant, multi-perspective evidence that data quality is a causal driver of LLM capability decay, reframing curation for continual pretraining as a \textit{training-time safety} problem and motivating routine "cognitive health checks" for deployed LLMs.

Reframe Technical Debt as Software Debt. Treat It Like a AAA-Rated CDO

https://www.evalapply.org/posts/software-debt/index.html
1•Bogdanp•54s ago•0 comments

Reach Out to Betafort Recovery

1•OscarRoss•1m ago•0 comments

CSS Custom Highlight API

https://developer.mozilla.org/en-US/docs/Web/API/CSS_Custom_Highlight_API
1•TheSilva•3m ago•0 comments

Modeling Others' Minds as Code

https://arxiv.org/abs/2510.01272
1•PaulHoule•4m ago•0 comments

Wi-Fi 8 Is Almost Here: Broadcom Unveils New Ultra High Reliability Chips

https://dongknows.com/ultra-high-reliability-wi-fi-8-is-here/
1•speckx•5m ago•0 comments

Why Aluminum in Vaccines Is Safe–and Often Essential

https://www.scientificamerican.com/article/why-aluminum-in-vaccines-is-safe-and-often-essential/
2•quapster•5m ago•0 comments

"Choices" by Joel Spolsky (2000)

https://www.joelonsoftware.com/2000/04/12/choices/
1•vismit2000•7m ago•0 comments

Register for Beta version access – AI Powered Roommate matchmaking

https://roomia.app
1•se2Invest•12m ago•0 comments

MySQL HeatWave Feature Announcements at Oracle AI World

https://blogs.oracle.com/mysql/post/mysql-heatwave-feature-announcements-at-oracle-ai-world
1•ksec•13m ago•0 comments

You can crash today's 6.12.43 LTS Linux kernel thanks to AI slop

https://twitter.com/spendergrsec/status/1958264076162998771
2•DaSHacka•17m ago•1 comments

Untold World Cup story: the plot to eliminate Brazil (2014)

https://www.cnn.com/2014/06/17/sport/football/brazil-chile-world-cup-scandal
1•thunderbong•18m ago•0 comments

The FTC Is Disappearing Blog Posts About AI Published During Lina Khan's Tenure

https://www.wired.com/story/ftc-removes-blog-posts-about-ai-authored-by-by-lina-khan/
2•JKCalhoun•20m ago•0 comments

Ghost

https://jacobfilipp.com/ghost/
2•surprisetalk•21m ago•1 comments

Parables involving gross bodily functions

https://interconnected.org/home/2025/10/10/parables
1•surprisetalk•21m ago•0 comments

Auxiliary Power Unit – Eroding Ancient Wisdom

https://squirrelsquadron.substack.com/p/auxiliary-power-unit-the-ipt-newsletter
1•squirrel•22m ago•0 comments

When the AI says you're fine

https://newsletter.deenamousa.com/p/when-the-ai-says-youre-fine
1•surprisetalk•22m ago•0 comments

InvoicePrinter 2.5 with QR images and Ruby 3.4 support

https://nts.strzibny.name/invoiceprinter-2.5/
1•amalinovic•22m ago•0 comments

'Wetware': Scientists use human mini-brains to power computers

https://www.canadianaffairs.news/2025/10/20/wetware-scientists-use-human-mini-brains-to-power-com...
2•TruffleLabs•23m ago•1 comments

The Vulgar Image

https://spikeartmagazine.com/articles/vulgarity-the-vulgar-image
1•thinkingemote•24m ago•0 comments

Ask HN: New YouTube player not working in Firefox

1•gethly•24m ago•3 comments

Ask HN: Second generation of intro to software dev for 3rd graders

1•xrd•25m ago•0 comments

Hands-On with Tabsdata: Publishing and Subscribing NYC Taxi Data with Tabsdata

https://tabsdata.com/blog/publishing-and-subscribing-nyc-taxi-data-with-tabsdata
1•teleforce•28m ago•0 comments

Ashen-WoW – Pure Vanilla, authentic, stable, community-run

https://ashen-wow.space/en
2•lolleroo•28m ago•0 comments

The Math Trick Hidden in Your Credit Card Number

https://www.scientificamerican.com/article/what-is-the-luhn-algorithm-the-math-behind-secure-cred...
3•sonabinu•34m ago•0 comments

Servo 0.0.1 Release

https://servo.org/blog/2025/10/20/servo-0.0.1-release/
2•Bogdanp•34m ago•0 comments

Intel's 80386 turned 40 this week

https://www.tomshardware.com/tech-industry/semiconductors/intel-386-at-40
6•giuliomagnifico•35m ago•1 comments

Meme Replicator

https://meme-replicator.oliverpartridge.workers.dev/
1•sainte-victoire•36m ago•0 comments

Durable Background Execution with Go and SQLite

https://threedots.tech/post/sqlite-durable-execution/
2•roblaszczak•39m ago•0 comments

Show HN: AI One Health – Connecting technologists with health professionals

https://ai-onehealth.com
2•ai-onehealth•40m ago•0 comments

GoFundMe created 1.4M donation pages for nonprofits; organizations had no clue

https://abc7news.com/post/gofundme-created-14-million-donation-pages-nonprofits-bay-area-organiza...
4•debo_•42m ago•0 comments