frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Explaining Why Hallucinate Large Language Models

https://arxiv.org/abs/2510.06107
1•gagan30•8h ago

Comments

gagan30•8h ago
Distributional Semantics Tracing: A Framework for Explaining Hallucinations in Large Language Models Gagan Bhatia, Somayajulu G Sripada, Kevin Allan, Jacobo Azcona Large Language Models (LLMs) are prone to hallucination, the generation of plausible yet factually incorrect statements. This work investigates the intrinsic, architectural origins of this failure mode through three primary contributions. First, to enable the reliable tracing of internal semantic failures, we propose Distributional Semantics Tracing (DST), a unified framework that integrates established interpretability techniques to produce a causal map of a model's reasoning, treating meaning as a function of context (distributional semantics). Second, we pinpoint the model's layer at which a hallucination becomes inevitable, identifying a specific commitment layer where a model's internal representations irreversibly diverge from factuality. Third, we identify the underlying mechanism for these failures. We observe a conflict between distinct computational pathways, which we interpret using the lens of dual-process theory: a fast, heuristic associative pathway (akin to System 1) and a slow, deliberate, contextual pathway (akin to System 2), leading to predictable failure modes such as Reasoning Shortcut Hijacks. Our framework's ability to quantify the coherence of the contextual pathway reveals a strong negative correlation () with hallucination rates, implying that these failures are predictable consequences of internal semantic weakness. The result is a mechanistic account of how, when, and why hallucinations occur within the Transformer architecture.

15M Budget Line That Doesn't Exist – Certificates

https://blog.axonshield.com/the-15-million-budget-line-that-doesnt-exist/
1•dc352•1m ago•0 comments

A billionaire has rebuilt downtown Detroit

https://www.economist.com/united-states/2025/10/15/a-billionaire-has-rebuilt-downtown-detroit
3•yakkomajuri•6m ago•1 comments

Knowledge Transfer from High-Resource to Low-Resource Languages for Code LLMs (2023)

https://arxiv.org/abs/2308.09895
1•peatmoss•7m ago•0 comments

C++26: Printing `std:tuple` with expression templates

https://www.cppstories.com/2025/tuple-iteration-cpp26/
1•ashvardanian•9m ago•0 comments

"Butt breathing" might soon be a real medical treatment

https://arstechnica.com/science/2025/10/butt-breathing-might-soon-be-a-real-medical-treatment/
2•zdw•11m ago•1 comments

The future of Python web services looks GIL-free

https://blog.baro.dev/p/the-future-of-python-web-services-looks-gil-free
1•birdculture•14m ago•0 comments

A Furious Debate over Autism's Causes Leaves Parents Grasping for Answers

https://www.nytimes.com/2025/10/14/health/autism-parents-genetics-vaccines-tylenol.html
1•walterbell•15m ago•0 comments

Active mechanical logic gates – Capstan Lever Logic (CLL) [video]

https://www.youtube.com/watch?v=Lt0alWQzkWY
1•karussell•17m ago•0 comments

Git considers SHA-256, Rust, LLMs, and more

https://lwn.net/SubscriberLink/1042172/869c5b0722123b13/
2•chmaynard•22m ago•2 comments

Experts say the high failure rate in AI adoption isn't a bug, but a feature

https://fortune.com/2025/10/21/ai-adoption-failure-rate-bug-feature-amy-coleman-jessica-wu-karin-...
1•minifyre•23m ago•2 comments

My Data Career Journey So Far

https://datamethods.substack.com/p/my-data-career-journey-so-far
2•zekrom•25m ago•0 comments

It's Not Just You – The iOS Keyboard Is Broken [video]

https://www.youtube.com/watch?v=hksVvXONrIo
7•quarkw•27m ago•1 comments

California cracks down on water theft but spares data centers

https://www.latimes.com/environment/story/2025-10-14/newsom-ai-data-center-water
1•1vuio0pswjnm7•29m ago•0 comments

The Hidden Engineering of Niagara Falls

https://practical.engineering/blog/2025/10/21/the-hidden-engineering-of-niagara-falls
2•chmaynard•29m ago•0 comments

You Probably Don't Need to Switch from Pandas to Polars

https://datamethods.substack.com/p/you-probably-dont-need-to-switch
3•zekrom•31m ago•0 comments

Uber: Rebuilding Uber's Apache Pinot Query Architecture

https://www.uber.com/blog/rebuilding-ubers-apache-pinot-query-architecture/
1•ankitsultana•31m ago•0 comments

I Still Love R. I Just Wish More People Did

https://datamethods.substack.com/p/i-still-love-r-i-just-wish-more-people
4•zekrom•31m ago•0 comments

Why calm leadership matters most when everything's on fire

https://chaoticgood.management/a-fire-is-not-an-emergency-for-the-fire-department/
4•rellid•36m ago•0 comments

Pixel Art in Microcontroller Displays [link fixed]

https://dev.makapix.club/
1•fabk•37m ago•1 comments

Driverless Waymo taxis under investigation for failing to stop for a school bus

https://www.latimes.com/business/story/2025-10-21/driverless-waymo-taxis-under-investigation-afte...
4•1vuio0pswjnm7•39m ago•0 comments

Chinese staff go rogue after Dutch seize control of chip firm

https://www.telegraph.co.uk/business/2025/10/20/chinese-staff-go-rogue-dutch-seize-control-of-chi...
11•ridiculous_leke•43m ago•0 comments

#1 on PeerPush

https://peerpush.net/p/instantsite
1•emanuilv•45m ago•0 comments

Show HN: DocCraft AI – Generate professional business documents

1•iedayan03•51m ago•0 comments

Palmer Luckey considering entering laptop market with US-made model

https://www.tomshardware.com/laptops/palmer-luckey-considering-entering-laptop-market-with-fully-...
2•mhb•51m ago•3 comments

Gemini CLI Loading Phrases

https://github.com/google-gemini/gemini-cli/blob/c6a59896f304b82ef5a4ab2ef7cd26f4dfb0fbea/package...
1•caminanteblanco•52m ago•0 comments

OptPipe: Memory- and Scheduling-Optimized Pipeline Parallelism for LLM Training

https://arxiv.org/abs/2510.05186
2•PaulHoule•54m ago•0 comments

Ask HN: Do you use AI copilots to search and apply for jobs?

1•rrmdp•55m ago•0 comments

Daniel Naroditsky, who became chess grandmaster as a teen, dies at 29

https://www.washingtonpost.com/obituaries/2025/10/21/daniel-naroditsky-dies-chess-grandmaster/
1•anigbrowl•55m ago•1 comments

US intervenes as Oil/Drug Wars Escalate, Venezuela claims part of Guyana [video]

https://www.youtube.com/watch?v=K9yFupFOENw
2•labrador•56m ago•0 comments

OpenAI launches AI browser Atlas in latest challenge to Google

https://www.reuters.com/technology/openai-unveils-ai-browser-atlas-2025-10-21/
1•geox•56m ago•1 comments