frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Attention Lottery: DeepSeek, Sparse Attention, and the Future of AI Cognition

https://geeksinthewoods.substack.com/p/attention-lottery-deepseek-sparse
1•artur_makly•57m ago

Comments

artur_makly•7m ago
“The degradation is subtle. The missing insights are rare, deferred, and distributed. Everyone notices a tenfold speed improvement; few notice the disappearance of an idea that might have changed the world.”

— funny correlation — this is the story of humanity’s biological, psychological, and philosophical evolution as well.

this is no difference.. History doing its thing again. Same Darwinian optimization, just swapped out the substrate. Silicon moves faster than carbon, which means we're speed-running toward some endpoint we can't quite see yet. Maybe we still get to choose architectural diversity before everything locks in. Or maybe we're already too late and just don't know it yet. To what final end?

Some uncanny correlations:

Biological Evolution: Just as DeepSeek's sparse attention sacrifices rare token connections for computational efficiency, biological evolution has consistently pruned "expensive" cognitive capabilities that didn't offer immediate survival advantage. The human brain operates on roughly 20 watts, an engineering marvel achieved through ruthless optimization. We lost the ability to synthesize vitamin C, to regenerate limbs, to perceive ultraviolet light, not because these capacities were useless, but because maintaining the metabolic infrastructure for rarely-used functions was too costly in ancestral environments where caloric scarcity was the norm. The neurological pathways that might have enabled eidetic memory or synesthetic cross-modal perception were likely discarded in favor of "good enough" pattern recognition optimized for predator avoidance and social navigation. Every human today is the descendant of ancestors whose brains kept the top-k survival-relevant features and let the outliers die in the attention lottery of natural selection.

Psychological Evolution: Our cognitive architecture exhibits the same sparse attention dynamics the article describes. Confirmation bias, the availability heuristic, and attentional blindness are not bugs but features, Bayesian priors that let us operate in real-time by ignoring the vast majority of sensory and conceptual space. We don't process all possible interpretations of a social interaction; we route attention to the handful that match our existing mental models, discarding the weak signals that might reveal we've misunderstood someone entirely. The psychological research on "inattentional blindness" (the invisible gorilla experiments) reveals that humans already run on learned sparsity, we literally cannot see what falls outside our predictive frame. The rare insights that change lives often come from those improbable, low-priority connections our brains almost filtered out: the shower thought, the hypnagogic flash, the accidental conversation with a stranger. Optimizing for cognitive efficiency means most humans spend their lives in a "tenfold speed improvement" of habitual thinking, never noticing the transformative ideas their sparse attention mechanisms prevented from ever reaching consciousness.

Philosophical Evolution: The history of thought reveals how philosophical paradigms function as civilizational sparse attention mechanisms, collective cognitive shortcuts that determine which questions a culture deems worth asking. The mechanistic worldview of the Enlightenment achieved extraordinary predictive power by treating nature as clockwork, but it systematically ignored (rendered computationally irrelevant) questions about consciousness, teleology, and qualitative experience. Logical positivism declared vast domains of human concern literally meaningless because they couldn't be empirically verified, a top-k selection rule for acceptable philosophical inquiry. Each dominant paradigm is a trained router deciding which intellectual pathways get attention and which get pruned. We celebrate the speed improvements: from Aristotelian physics to Newtonian mechanics in centuries, from Newtonian to relativistic in decades, from relativistic to quantum field theory in years. But the article's warning applies: we may never notice the metaphysical frameworks, the "ideas that might have changed the world," that were filtered out because they didn't fit the salience patterns of the prevailing epistemic architecture. The philosophical sparsity we inhabit isn't consciously chosen; it's the inherited result of centuries of optimizing for ideological efficiency, leaving vast regions of conceptual space unexplored because our collective attention mechanisms never computed those connections in the first place.

Show HN: Cbor.app – CBOR encoder/decoder with hex visualization

https://cbor.app/
1•0xcb0•2m ago•0 comments

I Stopped Scrolling and Started Coding: The Origin of FlickFuture

https://pieterhaasbroek.substack.com/p/why-i-stopped-scrolling-and-started
1•PantherCat•5m ago•0 comments

'Ex Machina' Abuses Women of Color and Nobody Cares Cause It's Smart (2015)

http://multiasianfamilies.blogspot.com/2015/05/how-ex-machina-abuses-women-of-color.html
2•isomorph•7m ago•0 comments

Shufflecake is a plausible deniability (hidden storage) layer for Linux

https://codeberg.org/shufflecake/shufflecake-c/src/branch/main/README.md
2•gasull•9m ago•0 comments

Is there any free Google Maps scraper available?

2•simkela•10m ago•1 comments

Bad Trips During Guided Psychedelic Sessions – How Rare Are They?

https://triptherapie.nl/forum/qa/what-percentage-of-the-trips-are-bad-trips-and-how-do-the-trip-s...
1•Triptherapie•11m ago•0 comments

ChatGPT hyped up violent stalker who believed he was "God's assassin," DOJ says

https://arstechnica.com/tech-policy/2025/12/chatgpt-hyped-up-violent-stalker-who-believed-he-was-...
2•MandieD•14m ago•0 comments

Tropy

https://tropy.org/
1•nanna•14m ago•0 comments

Hexapawn

https://en.wikipedia.org/wiki/Hexapawn
1•nanna•15m ago•0 comments

AI detection tools cannot prove that text is AI-generated

https://www.seangoedecke.com/ai-detection/
1•ingve•17m ago•1 comments

AI Reviews, Humans Profit: The Creator Economy in Science

https://medium.com/@zaranur848/ai-does-the-reviewing-humans-take-the-profit-share-the-next-big-cr...
1•haizei•18m ago•0 comments

Why Zig When There is C++, D, and Rust?

https://ziglang.org/learn/why_zig_rust_d_cpp/
2•tosh•19m ago•1 comments

Tracking Exposed: AI Forensics and the Reverse Engineering Task Force

https://tracking.exposed/
1•thunderbong•24m ago•0 comments

Why Did Trump Pardon the Former Honduran President? Follow the Tech Bros

https://www.motherjones.com/politics/2025/12/why-did-trump-pardon-the-former-honduran-president-f...
4•doener•25m ago•0 comments

Layoutz.hs: declarative, composable sections, trees, tables and interactive TUIs

https://github.com/mattlianje/layoutz/tree/master/layoutz-hs
1•internet_points•25m ago•0 comments

U.S.-Led Nuclear Power Boom Opens: Contract Orders Worth at Least 110 Tril. Won

https://www.businesskorea.co.kr/news/articleView.html?idxno=257977
1•mpweiher•25m ago•0 comments

Global DNS State, Part 2 – DNS Centralisation

https://reconwave.com/blog/post/dns-centralisation
3•yatralalala•27m ago•1 comments

Make the main Zig executable no longer depend on LLVM, LLD, and Clang libraries

https://github.com/ziglang/zig/issues/16270
1•tosh•27m ago•0 comments

The Big Problem with Solar Power [video]

https://www.youtube.com/watch?v=otSAEca41eE
2•mpweiher•31m ago•0 comments

The US polluters that are rewriting the EU's human rights and climate law

https://www.somo.nl/the-secretive-cabal-of-us-polluters-that-is-rewriting-the-eus-human-rights-an...
49•saubeidl•34m ago•0 comments

AI-Assisted Binary Reverse Engineering with Ghidra

https://github.com/biniamf/ai-reverse-engineering
4•mars_wonder•34m ago•1 comments

Improving MySQL Cluster Uptime: Designing Advanced Detection, Mitigation

https://www.uber.com/en-HK/blog/improving-mysql-cluster-uptime-part1/
1•ksec•35m ago•0 comments

To Catch a Predator: Leak exposes the internal operations of Intellexa's spyware

https://securitylab.amnesty.org/latest/2025/12/intellexa-leaks-predator-spyware-operations-exposed/
3•miohtama•37m ago•0 comments

When square pixels aren't square

https://alexwlchan.net/2025/square-pixels/
2•ravenical•37m ago•0 comments

Show HN: Travel ESIM Comparison

https://esimguide.com
2•iSloth•41m ago•0 comments

Beyond Electoral Theatre

https://rodgercuddington.substack.com/p/beyond-electoral-theatre-analysing
1•freespirt•41m ago•1 comments

Show HN: I built an autopilot that generates and posts my X tweets every day

https://x101.tech
1•HansP958•44m ago•0 comments

The first programming language designed for LLM

https://github.com/santino-research/spell
1•elio-santino•47m ago•0 comments

Why hiring feels impossible now: employers can't tell who's good

https://www.reddit.com/r/recruitinghell/s/4ExI1M25o5
3•BerislavLopac•49m ago•2 comments

How to Troubleshoot Common Kubernetes Errors [2025 Guide]

https://spacelift.io/blog/kubernetes-troubleshooting
1•amalinovic•49m ago•0 comments