frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

Show HN: A new alternative to Softmax attention – live GD-Attention demos

https://zenodo.org/records/16757311
2•GhostDrift•2h ago
We built two live demos to illustrate the Ghost Drift Theory — a framework for modeling semantic coherence — and a new attention mechanism called GD-Attention.

• Part 1 — Semantic Energy Landscape: Visualize the unique coherence point s* and jump direction g in real time. • Part 2 — GD-Attention vs Softmax: "Softmax blends, GD-Attention selects" — explore the difference interactively.

Paper (with Zenodo DOI): [Ghost Drift Theory & GD-Attention PDF](https://zenodo.org/records/16757311) ▶ Part 1: https://gdt-semantic-energy-demo-jdgoe6gkrohleltjgvwgwq.stre... ▶ Part 2: https://gda-vs-softmax-demo-zooif4cfewrmnv85zaqymy.streamlit...

Would love feedback on clarity, use cases, and potential improvements.

Comments

GhostDrift•2h ago
Background Softmax attention blends all values weighted by normalized scores. While effective, it inherently diffuses signal — sometimes undesirable in tasks requiring discrete focus.

GD-Attention, derived from the Ghost Drift Theory, takes a different approach: it selects a single coherence point ∗ along a "jump" direction in the semantic space, determined by an underlying energy function.

The attached paper formalizes this mathematically, and the demos let you see and interact with these mechanisms in real time:

Part 1: Energy landscape → find ∗ and Part 2: Compare Softmax vs GD-Attention outputs and selectivity

This is still experimental, and feedback from the community — especially on edge cases, real-world applicability, and potential integration with transformer architectures — would be hugely appreciated.

Climate Action Plan for Developers

https://github.com/social-impact/focus-areas/environmental-sustainability/climate-action-plan-for-developers
1•protontypes•21s ago•0 comments

Reinforcement Learning Conference 2025: Outstanding Paper Awards

https://rl-conference.cc/RLC2025Awards.html
1•smokel•22s ago•0 comments

Fixed Points with Event-Indexed Lipschitz Contractions

https://lightcapai.medium.com/fixed-points-with-event-indexed-lipschitz-contractions-298c5c9037a2
1•WASDAai•1m ago•1 comments

2012 (Rosy Retrospection)

https://brian.bearblog.dev/2012-rosy-retrospection/
1•brianalonso•7m ago•0 comments

Swimming Naked: Why Safety Nets Kill Startups

https://www.wizenheimer.dev/blog/opinionated-articulation
1•wizenheimer•7m ago•0 comments

Diagnosing Your Company's Strategy Problem

https://cutlefish.substack.com/p/tbm-271-diagnosing-your-companys
1•gpi•9m ago•0 comments

ICE Took Half Their Work Force. What Do They Do Now?

https://www.nytimes.com/2025/07/27/us/ice-glenn-valley-foods.html
2•JumpCrisscross•10m ago•0 comments

Self-attention mechanism explained

https://jtlicardo.com/blog/self-attention-mechanism/
1•jtlicardo•13m ago•0 comments

Conversations remotely detected from cell phone vibrations, researchers report

https://www.psu.edu/news/engineering/story/conversations-remotely-detected-cell-phone-vibrations-researchers-report
2•giuliomagnifico•15m ago•0 comments

Claude is competitive with humans in (some) cyber competitions

https://red.anthropic.com/2025/cyber-competitions/
1•Techbrunch•28m ago•0 comments

Hugging Face TTS Arena V2 Results (Papla and Async.ai Ahead of ElevenLabs)

https://tts-agi-tts-arena-v2.hf.space/leaderboard
1•zinagorc•29m ago•0 comments

Revenue Automation Series: Testing an Integration with Third-Party System

https://engineeringblog.yelp.com/2025/05/revenue-automation-series-testing-an-integration-with-third-party-system.html
1•initialg•33m ago•0 comments

The Enshittification of Generative AI

https://www.wheresyoured.at/the-enshittification-of-generative-ai/
6•rcy•35m ago•0 comments

AI Is Spam Technology

https://twitter.com/staysaasy/status/1954526861427437656
4•thisismytest•35m ago•0 comments

High-tech monitoring during heart surgery doesn't lower risk of complications

https://medicalxpress.com/news/2025-07-high-tech-heart-surgery-doesnt.html
2•PaulHoule•37m ago•0 comments

Show HN: Bolt – A super-fast, statically-typed scripting language written in C

https://github.com/Beariish/bolt
6•beariish•37m ago•0 comments

Buttercup is now open-source

https://blog.trailofbits.com/2025/08/08/buttercup-is-now-open-source/
1•wslh•37m ago•0 comments

Unveiling complexity in blue spaces and life expectancy

https://www.sciencedirect.com/science/article/pii/S0013935125012320
2•gnabgib•39m ago•0 comments

Copy Link to Highlight in Nightly – These Weeks in Firefox: Issue 185

https://blog.nightly.mozilla.org/2025/07/28/copy-link-to-highlight-in-nightly-these-weeks-in-firefox-issue-185/
1•Bogdanp•42m ago•0 comments

Assemblers in W64devkit

https://nullprogram.com/blog/2025/08/10/
1•ingve•45m ago•0 comments

We've been building Swarm agents incorrectly (starting from OpenAI's Swarm)

https://github.com/minki-j/agentic_classification
2•minkijung•48m ago•1 comments

Why Load Balancing at Scale Is Hard

https://startwithawhy.com/reverseproxy/2025/08/08/ReverseProxy-Deep-Dive-Part4.html
1•agentictime•50m ago•0 comments

Cryptoasset Realization: How Cryptocurrencies Are Frozen, Seized, and Forfeited

https://www.chainalysis.com/blog/cryptoasset-realization-explained/
1•paulpauper•53m ago•0 comments

AOL Underground

https://aolunderground.com/
1•chrisco255•54m ago•1 comments

Stephen Miran became Trump's top ideologue on tariffs

https://fortune.com/article/who-is-stephen-miran-paper-trump-tariffs/
2•TMWNN•58m ago•1 comments

Firecracker: Start a VM in less than a second (2021)

https://jvns.ca/blog/2021/01/23/firecracker--start-a-vm-in-less-than-a-second/
1•thunderbong•58m ago•0 comments

Sleeping in Airports

https://www.sleepinginairports.net/
2•bookofjoe•1h ago•0 comments

Hugging Face TTS Arena V2 Results (Papla and Async.ai ahead of ElevenLabs)

https://huggingface.co/spaces/TTS-AGI/TTS-Arena-V2
3•leysan•1h ago•3 comments

Adult sites trick users into Liking Facebook posts using a clickjack Trojan

https://www.malwarebytes.com/blog/news/2025/08/adult-sites-trick-users-into-liking-facebook-posts-using-a-clickjack-trojan
1•akyuu•1h ago•0 comments

Chinese state media says Nvidia H20 chips not safe for China

https://www.cnbc.com/2025/08/10/chinese-state-media-says-nvidia-h20-chips-not-safe-for-china.html
1•giuliomagnifico•1h ago•0 comments