frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Decoupling Compute and Memory for Async GPUs

5•yiyingzhang•3h ago
Cool open-source project that introduces a new programming model for decoupling compute and memory for NVIDIA GPUs that supports asynchronous memory operations (e.g., Hopper). 12% perf improvement over SOTA and 67% less kernel code.

Paper: "VDCores: Resource Decoupled Programming and Execution for Asynchronous GPU" arXiv:2605.03190

Comments

bobbyzhu2008•3h ago
67% less kernel code is the more interesting number here — Hopper's async capabilities have been underutilized largely because the programming model is painful. Curious how it handles cases where compute and memory phases aren't cleanly separable.
jhap•48m ago
This seems like a better version of CUDA, for Hopper GPUs?

Trying to recover from thin content penalty from Google

2•anitroves•26m ago•2 comments

Applied AI Implementation Engineer Freelance

3•awongsem•36m ago•0 comments

Ask HN: Where is our profession (programmer) going?

82•syntaxbush•17h ago•88 comments

Tell HN: OpenAI has started putting ads on paid programs

105•shantnutiwari•6h ago•48 comments

Ask HN: Quickbooks Alternative?

2•bix6•2h ago•0 comments

Google AI overview for "keynesian economics" is written in Korean

4•something765478•2h ago•1 comments

Decoupling Compute and Memory for Async GPUs

5•yiyingzhang•3h ago•2 comments

Ask HN: What surprised you about Estonia e-Residency and running an Estonian OÜ?

69•jvilalta•6h ago•62 comments

Ask HN: Do you thank your agents when they did a good job?

4•ex-aws-dude•4h ago•7 comments

Ask HN: What is one thing about AI that annoys you the most?

3•akashwadhwani35•1h ago•3 comments

Ask HN: How much coding should beginners learn in the AI era?

30•JohnDSDev•1d ago•40 comments

Got access to Gemini's actual thinking

4•StizzurpXDD•11h ago•0 comments

Ask HN: What are the hardest problems AWS Lambda MicroVMs can solve now?

5•iaziz786•20h ago•1 comments

Ask HN: What home printer do you use/recommend?

18•niyazpk•1d ago•21 comments

Overfitted a 900KB Transformer to Compress a 100MB CSV into 7MB

8•spidy__•2d ago•7 comments

Ask HN: Yahoo deleted all my emails. Now what?

15•neya•1d ago•12 comments

Ask HN: Will programmers write more efficient code during the memory shortage?

153•amichail•5d ago•245 comments

How to find AI-conservative companies to work for?

20•tossitawayplz•1d ago•11 comments

Ask HN: Why don't LLM harnesses enable/expose custom middleware hooks?

8•fur-tea-laser•1d ago•7 comments

Ask HN: I miss old days of blogging without promotions

8•throwaw12•1d ago•12 comments

Ask HN: Am I missing something with AI

15•vasko•2d ago•22 comments

Ask HN: Is anyone using the A2A protocol?

96•asim•1w ago•45 comments

Ask HN: How are you finding work/gigs as a SWE?

10•mariopt•1d ago•7 comments

Ask HN: What tools are you using for AI-assisted code review?

25•agos•1w ago•30 comments

Ask HN: Anthropic banned me from using Claude Code and I don't know what to do

80•ayi•2d ago•92 comments

Anyone else feels many LLMs are heavily biased towards consumerism these days?

8•pyeri•1d ago•4 comments

Tell HN: I never bought anything from clicking on a paid ad

22•julienreszka•2d ago•28 comments

Ask HN: Are people optimistic about the future?

43•JohnDSDev•5d ago•91 comments

Ask HN: What was the biggest contributor to your happiness in the past year?

10•chistev•14h ago•9 comments

You've reached the end!