frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: Introduction to GPU Inference, a short course with Interactive diagrams

https://athrael.net/courses/gpu-inference/
2•athrael-soju•36m ago
Hi HN!

I've spent most of this year working on GPU inference, and I put together a short course to share what I've learned.

It starts with the basics and works up to how inference is actually served, things like continuous batching, goodput, and disaggregated prefill and decode. I'll soon add a lesson that shows how to run adaptive disaggregated inference on a consumer GPU!

The lessons are around 5-10min each, include interactive diagrams and are fully voice narrated.

No signup or fees.

I'd love to hear what you guys think, and I'm happy to answer any questions!

Show HN: Alloy CSS, dialogs, menus and tabs that work with JavaScript off

https://alloyhtml.com/example.html
90•prafandy•2h ago•12 comments

Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium

https://github.com/RunanywhereAI/trnrt
11•sanchitmonga22•1h ago•1 comments

Show HN: VennDB: append-only in-memory Rust DB for rows queried using bit flags

https://github.com/plabayo/venndb
30•gdcbe•1d ago•2 comments

Show HN: Hue MD – Markdown that shows status at a glance and stays plain text

https://spingras.github.io/hue-md/
2•spingras•32m ago•0 comments

Show HN: Introduction to GPU Inference, a short course with Interactive diagrams

https://athrael.net/courses/gpu-inference/
2•athrael-soju•36m ago•0 comments

Show HN: Zigzag, a native Mac browser for people leaving Arc

https://github.com/ZigaoWang/zigzag
98•ZigaoWang•3d ago•61 comments

Show HN: Soccer-Bench – Watch teams of LLM agents play 5v5 soccer

https://darksinian.github.io/soccer-bench/
3•Darksinian•50m ago•0 comments

Show HN: Moonswing – a Linux desktop environment built with Flutter

https://github.com/miracle-wm-org/moonswing
4•mkosarek•1h ago•1 comments

Show HN: Atli – MCP server that lets AI agents buy and install travel eSIMs

https://heyatli.com/mcp
4•peterhoang•2h ago•0 comments

Show HN: Agav – an open-source terminal agent designed to waste fewer tokens

https://github.com/prapaa-ai/agav
16•GeradeMoleculee•3h ago•7 comments

Show HN: An open virtual office to cowork with humans while your agents work

https://flat.social/virtual-office-platform
11•pawelwentpawel•3h ago•3 comments

Show HN: Sutra-OS – A self-hosted ontology platform

https://github.com/0nelight/sutra-os
64•0nelight•18h ago•34 comments

Show HN: Belay – formal verification for SQLite migrations and queries in Lean 4

https://github.com/vihren-dev/belay
3•neprotivo•4h ago•0 comments

Show HN: Orchard – Turn a Linux server into your own cloud

https://orchard.hackclub.com
4•leafd•4h ago•1 comments

Show HN: Show HN: PWT Today – A Daily Pokémon World Tournament Browser Run

https://pwt-today.com/
2•bigpapikite•4h ago•0 comments

Show HN: Pulsar – cross-harness agent to agent communication and messaging

https://github.com/yocontra/pulsar
19•contrahax•14h ago•3 comments

Show HN: Open-source, real-time object tracking for live video feeds

https://github.com/aryamandarda/tamserve
34•aryaman_darda•20h ago•2 comments

Show HN: Shoptimist – Amazon but Curated

https://shoptimist.co/
5•MisterJoe•5h ago•2 comments

Show HN: MeshLive – Offline Video calls and livestreams over Bluetooth mesh

https://meshlive.github.io/
2•gptgautam1•8h ago•0 comments

Show HN: Fakemetrics.com – "build in public" like a superstar

https://fakemetrics.com/
49•tigranbs•23h ago•21 comments

Show HN: Toolbelt – Free developer utilities that run in the browser

https://gettoolbelt.dev/
6•gprakasha234•14h ago•1 comments

Show HN: ThingStudio, Node-RED style programming for microcontrollers

https://thingstudio.net/
39•mkarliner•6d ago•8 comments

Show HN: Birds as Code

https://erl-j.github.io/fun-zone/birds.html
18•abdljasser2•22h ago•10 comments

Show HN: Free weekly backups for Supabase Free projects (pg_dump to R2)

https://github.com/liulewis/supabase-free-backup-lite
10•agricalc•16h ago•0 comments

Show HN: A terminal-native idle factory game, written in Rust with ratatui

https://gitlab.com/snipedbywifi/terminactory
172•snipedbywifi•3d ago•44 comments

Show HN: Deslop skill based on corpus-linguistics and psycholinguistics research

https://github.com/etodanik/deslop
16•dannypovolotski•1d ago•4 comments

Show HN: The Last Complication, a Zachtronics-style watchmaking puzzle game

https://lastcomplication.com/
86•tdeangelis•1d ago•18 comments

Show HN: Carton Clock – A working pendulum clock made from empty drink cartons

https://www.niklasroy.com/carton-clock/
87•r0r0•4d ago•2 comments

Show HN: db-branch – database branches in seconds for AI agents and CI, via ZFS

https://github.com/db-branch/db-branch
45•nu_nu11•2d ago•16 comments

Show HN: NOS x86-64 hypervisor, written in Rust

https://nos-os.tech/en/demo
4•irqlevel•19h ago•0 comments