frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: Gall – Inkling 2 Mini on 24GB M2, frees RAM between messages

https://github.com/ltrgoddard/gall
2•ltrg•13m ago
Thinking Machines Lab gives 32GB as the minimum RAM requirement for Inkling 2 Mini on Mac, but with the Q3 quant I felt it must be possible to get somewhere reasonable on my 24GB M2 MacBook Air.

Llama.cpp wasn't cutting it even with patches, so I spent this week's Fable allowance (with a sprinkling of Astra) on this custom inference engine, and took the opportunity to add some optimisations and ergonomics for running on a memory-constrained laptop:

- strictly one model loaded at a time, requests queued; - KV cache gets saved and model unloaded after every response (or configurable delay), so RAM stays at 50MB between calls, but reload is fast; - menu bar app shows status and icon changes when prefilling/generating.

So far I've been using it with hax [1] with my normal system prompt + tool list, which runs to about 2,800 tokens, and getting near-instant responses in new sessions due to the cache-and-reload. Works great as a local agent setup for infrequent messages too, e.g. via a Telegram bridge.

I'm sure this vibecoded engine and the model itself will be superseded in time, but for now it's by far the best local model setup I've ever managed on this machine, so wanted to share for others in the same boat. Please do hack away at it.

1. https://github.com/OleksandrChekhovskyi/hax

"You and Your Research" by Dr. Richard W. Hammin [pdf]

https://www.cs.virginia.edu/~robins/YouAndYourResearch.pdf
1•arbayi•1m ago•0 comments

Planetwurst – The World Atlas of Sausages

https://planetwurst.com/
1•MiscIdeaMaker99•5m ago•0 comments

Making a font for the Jamaican flag alphabet

https://digitalseams.com/blog/making-a-font-for-the-jamaican-flag-alphabet
2•bobbiechen•5m ago•0 comments

Show HN: PortReaper – see which project and git branch holds each port on a Mac

https://github.com/amitgal45/portreaper
1•amitgal45•5m ago•0 comments

Jon Stewart's 2004 appearance on Crossfire

https://en.wikipedia.org/wiki/Jon_Stewart%27s_2004_appearance_on_Crossfire
2•gregsadetsky•6m ago•0 comments

Incredible: Origins of the Grandfather of GTA VI Creators Revealed

https://odnoboko.com/en/did_zasnovnikiv_rockstar_games_pokhodit_iz_borislava_na_lvivshchini
1•Kizert•7m ago•0 comments

Experts warn: Nearly everyone in AI is susceptible to a honey-trap scheme

https://techcrunch.com/2026/11/20/experts-warn-nearly-everyone-in-ai-is-susceptible-to-a-honey-tr...
1•theanonymousone•8m ago•0 comments

Show HN: Gall – Inkling 2 Mini on 24GB M2, frees RAM between messages

https://github.com/ltrgoddard/gall
2•ltrg•13m ago•0 comments

Valve says it might have to raise the price of supply-limited Steam Machines

https://arstechnica.com/gaming/2026/11/valve-says-it-might-have-to-raise-the-price-of-supply-limi...
1•rbanffy•13m ago•0 comments

Demis Hassabis

https://en.wikipedia.org/wiki/Demis_Hassabis
1•simonebrunozzi•15m ago•0 comments

The Brother-Sister Duo Who Want to Keep Anthropic Weird

https://www.wsj.com/tech/ai/anthropic-dario-daniela-amodei-siblings-ipo-be84ad11
1•throwaway384034•15m ago•0 comments

Natural Programming Just Dropped

https://github.com/fraliv50/llang-natural-language-programming-
1•hollywoodfranc•15m ago•1 comments

Secure Exclaves and Ambient Sensing

https://security.apple.com/blog/secure-exclaves/
1•dgroshev•18m ago•0 comments

Donald Hoffman Meets Stephen Wolfram for the First Time on Toe [video]

https://www.youtube.com/watch?v=1m7bXNH8gEM
1•Anon84•19m ago•0 comments

F/OSS Comics #16: BSD Unix, Part 6 – The Struggle for Freedom

https://fosscomics.com/posts/16.%20BSD%20Unix%20Part%206%20-%20The%20Struggle%20for%20Freedom/
1•joonehur•20m ago•1 comments

Future of Tech After Computers

1•HellaHansome•25m ago•1 comments

US klezmer group helped Soviet refuseniks with a musical cipher

https://www.timesofisrael.com/how-a-us-klezmer-group-helped-soviet-refuseniks-by-hiding-informati...
1•leephillips•27m ago•0 comments

I Hacked Harley's $100M Motorcycle [video]

https://www.youtube.com/watch?v=Z4Ty0oqA_Bk
1•jackdoe•28m ago•0 comments

US judge rejects CFTC emergency bid to block New York from policing Kalshi

https://www.reuters.com/legal/government/us-judge-rejects-cftc-emergency-bid-block-new-york-polic...
2•ra0x3•28m ago•0 comments

One-of-a-kind biological computer runs on living bacteria

https://newatlas.com/computers/biological-computer-living-bacteria/
2•sargstuff•29m ago•1 comments

JEDEC Previews DDR6 Memory Standard: 2.35x More Bandwidth, 44% Narrower DIMMs

https://www.servethehome.com/jedec-previews-ddr6-memory-standard-2-35x-more-bandwidth-44-narrower...
1•rbanffy•29m ago•0 comments

Show HN: TheGitAI/CLI Agent with Computer Control on Linux (Wayland+X11)

https://thegit.ai/tour
1•waximabbax•29m ago•0 comments

Show HN: Straum – A Postgres sidecar that keeps your dashboard aggregates live

https://github.com/janbjorge/straum
1•jeeybee•32m ago•0 comments

The New World (2025)

https://colossus.com/article/joshua-kushner-thrive-new-world/
1•simonebrunozzi•32m ago•0 comments

Domain Industry Relationship Maps: Registrars, Registries and Auctions

https://www.dnaccess.com/domain-industry-maps/
1•bhartzer•32m ago•0 comments

Show HN: I wrote FlightTrack twice

https://apps.apple.com/us/app/flighttrack-flight-tracker/id6788552553
1•bkazez•34m ago•0 comments

Free AI app that improves framerate of videos

https://flowframes.app/
1•illidan1000•34m ago•0 comments

OpenAgentCore: The OpenAI Agents API, open source and self-hosted

https://github.com/MiniMax-AI/OpenAgentCore
1•gfortaine•35m ago•0 comments

WordPress Forever?

https://www.gordonmclean.co.uk/2026/11/21/wordpress-forever/
1•speckx•37m ago•0 comments

GitHub Actions accepts invalid YAML

https://yossarian.net/til/post/github-actions-accepts-invalid-yaml/
2•woodruffw•37m ago•0 comments