Show HN: Shoehorn – Quantize any model down to run on your machine

https://notactuallytreyanastasio.github.io/shoehorn/

8•rhgraysonii•1h ago

Working on Mac, Linux, and Windows now. I include a simple GUI to find new models and get things built and set up. It is working quite well across a few models for me. The GitHub README and DESIGN.md files go into detail of the how/why and it's working remarkably well so far. https://github.com/notactuallytreyanastasio/shoehorn

Comments

mbuchel-hn•1h ago

does this work similar to airllm? i am wondering how it would handle something like quantizing kimi k3 on a budget of 8 gbs, or is that something you are not attempting to solve yet?

hmokiguess•31m ago

Reminds me of https://github.com/AlexsJones/llmfit

Using the railway network as a flatbed scanner

Fixing a Bricked Framework Laptop

The Amazon Tax

Linux 7.3 improves performance when running out of vRAM

How I Under-Engineered My Book

Python Polars Cheatsheet (based on our O'Reilly book)

Teaching my kid to code with a modern MUD

Fairphone is now officially available in the United States

Composable Tests

Code-native generation of highly programmable 3D assets (2026)

Babies born under sugar rationing grew into adults with lower cancer risk

Google has acquired the data of failed US airline Spirit

Splitting a Git Commit

Meta Files Patent for Facial Recognition, Automatic Recording of People

Show HN: Shoehorn – Quantize any model down to run on your machine

How Bluesky draws its logo on screenshots

Rethinking Database Programming

Baking a Model: A Metaphor for LLM Training

Muse Glimmer is a memory hierarchy disguised as a 30B Transformer

California's new tire efficiency rules could save drivers $1B a year

Quake Shareware, a CD-ROM just a little too full

Show HN: Saggar, a Mac terminal that keeps sessions and your attention organized

The coolest anti-surveillance tools at Defcon [video]

Deus Ex creator Warren Spector is retiring from game development

Finger: Social network that never died

Israel creates fake think tank in likely attempt to dupe AI chatbots

GPT-5.6 Sol Pricing Cut by 50%

Claude writing a macOS driver for my obscure HP printer built only for Windows

Fairphone 6 and PostmarketOS working main camera

IBM Simon (1994): the original smartphone, explained in its own ad [video]

Show HN: Shoehorn – Quantize any model down to run on your machine

Comments

Using the railway network as a flatbed scanner

Fixing a Bricked Framework Laptop

The Amazon Tax

Linux 7.3 improves performance when running out of vRAM

How I Under-Engineered My Book

Python Polars Cheatsheet (based on our O'Reilly book)

Teaching my kid to code with a modern MUD

Fairphone is now officially available in the United States

Composable Tests

Code-native generation of highly programmable 3D assets (2026)

Babies born under sugar rationing grew into adults with lower cancer risk

Google has acquired the data of failed US airline Spirit

Splitting a Git Commit

Meta Files Patent for Facial Recognition, Automatic Recording of People

Show HN: Shoehorn – Quantize any model down to run on your machine

How Bluesky draws its logo on screenshots

Rethinking Database Programming

Baking a Model: A Metaphor for LLM Training

Muse Glimmer is a memory hierarchy disguised as a 30B Transformer

California's new tire efficiency rules could save drivers $1B a year

Quake Shareware, a CD-ROM just a little too full

Show HN: Saggar, a Mac terminal that keeps sessions and your attention organized

The coolest anti-surveillance tools at Defcon [video]

Deus Ex creator Warren Spector is retiring from game development

Finger: Social network that never died

Israel creates fake think tank in likely attempt to dupe AI chatbots

GPT-5.6 Sol Pricing Cut by 50%

Claude writing a macOS driver for my obscure HP printer built only for Windows

Fairphone 6 and PostmarketOS working main camera

IBM Simon (1994): the original smartphone, explained in its own ad [video]