Boole-1.7B retains 85.9% of BF16 performance using 247MB (13.9x smaller). It outperforms 1-bit Bonsai-1.7B and similar-sized LFM models, and nearly matches 1.58-bit Bonsai-1.7B.
It’s intended for low-latency tasks using English and non-thinking mode. To learn more,
- Blog: https://precisionnumerics.ai/blog/boole-1p7b
- Weights: https://huggingface.co/precision-numerics/Boole-1.7B
- Chat in browser: https://precisionnumerics.ai/chat/
We're going to ship more capable models soon for the open-source community. Let us know what models/capabilities you want to see next!
tacomagick•37m ago