Hi HN! We're Rob, Matt, and Rachel from LlamaFarm (https://llamafarm.dev). We're building an open-source AI framework based on a simple belief: the future isn't one massive model in the cloud—it's specialized models running everywhere, continuously fine-tuned from real usage.

The problem: We were building AI tools and kept falling into the same trap. AI demos die before production. We built a bunch of AI demos but they were impossible to get to production. It would work perfectly on our laptop, but when we deployed it, something broke, and RAG would degrade. If we were running our own model, it would quickly become out of date. The proof-of-concept that impressed the team couldn't handle real-world data.

Our solution: declarative AI-as-code. One YAML defines models, policies, data, evals, and deploy. Instead of one brittle giant, we orchestrate a Mixture of Experts—many small, specialized models you continuously fine-tune from real usage. With RAG for source-grounded answers, systems get cheaper, faster, and auditable.

There’s a short demo here: https://www.youtube.com/watch?v=W7MHGyN0MdQ and a more in-depth one at https://www.youtube.com/watch?v=HNnZ4iaOSJ4.

Ultimately, we want to deliver a single, signed bundle—models + retrieval + database + API + tests—that runs anywhere: cloud, edge, or air-gapped. No glue scripts. No surprise egress bills. Your data stays in your runtime.

We believe that the AI industry is evolving like computing did. Just as we went from mainframes to distributed systems and monolithic apps to microservices, AI is following the same path: models are getting smaller and better. Mixture of Experts is here to stay. Qwen3 is sick. Llama 3.2 runs on phones. Phi-3 fits on edge devices. Domain models beat GPT-5 on specific tasks.

RAG brings specialized data to your model: You don't need a 1T parameter model that "knows everything." You need a smart model that can read your data. Fine-tuning is democratizing: what cost $100k last year now costs $500. Every company will have custom models.

Data gravity is real: Your data wants to stay where it is: on-prem, in your AWS account, on employee laptops.

Bottom line: LlamaFarm turns AI from experiments into repeatable, secure releases, so teams can ship fast.

What we have working today: Full RAG pipeline: 15+ document formats, programmatic extraction (no LLM calls needed), vector-database embedding, universal model layer that runs the same code for 25+ providers, automatic failover, cost-based routing; Truly portable: Identical behavior from laptop → datacenter → cloud; Real deployment: Docker Compose works now with Kubernetes basics and cloud templates on the way.

Check out our readme/quickstart for easy install instructions: https://github.com/llama-farm/llamafarm?tab=readme-ov-file#-...

Or just grab a binary for your platform directly from the latest release: https://github.com/llama-farm/llamafarm/releases/latest

The vision is to be able to run, update, and continuously fine-tune dozens of models across environments with built-in RAG and evaluations, all wrapped in a self-healing runtime. We have an MVP of that today (with a lot more to do!).

We’d love to hear your feedback! Think we’re way off? Spot on? Want us to build something for your specific use case? We’re here for all your comments!

WebAssembly WASI compilers in the Web browser with exaequOS

Firefox profiles: Private, focused spaces for all the ways you browse

JSON Schema Compatibility and the Robustness Principle

Show HN: Sovant – Memory that works across OpenAI, Claude and Gemini

Qualcomm just bought Arduino, and they're making a tiny computer [video]

The future of AI is already written

Devenv 1.10: monorepo Nix support with devenv.yaml imports

Show HN: Burst – Your Social Media Coach

Bankification Nation

Playwright new Test Agents explained

Ants Can Ferment Milk to Make Yogurt

Qt 6.10 Released, with Flexbox in QML

Reform defector left Tory staffer 'humiliated' after bullying and harassing her

Sora: Infinite Meaninglessness

Control your Canon Camera wirelessly

Home cluster. Feedback wanted on i3-n305

Show HN: Debug and Inspect TLS Encrypted Network Traffic from Any Source

The Flummoxagon

Aulico – Wrapping LLMs around crypto and stock markets

Show HN: Experiments in AI interfaces, hardware, and consumer AI

I Found Every Hiring Manager at Shopify (and You Can Too)

AI Agents: Rich Oases of Knowledge, Barren Deserts of Wisdom

IKEA Catalogs 1951-2021

Volunteer scientists work 'nights and weekends' to guide vaccine advice in US

Courts don't know what to do about AI crimes

Young People Are Falling in Love with Old Technology

Feeling Less Lonely

The 'One Piece' pirate flag became the global emblem of Gen Z resistance

Python Insider: Python 3.14.0 (final) is here

Launch HN: LlamaFarm (YC W22) – Open-source framework for distributed AI

Quiff Haircut 2025: Best Styles, Fades, Tapers