Ask HN: How are you doing RAG locally?

16•tmaly•2h ago

I am curious how people are doing RAG locally with minimal dependencies for internal code or complex documents?

Are you using a vector database, some type of semantic search, a knowledge graph, a hypergraph?

Comments

eajr•48m ago

Local LibreChat which bundles a vector db for docs.

whattheheckheck•34m ago

Anythingllm is promising

rahimnathwani•13m ago

If your data aren't too large, you can use faiss-cpu and pickle

https://pypi.org/project/faiss-cpu/

motakuk•2m ago

LightRAG, Archestra as a UI with LightRAG mcp

The $LANG Programming Language

Ask HN: How are you doing RAG locally?

Ask HN: Iran's 120h internet shutdown, phones back. How to stay resilient?

Unemployed almost a year after graduating MIT – a rant

Ask HN: ADHD – How do you manage the constant stream of thoughts and ideas?

Ask HN: Quantum Computation, Computers and Programming

Ask HN: Vxlan over WireGuard or WireGuard over Vxlan?

Ask HN: What are you working on? (January 2026)

Ask HN: Discrepancy between Lichess and Stockfish

Tell HN: DigitalOcean's managed services broke each other after update

Ask HN: Looking for Windows contributors for meeting-detection engine

Tell HN: I Downgraded from macOS Tahoe to Sequoia

Ask HN: Personal website featured on HN, list of restaurants in NYC

Tell HN: Intel could blow up the Console Wars if it had the guts

Ask HN: How to find gaps and oppurtunities in the AI era?

Ask HN: Who remembers AWS Spot's auction era before the 2017 pricing change?

Ask HN: 500 citation MSc CS, stuck in a low-trust region. How to move forward?

Tell HN: The Google Tenor GIF API has been shut down

Ask HN: Learning Discoverability

Ask HN: Are you underutilizing your insurance too?

Ask HN: How are you preventing LLM hallucinations in production systems?

Is "AI vibe coding" making prototyping worse inside real companies?

Ask HN: What made you move back to HTML-to-PDF in production?

Ask HN: Does anyone else think that humanoid robots is a bubble?

Eleva.js – A 2.3KB JavaScript framework with signals and no virtual DOM

Ask HN: Job seekers, what's working / not working?

Ask HN: When has a "dumb" solution beaten a sophisticated one for you?

Experiment: Using NotebookLM as a cynical code reviewer (via custom prompts)

Gh Account Permabanned – Help?

Unpopular Opinion: Bootstrap is a better front-end framework than Tailwind

Ask HN: How are you doing RAG locally?

Comments

The $LANG Programming Language

Ask HN: How are you doing RAG locally?

Ask HN: Iran's 120h internet shutdown, phones back. How to stay resilient?

Unemployed almost a year after graduating MIT – a rant

Ask HN: ADHD – How do you manage the constant stream of thoughts and ideas?

Ask HN: Quantum Computation, Computers and Programming

Ask HN: Vxlan over WireGuard or WireGuard over Vxlan?

Ask HN: What are you working on? (January 2026)

Ask HN: Discrepancy between Lichess and Stockfish

Tell HN: DigitalOcean's managed services broke each other after update

Ask HN: Looking for Windows contributors for meeting-detection engine

Tell HN: I Downgraded from macOS Tahoe to Sequoia

Ask HN: Personal website featured on HN, list of restaurants in NYC

Tell HN: Intel could blow up the Console Wars if it had the guts

Ask HN: How to find gaps and oppurtunities in the AI era?

Ask HN: Who remembers AWS Spot's auction era before the 2017 pricing change?

Ask HN: 500 citation MSc CS, stuck in a low-trust region. How to move forward?

Tell HN: The Google Tenor GIF API has been shut down

Ask HN: Learning Discoverability

Ask HN: Are you underutilizing your insurance too?

Ask HN: How are you preventing LLM hallucinations in production systems?

Is "AI vibe coding" making prototyping worse inside real companies?

Ask HN: What made you move back to HTML-to-PDF in production?

Ask HN: Does anyone else think that humanoid robots is a bubble?

Eleva.js – A 2.3KB JavaScript framework with signals and no virtual DOM

Ask HN: Job seekers, what's working / not working?

Ask HN: When has a "dumb" solution beaten a sophisticated one for you?

Experiment: Using NotebookLM as a cynical code reviewer (via custom prompts)

Gh Account Permabanned – Help?

Unpopular Opinion: Bootstrap is a better front-end framework than Tailwind