frontpage.

I'm sharing a fully offline RAG (Retrieval-Augmented Generation) stack I built to solve a crucial problem in industrial environments: data privacy and recurring API costs.

We deal with sensitive proprietary datasheets and schematics daily, making cloud-based LLMs like ChatGPT non-compliant.

The Solution: A containerized architecture that ensures data never leaves the local network.

The Stack: LLM: Llama 3 (via Ollama) Vector DB: ChromaDB Deployment: Docker Compose (One-click setup) Benefit: Zero API costs, no security risks, fast local performance. The code and architecture are available here: https://github.com/PhilYeh1212/Local-AI-Knowledge-Base-Docke...

Happy to answer questions about the GPU passthrough setup or document ingestion pipeline.

Voyager 1 Is About to Reach One Light-Day from Earth

OpenAI needs to raise at least $207B by 2030 so it can continue to lose money

I don't care how well your "AI" works

A cell so minimal that it challenges definitions of life

Statistical Process Control in Python

Slashdot Effect

Is DWPD Still a Useful SSD Spec?

Show HN: I turned algae into a bio-altimeter and put it on a weather balloon

KDE Plasma 6.8 Will Go Wayland-Exclusive in Dropping X11 Session Support

Show HN: KiDoom – Running DOOM on PCB Traces

Image Diffusion Models Exhibit Emergent Temporal Propagation in Videos

Surprisingly, Emacs on Android is pretty good

Qiskit open-source SDK for working with quantum computers

Cekura (YC F24) Is Hiring

I DM'd a Korean presidential candidate and ended up building his core campaign

Show HN: Offline RAG System Using Docker and Llama 3 (No Cloud APIs)

Copyparty, the FOSS file server [video]

Trillions spent and big software projects are still failing

Justice dept. requires Realpage end sharing competitively sensitive information

Jakarta is now the biggest city in the world

Show HN: We built an open source, zero webhooks payment processor

1,700-year-old Roman sarcophagus is unearthed in Budapest

CS234: Reinforcement Learning Winter 2025

A new bridge links the math of infinity to computer science

Space Truckin' – The Nostromo (2012)

How to repurpose your old phone into a web server

Efficient solar cooking that stores heat in sand

Launch HN: Onyx (YC W24) – Open-source chat UI

FLUX.2: Frontier Visual Intelligence

Java Decompiler

Show HN: Offline RAG System Using Docker and Llama 3 (No Cloud APIs)

Comments

Voyager 1 Is About to Reach One Light-Day from Earth

OpenAI needs to raise at least $207B by 2030 so it can continue to lose money

I don't care how well your "AI" works

A cell so minimal that it challenges definitions of life

Statistical Process Control in Python

Slashdot Effect

Is DWPD Still a Useful SSD Spec?

Show HN: I turned algae into a bio-altimeter and put it on a weather balloon

KDE Plasma 6.8 Will Go Wayland-Exclusive in Dropping X11 Session Support

Show HN: KiDoom – Running DOOM on PCB Traces

Image Diffusion Models Exhibit Emergent Temporal Propagation in Videos

Surprisingly, Emacs on Android is pretty good

Qiskit open-source SDK for working with quantum computers

Cekura (YC F24) Is Hiring

I DM'd a Korean presidential candidate and ended up building his core campaign

Show HN: Offline RAG System Using Docker and Llama 3 (No Cloud APIs)

Copyparty, the FOSS file server [video]

Trillions spent and big software projects are still failing

Justice dept. requires Realpage end sharing competitively sensitive information

Jakarta is now the biggest city in the world

Show HN: We built an open source, zero webhooks payment processor

1,700-year-old Roman sarcophagus is unearthed in Budapest

CS234: Reinforcement Learning Winter 2025

A new bridge links the math of infinity to computer science

Space Truckin' – The Nostromo (2012)

How to repurpose your old phone into a web server

Efficient solar cooking that stores heat in sand

Launch HN: Onyx (YC W24) – Open-source chat UI

FLUX.2: Frontier Visual Intelligence

Java Decompiler