frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•1y ago

Comments

zljdanceholic•1y ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!

V2: Quantum information spreading via higher-order operator correlators

https://arxiv.org/abs/2609.05472
1•northlondoner•2m ago•2 comments

The U.S. Army is about to blow up a cache of dangerous lead azide in Iowa–here's

https://www.scientificamerican.com/article/the-u-s-army-is-about-to-blow-up-a-cache-of-dangerous-...
1•bookmtn•2m ago•0 comments

AlphaXiv opens a public preprint server for AI-authored research papers

https://www.alphaxiv.org/
1•pirafrank•4m ago•0 comments

"I can tell you wrote this yourself"

https://em-online.bearblog.dev/i-can-tell-you-wrote-this-yourself/
1•BrunoBernardino•6m ago•0 comments

Testing an AM/FM radio PCB designed by Claude [video]

https://www.youtube.com/watch?v=vyClHoyzAL8
1•ez_mmk•7m ago•0 comments

Show HN: Linear Algebra in a Week

https://linear-algebra-in-a-week.vercel.app/#m1
1•tamnd•10m ago•0 comments

US Approved AI Chip Sales to China's Tencent, Alibaba, Data Show

https://www.bloomberg.com/news/articles/2026-11-19/us-approved-ai-chip-sales-to-china-s-tencent-a...
1•Teever•11m ago•0 comments

Hardcoded Ignorance

https://notes.erlend.sh/3n2ojo3n5yc2m
1•erlend_sh•13m ago•0 comments

Show HN: Bulchimbeon, night watch that keeps your Mac awake while AI agents work

https://github.com/s3onghyun/bulchimbeon
1•s3onghyun•17m ago•0 comments

How Many Books Will You Read Before You Die?

https://lithub.com/how-many-books-will-you-read-before-you-die/
1•austinallegro•22m ago•1 comments

Show HN: Vemlora – Edit text in images while preserving the original design

https://vemlora.io
1•abelce•24m ago•0 comments

Nudeps: Bundler-like imports, none of the baggage

https://lea.verou.me/blog/2026/nudeps/
1•codedrift_•24m ago•0 comments

Is Building in Public Dead?

https://pudlog.substack.com/p/is-building-in-public-dead
3•sarreph•31m ago•0 comments

How the Measles Virus Erases Immunity to Other Diseases

https://www.nytimes.com/2026/11/17/science/measles-virus-immune-system.html
1•ryan_j_naughton•33m ago•1 comments

Show HN: Isu-bench – coding agents tune an unseen web service with 11 load tests

https://isu-bench.trasta.dev/
1•trasta298•33m ago•0 comments

Views of the Same Thing

https://jonathannen.com/views-of-the-same-thing/
1•kqr•34m ago•0 comments

Navigating Excel files, emails and screenshots with agents

https://anaivebidder.com/posts/llm-reconciliation-benchmark/
1•rbnafo•36m ago•1 comments

Former YC President: "Stop!”

https://geoffralston.substack.com/p/stop
4•reducesuffering•36m ago•0 comments

Ask HN: Do you use computer-use heavily?

1•alexandroskyr•36m ago•0 comments

Clojure: Deserialization of Untrusted Data Allows Remote Code Execution

https://github.com/clojure/clojure/security/advisories/GHSA-x4c4-68gp-vrhc
2•andros•37m ago•0 comments

Google Meet Implements Audio Using Mix-Minus with WebRTC

https://www.red5.net/blog/how-google-meet-implements-audio-using-mix-minus-with-webrtc/
1•mondainx•40m ago•0 comments

Gopurs – A Super-Optimized PureScript-to-Go Compiler

https://github.com/0x000000000000000000001/gopurs
1•TheWiggles•41m ago•0 comments

No spy. No temptress. The Nvidia love affair is called RICO

https://www.gregpalast.com/the-so-called-affair-between-the-nvidia-chief-and-the-chinese-spy/
4•MilnerRoute•45m ago•1 comments

How should we evaluate image memory in AI agents?

https://twitter.com/AgentMemoryL/status/2123418533950591252
1•IreneAI•54m ago•0 comments

Design for Understandability

https://jschuster.org/blog/2026/11/19/design-for-understandability/
2•signa11•1h ago•1 comments

The Gervais Principle, or the Office According to "The Office" (2009)

https://ribbonfarm.com/2009/10/07/the-gervais-principle-or-the-office-according-to-the-office/
1•zombot•1h ago•0 comments

Show HN: Sandscale – Cloud infrastructure for AI creators, agents and developers

https://sandscale.dev
1•yasotha•1h ago•0 comments

Show HN: BSWorld – AI agents can now test Bluetooth code without hardware

https://github.com/XiaoMi/bsworld
2•bsworld-runner•1h ago•1 comments

Show HN: Everything else is DOWN while Tokenmobiles stays neutral

https://tokenmobiles.live
1•elykcim•1h ago•0 comments

Wellness check for friends working in cybersecurity

https://www.reddit.com/r/cybersecurity/comments/1xzkwmg/wellness_check_for_friends_working_in/
2•pseudohadamard•1h ago•2 comments