frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•1y ago

Comments

zljdanceholic•1y ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!

Vals AI – Compare AI models across real-world benchmarks

https://www.vals.ai/comparison
1•cobychapple•2m ago•0 comments

What should my dog eat?

https://fluffmobile.com/what-should-my-dog-eat/
1•titusblair•3m ago•0 comments

Why do big dogs die young?

https://fluffmobile.com/research/why-big-dogs-die-young/
1•titusblair•3m ago•0 comments

How Carrel took shape: from a bookmark pile to trackers

https://usecarrel.app/blog/how-carrel-took-shape
1•neilguuu•4m ago•0 comments

Wait for pull request events with GitHub CLI

https://github.blog/changelog/2026-11-18-wait-for-pull-request-events-with-github-cli/
1•axis_official•12m ago•0 comments

Show HN: Git Hook for Model Identifation

https://github.com/orsenthil/git-hook-model-identification
1•orsenthil•12m ago•0 comments

Will Wright's next simulation will use AI to mine content from your memories

https://arstechnica.com/gaming/2026/11/will-wrights-next-simulation-will-use-ai-to-mine-content-f...
2•vok•13m ago•0 comments

Project Gryffindor: Meta's plan to get more school kids using Instagram

https://www.npr.org/2026/11/18/nx-s1-6037808/meta-instagram-schools-teens-safety
3•gfaddy•14m ago•0 comments

Scaling Durable Execution Workflows with CitusDB and NATS

https://www.bytefish.de/blog/sqlflow_distributed.html
1•bytefish•15m ago•1 comments

Ukraine blew up Putin's bridge using relay drones to bypass Starlink limits

https://arstechnica.com/gadgets/2026/11/ukraine-blew-up-putins-bridge-using-relay-drones-to-bypas...
4•hackthemack•19m ago•0 comments

Show HN: Snowchive – Snowden archive of all published documents

https://snowchive.org
4•libroot•19m ago•0 comments

Readycode.ai – Multi AI Platform

https://readycode.ai/
1•readycodeai•20m ago•0 comments

Another critical PHP flaw to be revealed tomorrow

https://www.aikido.dev/blog/php-security-release-19-november-2026-cve-2026-115560
2•EGreg•20m ago•1 comments

Ruby2ßhell: Pre-authentication RCE on stock Rails

https://verialabs.com/ruby2shell/
5•jdns•22m ago•0 comments

45-Year-Old Commodore Program Recovered from a Paper Printout

https://handheldhideout.neocities.org/articles/a-45-year-old-commodore-program-recovered-from-pap...
1•hackthemack•27m ago•0 comments

Internal tools are more useful half finished

https://12gramsofcarbon.com/p/agentics-mushy-software
2•theahura•29m ago•0 comments

Alfred 6

https://www.alfredapp.com
1•microflash•32m ago•1 comments

Research Acceleration: The Jagged Frontier

https://openai.com/index/research-acceleration-jagged-frontier/
1•saguntum•33m ago•0 comments

Traffic Mix Matters

https://brooker.co.za/blog/2026/11/18/workload-mix.html
1•ot•33m ago•0 comments

Confidential Cloud Public Beta

https://confidential.ai/blog/confidential-cloud-beta
2•ameanasad•34m ago•0 comments

Anthropic raises record $81B in IPO at $1.5T valuation

https://www.reuters.com/legal/transactional/anthropic-prices-blockbuster-ipo-83-share-source-says...
1•JumpCrisscross•36m ago•0 comments

Anthropic IPO raises record $81.3B on strong AI demand

https://www.npr.org/2026/11/18/nx-s1-6046212/anthropic-record-ipo-price
3•madihaa•38m ago•0 comments

Intel signs first external customer for advanced 18A chips

https://www.cnbc.com/2026/11/18/intel-first-18a-foundry-customer.html
2•snikolaev•42m ago•0 comments

CobaltC vs. Rust (compiled with overflow checks)

https://github.com/strawberry9/CobaltC/tree/main/bench
1•SilentLambda•44m ago•0 comments

Show HN: Satelital – How I made a custom game engine for my indie game

https://spectralorbit.com/blog/satelital_game_engine
1•ellipticaldoor•44m ago•0 comments

Steve Yegge on AI Agents and the Future of Software Engineering

https://newsletter.pragmaticengineer.com/p/steve-yegge-on-ai-agents-and-the
4•duck•46m ago•0 comments

Madras School System and AI Learning Share Similarity

2•tesnorindian•52m ago•0 comments

Show HN: Pip – Your Git history puts you on a Performance Improvement Plan

https://github.com/littlestjames82-sys/pip-pip
1•ghostdevstudio•54m ago•0 comments

Ask HN: What positive impact has AI had in the past 5 years?

2•meredithbloom•57m ago•6 comments

Official Microsoft agent-framework PyPI package compromised

https://opensourcemalware.com/blog/agent-framework-pypi-compromised
3•jruohonen•1h ago•0 comments