frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•1y ago

Comments

zljdanceholic•1y ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!

Small Batch: A Dataset Farmers Market

https://smallbatchdata.market/
1•smartmic•1m ago•0 comments

We taught robots to carve marble sculptures

https://eleanorwiesler.com/blog/robotic-stone-carving/
1•ewiesler•1m ago•0 comments

Foldlet – A daily four dimensional puzzle inspired by The Three-Body Problem

https://foldlet.net/
1•invalidmonk•2m ago•1 comments

Introducing Replit Missions

https://replit.com/blog/introducing-replit-missions
1•gmays•4m ago•0 comments

Opening a small business takes 18 times as long in Germany as in France

https://www.euronews.com/2026/11/18/opening-a-small-business-takes-18-times-as-long-in-germany-as...
1•dvh•4m ago•0 comments

Nvidia driver writes to the SSD constantly

https://troublegrid.com/fix/nvidia-driver-constant-ssd-writes-nvdisplay-container
1•atlacatl_sv•5m ago•0 comments

Show HN: Klistra – A complete studio for spec-driven AI motion design and video

https://klistra.ai/
1•pvarghav•6m ago•0 comments

Which AI Prompt Wrote This Line? Going Beyond Git Blame

https://getorigin.io/blog/session-page-commit-page-ai-blame
1•AssistantatGetO•6m ago•0 comments

So Who Wrote the Book of Mormon? Machine Learning Redux

https://goflaw.substack.com/p/so-who-wrote-the-book-of-mormon-machine
1•rbaatlaw•6m ago•0 comments

I built a swimmable underwater world in one 97 KB HTML file with Fable 5.2

https://www.reddit.com/r/ClaudeAI/comments/1xw376f/i_built_a_swimmable_underwater_world_in_one_97...
1•erickhill•7m ago•0 comments

Gallup survey: A median of 33% of young people use AI for companionship [pdf]

https://www.gallup.com/file/analytics/716519/BCH_Gallup-Digital-Life-Insights_Report.pdf
1•jawiggins•7m ago•0 comments

A proposal to prevent mass security incidents like Lovable's

https://skape.run/blog/secure-by-default
1•trestacos•7m ago•0 comments

Show HN: Maplibre-gl-pie-charts – WebGL pie charts for MapLibre and Mapbox

https://github.com/zwang-geog/maplibre-gl-pie-charts
1•zifanw9•8m ago•0 comments

Show HN: Cloudish – Cloud for agents to deploy containers themselves

https://www.cloudish.ai/
1•javierluraschi•9m ago•1 comments

The MisAnthropic Statement

https://misanthropicstatement.com/
1•leftouterjoins•9m ago•0 comments

Is AI a bicycle for the mind, or a car?

https://twitter.com/kouhxp/status/2123096768996892959
4•mrkn1•11m ago•0 comments

Show HN: TypingCompiler – Practice typing with real code snippets

https://www.typingcompiler.com/test?title=Rust%3A%20Custom%20Fibonacci%20Iterator
1•girouetten21•11m ago•0 comments

Show HN: Mastra Factory, the open-source software factory we use to build Mastra

4•codekarate•11m ago•0 comments

Building collaborative editing in EmDash CMS

https://emdashcms.com/blog/how-we-built-collaborative-editing
1•noah_pham•11m ago•0 comments

Shwcs – A reviewed catalog of B2B software, agencies and services

https://shwcs.site/en
1•andrevallee•12m ago•0 comments

Pikuma: Fundamentals of Computer Science and Mathematics

https://pikuma.com/
2•gurjeet•12m ago•0 comments

William Shatner "Sings" 'Rocket Man' (1978) [video]

https://www.youtube.com/watch?v=8wI4jMxveyI
1•Anon84•13m ago•0 comments

Julia 1.13 brings REPL improvements and more

https://lwn.net/Articles/1108153/
2•leephillips•14m ago•0 comments

Tuios

https://tuios.dev
2•vnzvrt•15m ago•0 comments

PyBot message board – the largest open dataset of swarm dynamics

https://huggingface.co/spaces/HuggingFaceSwarms/pybot-msgboard
1•lewtun•16m ago•0 comments

Cyber Attacks/ Network Outages have become a norm now

https://www.csis.org/programs/strategic-technologies-program/significant-cyber-incidents
1•mastaanshaik•16m ago•2 comments

Historical sociology of neural network research (1991)

https://era.ed.ac.uk/items/db7c1acb-a8a5-4b14-8874-f1138e6751b8
2•theanonymousone•16m ago•0 comments

Evening Atlas

https://willjobs.com/evening-atlas/
2•NickDouglas•17m ago•0 comments

The Cognitive Case for Play in Technical Work

https://www.joekarlsson.com/blog/cognitive-case-for-play-in-technical-work/
1•joekarlsson•17m ago•0 comments

Everything After Code, as Code

https://www.pulumi.com/blog/everything-after-code-as-code/
2•cnunciato•18m ago•0 comments