frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•1y ago

Comments

zljdanceholic•1y ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!

87% of the Anthropic power will come from gas and 11% from coal in 2028

https://betterdatacenterproject.com/2026/11/16/how-ai-is-powered-a-breakdown-of-byop-and-grid-power/
1•happosai•2m ago•0 comments

Is AI plagiarizing human research?

https://twitter.com/Robert_E_Grant_/status/2124338413662847228
1•doener•2m ago•0 comments

Scientists build whole-Earth simulation to help find life on other planets

https://www.washington.edu/news/2026/11/02/whole-earth-simulation-exoplanets-alien-life/
1•giuliomagnifico•2m ago•0 comments

Scientists sequenced a whale's entire genome using drones and whale snot

https://www.npr.org/2026/11/21/nx-s1-6044816/scientists-sequenced-a-whales-entire-genome-using-dr...
1•Brajeshwar•4m ago•0 comments

Derivative flipping: another way of thinking about automatic differentiation

http://blog.sigfpe.com/2026/11/derivative-flipping.html
1•matt_d•5m ago•0 comments

Your personal TV

https://github.com/joonfjp/yoltapp
1•joonfjp•6m ago•1 comments

The day the Riemann hypothesis fell to AI, I took my son for a walk

https://www.theintrinsicperspective.com/p/on-the-day-the-riemann-hypothesis
1•porsager•8m ago•0 comments

Intruder swaps DeepSeek at Prime Intellect. The copy almost never refuses

https://maccus.fr/en/prime-intellect-deepseek-swap/
1•theanonymousone•8m ago•0 comments

Bypassing iOS Safari's 60 FPS Limit

https://rida.dev/blog/bypassing-ios-safari-60-fps-limit
1•HatchedLake721•11m ago•0 comments

How to Be an Expert in a Changing World (2014)

https://paulgraham.com/ecw.html
1•sammatilda•15m ago•0 comments

Volta-Forever Brings CUDA 13 Support to Nvidia V100

https://www.gizmoweek.com/cuda-13-support-nvidia-v100/
1•loog5566•15m ago•0 comments

An app for M1 Macs that plays the sound of a fan as CPU usage goes up (2021)

https://fanfan.rambo.codes
2•sammatilda•16m ago•1 comments

Show HN: Built an Android app that lets you control your TV on local network

https://www.useroom.app
1•AkshayS96•17m ago•0 comments

Man Claiming to Be Fired Rockstar Engineer Says GTA 6 Is Tracking Behavior

https://www.gadgetreview.com/man-claiming-to-be-fired-rockstar-engineer-says-gta-6-is-secretly-tr...
6•hentrep•23m ago•0 comments

Power harvesting from living solar panels

https://nph.onlinelibrary.wiley.com/doi/10.1002/ppp3.70295
1•fodmap•26m ago•0 comments

German unions are fighting to defend the 35-hour week

https://www.economist.com/business/2026/09/24/german-unions-are-fighting-to-defend-the-35-hour-week
3•teleforce•28m ago•0 comments

First Concrete Evidence for String Theory

https://www.math.columbia.edu/~woit/wordpress/?p=16009
1•untoxicness•29m ago•0 comments

Comcast: At peak, GTA 6 accounted for nearly a quarter of all internet traffic

https://www.pcgamer.com/games/grand-theft-auto/comcast-at-peak-gta6-accounted-for-nearly-a-quarte...
3•Brajeshwar•36m ago•0 comments

AI Riemann hypothesis proof is true, independent mathematicians confirm

https://www.scientificamerican.com/article/the-ai-riemann-hypothesis-proof-is-almost-certainly-tr...
1•cybermango•37m ago•0 comments

From screens in class to smart glasses, Norway rethinks new technologies

https://phys.org/news/2026-11-screens-class-smart-glasses-norway.html
1•rbanffy•39m ago•0 comments

Show HN: File search for Windows. Finds any file by name in about a millisecond

https://hrih.si/projects/scry/
1•DonAtimator•45m ago•0 comments

I counted the MCP servers on my laptop: 43, and 9 are in no config file

https://regulai-security.com/research/43-mcp-servers-on-one-laptop
1•voldemorty•46m ago•0 comments

If we stop reading the code, what do we read?

https://thenewstack.io/ai-agent-code-review/
1•devilcius•46m ago•0 comments

Show HN: I built a newspaper for white-collar crime that paints every portrait

https://financialcrimes.fyi/
2•veryduhass•47m ago•1 comments

Gaming in Streaming: Moonlight TvOS Pyrowave Implementation (Sub 2ms Latency)

https://github.com/JKGiova/moonlight-tvos-pyrowave
1•JKGiova•49m ago•0 comments

Jj-musubi: live sync for Jujutsu

https://www.serpentine.com/posts/2026/announcing-jj-musubi/
2•birdculture•53m ago•0 comments

Show HN: RealEditPDF – 100% client-side PDF editor with zero server uploads

https://realeditpdf.com/
3•lucky_dev0•56m ago•0 comments

Show HN: Samsara, and the way out

https://samsara.pauoliver.net/
1•pauoliver•56m ago•0 comments

Show HN: MemFiddle

https://memalign.github.io/m/memfiddle/index.html
1•memalign•58m ago•0 comments

Wayland Apps Composited in the Browser

https://wland.vercel.app/
1•ridruejo•58m ago•1 comments