frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•1y ago

Comments

zljdanceholic•1y ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!

The most misunderstood graph in AI just got a major update

https://www.technologyreview.com/2026/11/20/1149399/the-most-misunderstood-graph-in-ai-just-got-a...
1•speckx•3m ago•0 comments

Concepts to Know for Coding with AI Agents

https://www.davidayo.com/blog/5-concepts-to-know-for-coding-with-ai-agents/
1•davidayo•4m ago•0 comments

BrickLink Is Temporarily Unavailable

https://maintenance.bricklink.com/recovery.html
1•Freak_NL•5m ago•0 comments

China Is Mass-Producing One-Person AI Companies

https://www.bloomberg.com/news/features/2026-11-12/how-china-is-creating-a-new-generation-of-ai-e...
1•ravieira•5m ago•0 comments

GPT-6.2 Sol and Astra review: should you switch?

https://www.coderabbit.ai/blog/gpt-6-2-sol-and-astra-review
2•smb06•6m ago•0 comments

Award-winning documentary American Doctor sets UK and Ireland cinema release

https://www.theupcoming.co.uk/2026/07/21/award-winning-documentary-american-doctor-sets-uk-and-ir...
1•Betelbuddy•6m ago•0 comments

Games like Krillion a.k.a. the second DLE Renaissance

https://dles.gg/blog/games-like-krillion
1•trizoza•10m ago•0 comments

The use of AI based tools to find bugs in Open Source software

https://www.haproxy.com/blog/on-the-use-of-ai-based-tools-to-find-bugs-in-open-source-software
1•owenthejumper•12m ago•0 comments

An all-digital future means constant security breaches

https://www.dedoimedo.com/life/digital-future.html
4•dxs•14m ago•0 comments

Lenacapavir

https://en.wikipedia.org/wiki/Lenacapavir
4•PaulHoule•14m ago•1 comments

What happens when a Google data centre comes to town? Southern India finding out

https://www.cbc.ca/news/world/ai-data-centre-google-india-9.7374345
2•Betelbuddy•14m ago•0 comments

Anthropic is not living up to its ideals

https://so8res.substack.com/p/anthropic-is-not-living-up-to-its
2•sundarurfriend•16m ago•0 comments

The Strategy of Redundancy: The Devaluation of Plagiarism in the Age of Entropy

https://medium.com/@smoking2man/the-strategy-of-redundancy-the-devaluation-of-plagiarism-in-the-a...
1•Aldus551•17m ago•0 comments

A on device STT Wisper Flow alternative that uses Mistral Voxtral model and AFM

https://github.com/ThriveEngineer/Whistral
1•luis_journey•17m ago•0 comments

Terraform Experiencing Issues

https://status.hashicorp.com
1•AxEy•18m ago•0 comments

You Can't Focus in an Open Office Pro Perfected [video]

https://www.youtube.com/watch?v=HQPgvxNU94M
2•tortilla•18m ago•0 comments

I've only sold five copies of GTA 6, says shop owner

https://www.bbc.com/news/articles/cmqj5dr01e85o
1•robrain•18m ago•0 comments

SpaceX lenders don't want Elon Musk launching their collateral into space

https://arstechnica.com/space/2026/11/spacex-lenders-dont-want-elon-musk-launching-their-collater...
5•lakis•20m ago•0 comments

Winedroid – run Android apps without Android (WASM demo)

https://winedroid.soham.sh/demo/
5•sohzm•21m ago•1 comments

US will soon announce root cause behind FAA nationwide ground stop

https://arstechnica.com/gadgets/2026/11/how-faa-can-modernize-us-national-airspace-system-without...
6•lakis•23m ago•0 comments

Nvidia's accounting is a focus of US SEC investigation

https://www.reuters.com/world/us-secs-nvidia-probe-is-examining-potential-accounting-issues-sourc...
8•Betelbuddy•23m ago•1 comments

Chronic Brain Trauma Is Extensive in Navy's Elite Speedboat Crews

https://www.nytimes.com/2024/11/12/us/brain-trauma-cte-navy-speedboat.html
2•pr337h4m•24m ago•0 comments

Ask HN: Was I proven correct SWE is dying?

1•blindprogrammer•24m ago•2 comments

iOS's Unpredictable Search

https://unsung.aresluna.org/ioss-unpredictable-search/
1•speckx•25m ago•0 comments

Dutch data watchdog highlights safety issues with AI glasses

https://www.theregister.com/security/2026/11/20/dutch-data-watchdog-highlights-safety-issues-with...
4•nephihaha•25m ago•0 comments

The place the frostbite CPU came from

https://twitter.com/EV_Trapper/status/2123631975894302816
1•petra•26m ago•0 comments

EndeavorOTC, FDA-approved video game for treating ADHD

https://www.endeavorotc.com/
2•illidan1000•28m ago•1 comments

GrapheneOS claims Google is now waging war against it, could lock Pixel bootload

https://www.androidauthority.com/grapheneos-team-google-pressure-3737525/
15•jeena•29m ago•2 comments

Judge: DHS's Seizure Of Immigration Lawyer's Phone Likely Violated 1st Amendment

https://www.techdirt.com/2026/11/20/judge-says-dhss-seizure-of-an-immigration-lawyers-phone-likel...
10•hn_acker•30m ago•1 comments

Engineering human oversight with decision queues

https://muster.town/blog/engineering-human-oversight-with-decision-queues
1•bitforger•30m ago•0 comments