frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•2mo ago

Comments

zljdanceholic•2mo ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!

Awesome Fresh Developer Tools

https://github.com/devtoolsd/awesome-devtools
3•dariubs•4m ago•1 comments

Hertz and Other Rental Car Agencies Turn to AI for Damage Detection

https://www.nytimes.com/2025/07/09/travel/rental-car-ai-scanner-hertz.html
2•perihelions•4m ago•0 comments

Woman takes 10x dose of turmeric, gets hospitalized for liver damage

https://arstechnica.com/health/2025/07/woman-takes-10x-dose-of-turmeric-gets-hospitalized-for-liver-damage/
2•burnt-resistor•9m ago•1 comments

One Company Poisoned the Planet

https://www.youtube.com/watch?v=SC2eSujzrUY
1•doener•12m ago•0 comments

Croissant: Building a No-Framework Web App

https://dbushell.com/2025/07/11/croissant-no-framework-web-app/
1•ingve•16m ago•0 comments

A Stroke of Genius: Striving for Greatness in All You Do by R.W. Hamming

https://www.cs.utexas.edu/~dahlin/bookshelf/hamming.html
2•luskira•17m ago•0 comments

Slack's 57MB 404 page

https://a.slack.com/archives/b/c
2•lecarore•18m ago•0 comments

A Mind Is Born: 256 byte Commodore 64 demo

https://linusakesson.net/scene/a-mind-is-born/
1•fanf2•18m ago•0 comments

Navigating AI in translation: Why human expertise still matters

https://www.gulf-times.com/article/707217/opinion/navigating-ai-in-translation-why-human-expertise-still-matters
1•Bluestein•19m ago•0 comments

Show HN: CD Calculator – A tool to calculate bank CD interest returns

https://cd-calculator.net/
2•lur0913•20m ago•0 comments

Exploiting Public App_key Leaks to Achieve RCE in Laravel Applications

https://blog.gitguardian.com/exploiting-public-app_key-leaks/
1•guedou•21m ago•0 comments

Kimi-Dev-72B

https://huggingface.co/moonshotai/Kimi-Dev-72B
1•tosh•22m ago•0 comments

A Practical Guide to Evaluating Large Language Models (LLM)

https://medium.com/@thomas.zilliox/a-practical-guide-to-evaluating-large-language-models-llm-4882fb22892f
1•handfuloflight•22m ago•0 comments

SEO, Logorrhoea and the Rise of Sick AI

https://purpleorca.co.uk/seo-logorrhoea-the-rise-of-sick-ai-a-cautionary-tale-for-content-strategists/
1•jruohonen•26m ago•0 comments

Google strikes deal to buy fusion power from MIT spinoff Commonwealth Fusion Sys

https://www.reuters.com/sustainability/climate-energy/google-strikes-deal-buy-fusion-power-mit-spinoff-commonwealth-2025-06-30/
1•mpweiher•27m ago•0 comments

Claude Code/Cursor is using grep? Are we devolving

3•redskyluan•27m ago•2 comments

Guess a random number between 1 and 50

1•Aldipower•28m ago•0 comments

Defold editor scripting adds scene editing in 1.10.4

https://defold.com/2025/07/11/editor-scripting-update/
3•vlaaad•28m ago•1 comments

Show HN: I made a simple iOS app to track and count my habits

https://apps.apple.com/il/app/clicker-counter-simple-tally/id6747491747
2•yoav_sbg•30m ago•0 comments

7GUIs in Mint

https://mint-lang.com/posts/7GUIs
1•gdotdesign•31m ago•0 comments

Self-imposed ban – a lightweight bash script to block commands

https://github.com/alex-moon/ban
1•alex-moon•32m ago•0 comments

What happened to XProtect this week?

https://eclecticlight.co/2025/07/11/what-happened-to-xprotect-this-week/
1•GavinAnderegg•32m ago•0 comments

Engineers develop fire extinguisher that puts out fire with sound (2023)

https://inspenet.com/en/noticias/engineers-develop-fire-extinguisher-that-puts-out-fire-with-sound/
2•thunderbong•38m ago•0 comments

Screen recording of working with Cursor [video]

https://www.youtube.com/watch?v=BTC_a_GoUzo
2•jstanley•50m ago•1 comments

Show HN: AI Movie Finder – I created a way to find movies by describing

https://www.aimoviefinder.com
1•mosbyllc•51m ago•0 comments

Wrapping Go errors with caller info

https://dizzy.zone/2025/07/10/Wrapping-Go-errors-with-caller-info/
2•ingve•55m ago•0 comments

Crates.io: Development Update

https://blog.rust-lang.org/2025/07/11/crates-io-development-update-2025-07/
3•HieronymusBosch•57m ago•0 comments

The Bitter Lesson (2025)

https://www.artfintel.com/p/the-bitter-lesson
1•Michelangelo11•1h ago•0 comments

Why Is Fertility So Low in High Income Countries? (NBER)

https://www.nber.org/papers/w33989
21•jmsflknr•1h ago•33 comments

Secure Your Keys with Keyand.me

https://thasso.xyz/key-and-me.html
1•thasso•1h ago•0 comments