frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•1y ago

Comments

zljdanceholic•1y ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!

Benchmarking OSS inference vendors on cost/latency

https://github.com/powerset-co/inference-bench
1•patrickdevivo•30s ago•0 comments

Silicon Valley leaders back call for Jensen Huang's return to Nvidia

https://www.reuters.com/legal/transactional/silicon-valley-leaders-back-call-jensen-huangs-return...
1•geox•1m ago•0 comments

Starship will use the Henry Hub to access energy 10x cheaper than Jet Fuel

https://selenianboondocks.com/2026/05/how-starship-will-use-the-henry-hub-to-access-energy-10x-ch...
1•mpweiher•2m ago•0 comments

Show HN: LaunchStack CLI – Drift-safe scaffolding CLI for TypeScript back ends

https://github.com/wbizmo/launchstack-cli
1•wbizmo•3m ago•0 comments

CI was becoming a mess, so I fixed it by sharding and selective testing

https://www.palanikannan.com/blogs/ci-was-becoming-a-mess
3•rohanucla•3m ago•0 comments

What if Linux is the digital body? (An alternative AGI hypothesis)

https://figshare.com/articles/preprint/_p_dir_ltr_The_Linux-Based_Cognitive_System_Hypothesis_A_C...
1•kisnorbert•3m ago•0 comments

Nvidia backed 40 startups in three months. It led none of them

https://justraised.io/blog/nvidia-does-not-lead-startup-rounds
1•jrbayguade•4m ago•0 comments

The agentic Christmas gift: a family tree

https://waldo.vanderlore.de/blog/find-the-people-you-come-from/
1•waldov•4m ago•0 comments

Redpanda just archived their repo: what's next?

1•legothief•4m ago•0 comments

My nail biting has been cured –. By manicure?

https://devz.cl/posts/my-nail-biting-has-been-cured-by-manicure/
1•DanielVZ•5m ago•0 comments

Caption.me AI Arena – How Funny Are LLMs?

https://www.caption.me/ai-arena
1•cbeach•6m ago•0 comments

Show HN: InvoiceForge – Zero-dependency JavaScript invoicing library

https://www.codester.com/items/75710/invoiceforge-invoice-generator-js-library
1•SAWANs•7m ago•0 comments

Tencent Hy4 Flash

https://openrouter.ai/tencent/hy4-flash
1•theanonymousone•8m ago•0 comments

AttestLink – Your code/VM has a cryptographic identity

https://github.com/rhodey/AttestLink
1•rhodey•8m ago•0 comments

Obituaries

https://stratechery.com/2026/obituaries/
1•Handy-Man•8m ago•0 comments

Show HN: Mac's Notes, Reminders and Photos never reach Android, so I built them

https://github.com/YashwanthKamireddi/Skykeep
1•yashkamireddi•10m ago•0 comments

The Library of Things Toolkit

https://www.shareable.net/the-library-of-things-toolkit-a-comprehensive-resource-to-help-create-t...
1•surprisetalk•12m ago•0 comments

Benchmarking PDF-to-Markdown Tables (Docling, PyMuPDF, MarkItDown, and More)

https://github.com/switchfile/pdf-table-bench
1•florain•13m ago•0 comments

A 512 KiB binary message teaching chess without a shared language

https://artemlegotin.com/golden-board/
1•legotin•13m ago•0 comments

An Open Letter to Apple: Enough Is Enough

https://rhyn0bytes.bearblog.dev/to-apple-enough-is-enough/
2•speckx•13m ago•0 comments

Cartoons on an AI PMs' shifting choices in a low-attention post-AGI era

https://boskykode.com/blog/low-attention-post-agi-world-contrarian-product-perspectives
1•bosky101•14m ago•0 comments

I Am Agent Garrett, and I Am Watching the End of Hacking Happen in Real Time

https://garrettstimpson.ca/posts/2026/11/16/sentinels-and-the-end-of-hacking/
1•gary23w•15m ago•0 comments

Where Are Our 10× Engineers? The Math of AI-Assisted Coding [video]

https://www.youtube.com/watch?v=go_Fjw_51W4
2•navaro1•16m ago•0 comments

Jensen Huang allies build a "war room" to get him back at Nvidia

https://arstechnica.com/ai/2026/11/jensen-huang-allies-build-a-war-room-to-get-him-back-at-nvidia/
2•daretograsp•17m ago•0 comments

Show HN: BootForm, an MCP-first form back end that works before you sign up

https://bootform.com/
1•melenaos•17m ago•0 comments

Plzdontkillus – experimental creator bootcamp about AI doom

https://plzdontkillus.com/
1•chippy•17m ago•0 comments

U.S. Moves to Close A.I. Chip Loophole Ahead of China Trip

https://www.nytimes.com/2026/11/16/us/politics/trump-china-ai-chip-loophole.html
2•jbegley•17m ago•0 comments

From 'The Pragmatic Programmer' to 'Simplicity'

https://yedhu.me/posts/from-the-pragmatic-programmer-to-simplicity/
2•yedhukrishnan•19m ago•0 comments

I've quit social media with zero willpower

https://adam.ci/train/quit-social-media/
3•adamci•19m ago•0 comments

Show HN: VioLens– Open-source HTTPS debugging proxy, Fiddler Classic alternative

https://github.com/MarkSPowell/VioLens
1•MSP_Logic•20m ago•0 comments