frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Beyond Red vs. Blue: The Political Typology

https://www.pewresearch.org/politics/2026/06/10/beyond-red-vs-blue-the-political-typology/
1•karakoram•2m ago•0 comments

Installing Arch Linux Without a USB Drive: ChatGPT Broke My Windows

https://medium.com/@louisaeilotd/installing-arch-linux-without-a-usb-drive-db6a7d8227fa
1•aeilot•2m ago•0 comments

UK court confirms existence of government surveillance order against Apple

https://www.computerweekly.com/news/366654729/UK-court-confirms-existence-of-government-surveilla...
1•miohtama•2m ago•0 comments

How to Put a 70B Model on a GPU Diet [video]

https://www.youtube.com/watch?v=T58AjM7IGDg
1•lroe•2m ago•0 comments

Voyager 1's 'light-day' milestone is only the beginning

https://www.scientificamerican.com/article/voyager-1-reaches-one-light-day-milestone/
1•Stratoscope•2m ago•0 comments

Terminator's chip moment for us was reinforcement learning (RL)

1•delopsu•3m ago•0 comments

(offensive) adoption is the bottleneck

https://alexschapiro.com/hack-yourself/
1•bearsyankees•4m ago•0 comments

Science Isn't a Series of Lucky Accidents

https://worksinprogress.co/issue/accidental-discoveries/
1•karakoram•8m ago•0 comments

Richard Feynman and the Math of Menu Choices

https://www.alumni.caltech.edu/techer/stories/richard-feynman-and-the-math-of-menu-choices/
2•karakoram•8m ago•0 comments

Show HN: Zwitch alternative App Switcher for macOS (Free)

https://zwitch.net/
1•frnk-km•8m ago•0 comments

[Chlorophyll Engine] 10M Trees – 15km² Test [video]

https://www.youtube.com/watch?v=VC_NUxbeA0E
1•sheepscreek•9m ago•0 comments

Show HN: ScreenClip – screenshot a bug, your coding agent opens the PR

https://screenclipai.com/
1•lludo•10m ago•1 comments

Automate Mac tasks with Gemini computer use

https://blog.google/innovation-and-ai/products/gemini-app/computer-use-mac/
1•xnx•10m ago•0 comments

US Army will detonate 10k pounds of lead azide

https://abcnews.com/US/iowa-army-plant-lead-azide-detonation/story?id=138261613
1•isnotchicago•11m ago•0 comments

VHS Vault (95 TB)

https://chirpcdn.com/vhsvault.html
1•o_-_o•12m ago•1 comments

Claude Fable 5.2 solves two open problems in the physics of black holes

https://www.anthropic.com/research/claude-black-hole-physics
2•cybermango•12m ago•0 comments

Genie 4 is now available on the Gemini API

https://blog.google/innovation-and-ai/technology/developers-tools/genie-4-in-gemini-api/
1•acossta•12m ago•0 comments

Some thoughts on security after ten years of qmail 1.0 (2007) [pdf]

https://cr.yp.to/qmail/qmailsec-20071101.pdf
1•madars•14m ago•0 comments

‘AI gravity’ is pulling you toward dependency. Here’s how to push back

https://mitsloan.mit.edu/ideas-made-to-matter/ai-gravity-pulling-you-toward-dependency-heres-how-...
1•zzzeek•15m ago•0 comments

Jev, job by job: what it does, what it doesn't, and when to reach for it

https://webuilddatabases.com/blog/jev-job-by-job/
1•Dan_Reynolds•15m ago•0 comments

High-End Furniture Marketplace AptDeco Taking People's Furniture and Not Paying

https://www.404media.co/high-end-furniture-marketplace-aptdeco-is-taking-peoples-furniture-and-no...
4•beardyw•17m ago•0 comments

Pancreatic cancer halted by virus injection in three patients

https://scienceinhand.com/pancreatic-cancer-halted-by-virus-injection-in-three-patients/
2•cybermango•17m ago•0 comments

Do Google engineers vibe code?

https://www.youtube.com/watch?v=PbsocBPkoUc
1•Betelbuddy•18m ago•0 comments

Evaluating Proactive Agents

https://langfuse.com/blog/2026-11-19-evaluating-proactive-agents
1•annabellschaf•18m ago•1 comments

I Cloned Adobe with AI – Brandon Thomas, ArtCraft

https://www.youtube.com/watch?v=UCL4K36SHp0
1•joeavella•18m ago•0 comments

FAA to Phase Out Floppy Disks from Airport Control Towers

https://www.nytimes.com/2026/11/06/us/faa-floppy-disks-atc-2028.html
1•karakoram•19m ago•2 comments

What's New in Alfred 6

https://www.alfredapp.com/whats-new/
2•qainsights•19m ago•0 comments

Can You Regulate 'Fairness'? The EU's Digital Fairness Act Is Going to Try

https://www.techdirt.com/2026/11/18/can-you-regulate-fairness-the-eus-digital-fairness-act-is-goi...
2•hn_acker•19m ago•0 comments

Breaking Down Data Silos in the Physical World

https://bostondynamics.com/blog/breaking-down-data-silos-in-the-physical-world/
1•gmays•20m ago•0 comments

A KytyPS5 issue is distributing malware to users, claiming to be a GTA6 patch

https://github.com/KytyPS5/KytyPS5/issues/2413
1•CharlieItanium•21m ago•0 comments
Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•1y ago

Comments

zljdanceholic•1y ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!