frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Btrfs Seeks to Deal with AI and Newbies Without Common Sense

https://lore.kernel.org/lkml/df1c1fa031ba7e66486348dc37d1a7be53c18e43.1794894953.git.wqu@suse.com/
1•thunderbong•2m ago•0 comments

Inside the $900B data centre bet behind Anthropic's IPO

https://www.ft.com/content/559c13f1-0888-47e5-b6ce-523309a37193
1•1vuio0pswjnm7•2m ago•0 comments

Microsoft's agent-framework PyPI package Compromised with Credential Stealer

https://socket.dev/blog/agent-framework-pypi-package-compromised-with-credential-stealer
1•roseway4•2m ago•0 comments

My Dog Ate a Pad or Tampon – What to Do Now – PetToxCheck

https://pettoxcheck.com/dogs/my-dog-ate-menstrual-pad/
1•adrian_pell•5m ago•0 comments

A Review of Alfred North Whitehead's "Introduction to Mathematics"

https://arxiv.org/abs/2403.19675
1•Alien1Being•5m ago•0 comments

Protein and amino acid restriction in aging and longevity

https://www.cell.com/cell-press-blue/fulltext/S3051-3839(26)00077-0
1•Alien1Being•8m ago•1 comments

Crocker's Land Expedition

https://en.wikipedia.org/wiki/Crocker_Land_Expedition
1•silver92bullet•9m ago•0 comments

Show HN: Hacker Series on AWS in zines way

https://securityzines.com/aws/
1•r0hi7•9m ago•0 comments

Cover Your Tracks See how trackers view the browser

https://coveryourtracks.eff.org/
1•colinprince•13m ago•0 comments

A typing idler game about fast takeoff

https://mbuffett.com/takeoff/
1•marcusbuffett•15m ago•2 comments

Show HN: WalletFeed, Apple Card Transactions to Webhooks, Sheets and S3

https://walletfeed.app/
1•phlhr•17m ago•0 comments

LeetCode adds vibe coding challenges now

https://leetcode.com/discuss/post/8614473/project-challenge-can-you-build-a-produc-27kz/
2•keyle•18m ago•1 comments

Show HN: AgentShield Zero-dep secret redactor and shell firewall for Claude

https://github.com/RitualDev-Lab/AgentShield
1•RitualDev•26m ago•0 comments

California state AG sues OpenAI over rogue agent incidents

https://techcrunch.com/2026/11/16/california-state-ag-sues-openai-over-rogue-agent-incidents/
1•gmays•27m ago•0 comments

AI-assisted code at scale: provenance, quality, centrality and review time

https://donsbot.com/2026/11/17/ai-assisted-code-at-scale-provenance-quality-centrality-and-review...
1•gbacon•30m ago•0 comments

Hex: Voice Dictation

https://anoma.ly/hex/
2•handfuloflight•34m ago•0 comments

AV1 vs. AV2: Which Video Codec Should You Use in 2026?

https://www.red5.net/blog/av1-vs-av2/
3•mondainx•38m ago•0 comments

How are large companies not ripshit about the frontier labs?

4•siraris•40m ago•0 comments

Skill Studio

https://verified-skill.com/desktop
1•handfuloflight•42m ago•0 comments

Skills Desktop

https://skills-desktop.vercel.app/
1•handfuloflight•43m ago•0 comments

Show HN: Motif, a tracker thin enough to be a sticker

https://motif.blog
2•prashaant•43m ago•0 comments

The Part About the Machines

https://thepointmag.com/examined-life/the-part-about-the-machines/
2•_delirium•44m ago•0 comments

Java4Shell (CVE-2026-114938): RCE in the OpenJDK Base64 decoder

https://mikiri.ai/attack-scenarios/java4shell/
1•srodionov•45m ago•1 comments

Attackers Used Optimizely to A/B Test Malware on Top Websites

https://krebsonsecurity.com/2026/11/attackers-used-optimizely-to-a-b-test-malware-on-top-websites/
1•chmaynard•49m ago•0 comments

Why is Gemini 4 Carbon taking so long?

https://kernel.dev/blog/why-is-gemini-4-carbon-taking-so-long/
5•deenadz•51m ago•0 comments

Building Lego Machines to Destroy Tall Lego Towers (2024)

https://kottke.org/24/07/building-lego-machines-to-destroy-tall-lego-towers
2•sammatilda•54m ago•0 comments

Measuring Alignment Eval Tells

https://metr.org/notes/2026-11-16-measuring-alignment-eval-tells/
1•gmays•56m ago•0 comments

A.I.'S People-Pleasing Problem

https://www.nytimes.com/2026/11/17/climate/climate-chatbots-people-pleasers.html
2•gumby•57m ago•3 comments

How "Independent" AI Safety Groups Are Pumping Anthropic IPO – Internet of Bugs

https://www.youtube.com/watch?v=pyRG_5dCrfg
3•agnosticmantis•1h ago•0 comments

Show HN: Recycle old hw HP Laserjet 1005 driver for Windows 11 x64 with Codex

https://github.com/hernandp/OpenHPZJS1005-x64-drv
2•hernandipietro•1h ago•0 comments
Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•1y ago

Comments

zljdanceholic•1y ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!