frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Starlink reintroduces SNR and signal quality measurement from LAN side gRPC

https://www.reddit.com/r/StarlinkEngineering/comments/1y1jvqp/getting_starlink_snr/
1•walrus01•1m ago•0 comments

Big Data Is Dead

https://motherduck.com/blog/big-data-is-dead/
1•ghassenfaidi•3m ago•0 comments

The Short Age of Dragon Riders

https://atilloy.com/2026/11/16/the-short-age-of-dragon-riders/
1•libraryofbabel•5m ago•0 comments

The Distillation of Knowledge: When the History of Its Emergence Disappears

https://medium.com/@smoking2man/the-distillation-of-knowledge-when-the-history-of-its-emergence-d...
1•Aldus551•7m ago•0 comments

Pakistan's solar revolution is so successful the national grid is lagging behind

https://www.bbc.com/news/articles/ckvg2n2q3103o
1•wmchen•9m ago•0 comments

Aulico: The Tradingview Alternative

https://www.aulico.com/tradespaces/new
1•lugozziano•9m ago•0 comments

Ride the SQL curve from basics to mastery

https://sqlride.com/
1•michaelsbradley•11m ago•0 comments

I used the 28 Days of Shipping

https://derekrodriguez.dev/how-i-used-the-28-days-of-shipping/
1•dwrodri•11m ago•0 comments

Show HN: trace2rules – Mine and audit coding-agent logs into AGENTS.md rules

https://github.com/rkkautsar/trace2rules
1•rkkautsar•11m ago•1 comments

Show HN: I made an app to show your codebase on a canvas [video]

https://www.youtube.com/watch?v=WNnumyRfUpQ
1•vahidce•13m ago•0 comments

Provide Feedback on SimpleNewss Usability

https://www.simplenewss.com/
1•jream1991•14m ago•0 comments

The Sam Bankman-Fried Interview

https://supercycle.blog/p/the-sam-bankman-fried-interview
1•15o9o•14m ago•0 comments

Windows: Run larger local AI models across PCs

https://techcommunity.microsoft.com/blog/microsoftusbblog/introducing-rdma-over-usb4%c2%ae-on-win...
1•vwadhwani•16m ago•0 comments

Psalm 7.15: full PHP 8.6 support and weak crypto/SQL-aware security analysis

https://psalm.dev/articles/psalm-7-15
1•danogentili•18m ago•0 comments

Inventing Your Own Math as a Computer Programmer

https://leetarxiv.substack.com/p/inventing-your-own-math-as-a-computer-programmer
1•theanonymousone•22m ago•0 comments

Google: 'The era of autonomous attacks has arrived'

https://thehill.com/policy/technology/6224604-autonomous-ai-threats-google-report/
1•theanonymousone•22m ago•0 comments

Fastest Soft Robot Ever Built Doesn't Need Electronics to Function [video]

https://www.youtube.com/watch?v=uNPwgYMA0Js
1•gumby•25m ago•1 comments

Tech Outages Are Only the Beginning. A.I. Will Bring More Disruptions

https://www.nytimes.com/2026/11/21/us/politics/tech-outages-ai-disruptions.html
1•doener•25m ago•0 comments

Conditional Subexponential Attacks on Structured Learning with Errors [pdf]

https://nigelsmart.github.io/Sub-Exp-LWE/main.pdf
1•madars•26m ago•0 comments

The Universal Declaration on AI – The Promethean Covenant

https://tenarticles.org/
2•peterpaulis•28m ago•0 comments

Show HN: CVPebble – Free CV builder that runs in the browser, no account needed

https://cvpebble.com/
1•CVPebble•33m ago•1 comments

Revised Estimates for the Number of Human and Bacteria Cells in the Body

https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1002533
1•gradus_ad•34m ago•0 comments

FBI's criminal information database hacked, CNN reports

https://www.cnbc.com/2026/11/21/fbis-criminal-information-database-hacked-cnn-reports.html
2•shinryudbz•39m ago•1 comments

iTerm2 vulnerability via Kitty Image Protocol

https://ii4gsp.github.io/iterm2-rce/
3•rvz•40m ago•0 comments

The Polarizing Practice of Eating Horses (2013)

https://www.theatlantic.com/health/archive/2013/02/the-polarizing-practice-of-eating-horses/273388/
2•Eridanus2•41m ago•0 comments

Compromise Test

2•kbdev•42m ago•1 comments

Send Files Anywhere – Encrypted P2P file relay with zero disk storage

https://maizor.org/en/send
3•mtananyan•48m ago•0 comments

Varieties of Discourseposting

https://www.astralcodexten.com/p/varieties-of-discourseposting
2•paulpauper•48m ago•0 comments

Gemini 4 Neon solves Bitcoin puzzle from 2024

https://echo.ls/zden-level-halv/
4•maplet•48m ago•0 comments

Notes on Differentiated Social Awareness

https://www.jenn.site/notes-on-differentiated-social-awareness/
2•paulpauper•49m ago•0 comments
Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•1y ago

Comments

zljdanceholic•1y ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!