frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Niewz – a native RSS reader for iPhone, iPad and Mac

https://apps.apple.com/us/app/niewz/id6834017988
1•romainrou•4m ago•0 comments

Brad Feld – What Do You Want to Do Tonight?

https://feld.com/archives/2026/11/what-do-you-want-to-do-tonight/
1•rmason•7m ago•1 comments

IPTV USA Subscription – IPTV USA – 50k Channels and 4K Streaming

https://www.nhl.com/goldenknights/news/vegas-jr-golden-knights-announce-teams-tryout-information-...
1•saraapah•12m ago•2 comments

Scientists Are Stumped by This Object in Space

https://www.nytimes.com/2026/11/16/science/1998-ky26-asteroid-comet.html
1•reaperducer•13m ago•0 comments

The Emulation Frontier

https://alexlitzenberger.com/blog/the_emulation_frontier
1•alexlitz•14m ago•0 comments

WSJ: Jensen Huang was a difficult boss

https://www.wsj.com/business/put-downs-parties-and-a-royal-family-the-culture-inside-jensen-huang...
1•onmysofa•19m ago•2 comments

My Father Gave the Internet Declaration of Independence; Time for a Second Draft

https://www.rollingstone.com/culture/culture-commentary/amelia-rose-john-perry-barlow-internet-de...
1•the-mitr•25m ago•0 comments

Show HN: Sip pacer to help you drink slower

https://apps.apple.com/us/app/pour-decision-drink-less/id6499468185
1•OzBuilds•26m ago•0 comments

The WeirdML Benchmark (2025)

https://www.lesswrong.com/posts/LfQCzph7rc2vxpweS/introducing-the-weirdml-benchmark
1•peter_d_sherman•26m ago•1 comments

Everything You Wanted to Know About LLM Post-Training [video]

https://www.youtube.com/watch?v=LVXtFnEbNU0
1•gmays•33m ago•0 comments

Nvidia Announces Rubin HPC

https://blogs.nvidia.com/blog/rubin-hpc/
2•jonbaer•33m ago•0 comments

Show HN: Pulsar – cross-harness agent to agent communication and messaging

https://github.com/yocontra/pulsar
1•contrahax•33m ago•0 comments

Show HN: Find out how cooked your webapp is

https://genclass.dev/scan
1•Karanvir1729•34m ago•0 comments

News from more than one source

https://www.simplenewss.com/
1•jream1991•35m ago•1 comments

Mathematical Modeling Basics [pdf]

https://matmod.ch/lpl/doc/modelbook.pdf
2•the-mitr•36m ago•0 comments

US Data Centers' Carbon Footprint Rivals Small European Countries

https://www.barrons.com/news/us-data-centers-carbon-footprint-rivals-small-european-countries-0c4...
1•melling•38m ago•0 comments

Nvidia's top lawyer agrees to testify before Congress

https://www.politico.com/news/2026/11/16/nvidia-top-lawyer-testify-congress-01168851
2•JumpCrisscross•40m ago•0 comments

123456' has been the most popular password for 7 out of the last 8 years

https://www.theregister.com/security/2026/11/16/123456-has-been-the-worlds-most-popular-password-...
2•madihaa•43m ago•1 comments

Carney says Canada could turn to Chinese automakers if Trump trade talks fail

https://apnews.com/article/canada-carney-trump-china-trade-autos-cbb2d3f90eed95925ffa4cb9a4b25239
5•madihaa•45m ago•0 comments

How much does it cost to produce one research paper?

https://blogs.lse.ac.uk/impactofsocialsciences/2026/11/04/how-much-does-it-cost-to-produce-one-re...
1•martincsweiss•45m ago•0 comments

iOS 27.3 Beta Adds Daily Siri AI Limits and iCloud+ Upgrades

https://www.macrumors.com/2026/11/16/apple-icloud-paid-siri-ai-upgrade/
1•soheilpro•49m ago•0 comments

Show HN: Toolbelt – Free developer utilities that run in the browser

https://gettoolbelt.dev/
2•gprakasha234•50m ago•0 comments

Ask HN: Are the more software malfunctions now than before?

3•sirnicolaz•55m ago•0 comments

A Bull Market for Pokémon Cards, Fueled by Pikachu and Nostalgia

https://www.nytimes.com/2026/11/16/us/pokemon-cards-value-investors.html
2•bookofjoe•56m ago•1 comments

US tightens AI chip export controls to stop Chinese labs from remote GPU access

https://techcrunch.com/2026/11/16/us-tightens-ai-chip-export-controls-to-deter-chinese-companies-...
1•mezark•59m ago•0 comments

Show HN: Nine is multiplayer sudoku across all Apple devices

https://apps.apple.com/us/app/nine-sudoku/id6789779314
1•ndgold•59m ago•0 comments

FluxCloud: Decentralized Cloud

https://runonflux.com/fluxcloud/
1•nreece•59m ago•0 comments

How to Build the Future: Paul Graham and Amjad Masad [video]

https://www.youtube.com/watch?v=Q78dJ0vkWe8
1•gmays•1h ago•0 comments

Coles Cybersecurity Incident

https://www.abc.net.au/news/2026-11-16/coles-investigates-cybersecurity-breach-but-little-detail/...
1•incogvito•1h ago•1 comments

Jitpipe–Sample 25 stdin rows,synthesize regex/Awk filter,stream the rest in Rust

https://github.com/abhinavm-web/jitpipe
1•abhinav9131•1h ago•0 comments
Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•1y ago

Comments

zljdanceholic•1y ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!