frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium

https://github.com/RunanywhereAI/trnrt
1•sanchitmonga22•1m ago•0 comments

Your Embargo-Breaking Blog Post Isn't Security Research. It's Marketing Bullshit

https://www.spacerogue.net/?p=1098
1•apaprocki•4m ago•0 comments

Account Takeover in Phase Two's Keycloak Organizations Extension

https://ferment.fan/blog/keycloak-orgs-account-takeover/
1•fermentfan•4m ago•0 comments

Sometimes three boring statements beats one clever expression

https://allthingssmitty.com/2026/11/16/sometimes-three-boring-statements-beat-one-clever-expression/
1•AllThingsSmitty•4m ago•0 comments

25 Years on eBay

https://82mhz.net/posts/2026/11/25-years-on-ebay/
1•speckx•4m ago•0 comments

Tiny-voca: 4.5M-parameter TTS, 70x real-time on CPU, trained for under $10

https://huggingface.co/n4ze3m/tiny-voca
1•modinfo•5m ago•0 comments

Show HN: Turn any selfie into a 3D head you can stretch like Mario 64

https://itsbenlong.com/floppyface/
1•DJSnackySnack•5m ago•0 comments

"Transparent" Near-to-Eye Displays

https://kguttag.com/2026/08/10/transparent-near-to-eye-displays/
1•PaulHoule•6m ago•0 comments

Thinking Clearly about Software

https://www.seangoedecke.com/thinking-clearly/
1•andai•7m ago•1 comments

Companies change the nature of human work in order to make AI more effective

https://bsky.app/profile/sarahoconnorft.ft.com/post/3n2iw7ribzs2k
1•mooreds•8m ago•0 comments

Outages keep piling up. Or are we just noticing them more?

https://this.weekinsecurity.com/outages-keep-piling-up-or-are-we-just-noticing-them-more/
2•moooooky•9m ago•1 comments

She went to college to become a social worker; she's joined the skilled trades

https://text.npr.org/nx-s1-6012818
1•mooreds•10m ago•0 comments

Phone-Free Schools and Achievement Growth: A Student-Level Analysis

https://cepr.harvard.edu/phone-free-schools
1•mooreds•10m ago•0 comments

Fixed-Point-Oriented Programming: A Concise and Elegant Paradigm

https://arxiv.org/abs/2507.21439
3•mtdewcmu•11m ago•0 comments

Reverse-Engineering Kevin J. Lang's Lost OCaml Code in Apache DataSketches

https://www.tisonkun.io/posts/ai-repair-program/
1•savin-goyal•11m ago•0 comments

NSA Internal Network Down

https://www.reuters.com/technology/highly-classified-us-national-security-communications-network-...
10•nodoodles•11m ago•2 comments

Yumak: Hyperfast, daemonless Git front end that federates over ATProto

https://git.klbr.net/ptr.pet/yumak
1•nerdypepper•11m ago•0 comments

Show HN: Hourari: Meeting cost without exposing salaries

https://www.hourari.com/demo
1•similo•12m ago•0 comments

Kennedy let measles run wild in America

https://www.reuters.com/investigations/how-kennedy-let-measles-run-wild-america-2026-11-17/
3•geox•12m ago•0 comments

Show HN: Doom inside a 39M-parameter neural network

https://huggingface.co/spaces/kulikov0/micro-doom-world
1•kulikov0•12m ago•0 comments

Did the EU accidentally make social media a paradise for populists?

https://marisantons.lv/did-the-eu-accidentally-make-social-media-a-paradise-for-populists/
3•dzedajs•13m ago•0 comments

Asking for help on LinkedIn was a waste of time, so I'll try here

1•bernaforcillo•13m ago•0 comments

Ask HN: How to contribute to an Open Source project

1•mjs06•14m ago•0 comments

The Century of the Maxxer

https://samkriss.substack.com/p/the-century-of-the-maxxer
1•largePanda9•14m ago•0 comments

2026 Christmas Island Red Crab Migration Livestreams

https://christmasislandnationalpark.gov.au/red-crab-migration/2026-red-crab-migration-livestreams/
2•ChrisArchitect•14m ago•1 comments

The Nvidia Bubble

https://www.wheresyoured.at/the-nvidia-bubble/
2•7777777phil•14m ago•0 comments

Show HN: Temper: Declare your system and fails the build when no proof

https://turbolytics.github.io/temper/
2•dm03514•15m ago•0 comments

Ready or Not, Here Comes AI, by Chris Shiflett

https://shiflett.org/blog/2026/ready-or-not-here-comes-ai
1•speckx•16m ago•0 comments

Hudd – self-hosted video meetings, no database, one command

https://hudd.live/
1•aldrichworld•17m ago•0 comments

Show HN: Orbital - Everything (known) in Earth orbit, live in 3D, in the browser

https://jerredcook.github.io/orbital/
1•gifford89•17m ago•0 comments
Open in hackernews

An Enterprise-Level Retrieval-Augmented Generation System

https://comfyai.app/article/llm-applications/enterprise-level-rag-hands-on-practice-II
6•zljdanceholic•1y ago

Comments

zljdanceholic•1y ago
How can we search the wanted key information from 10,000+ pages of PDFs within 2.5 hours? For fact check, how do we implement it so that answers are backed by page-level references, minimizing hallucinations?

RAG-Challenge-2 is a great open-source project by Ilya Rice that ranked 1st at the Enterprise RAG Challenge, which has 4500+ lines of code for implementing a high-performing RAG system. It might seem overwhelming to newcomers who are just beginning to learn this technology. Therefore, to help you get started quickly—and to motivate myself to learn its ins and outs—I’ve created a complete tutorial on this.

We have a complete graph to explain its workflow where multiple tools are used: Docling for parsing PDFs, LangChain for chunking text, faiss for vectorization and similarity searching, and chatgpt for LLMs.

Besides, I also outline the codeflow, demonstrating the running logic involving multiple python files where starters can easily get lost. Different files are colored differently. The purpose of showing this is not letting you memorize all of these file relationships. It works better for you to check the source code yourself and use this as a reference if you find yourself lost in the code.

The original project of Ilya Rice design its RAG system for answering questions of annual reports from companies, so he only designed three types of question response format for that challenge: a name, a number, or a boolean. But to ask questions about technical stuff, we absolutely ask general questions like How does RoPE work? to know about some concepts and the like Therefore, I further modify the system logic to fit this need by customizing an AnswerWithRAGContextExplanationPrompt class and automatically matching the most related chapter and corresponding pages via searching through all faiss databases (only retrieve the top-1) The final performance is demonstrated below (not cherry-picked, only tested once).

- What's the steps to train a nanoGPT from scratch? The answer is:

Training nanoGPT from scratch involves several clearly defined steps. First, set up the environment by installing necessary libraries, using either Anaconda or Google Colab, and then download the dataset (e.g., tinyShakespeare). Next, tokenize the text into numerical representations and split the data into training and validation sets. Define the model architecture including token/positional embeddings, transformer blocks with multi-head self-attention and feed-forward networks, and layer normalization. Configure training hyperparameters and set up an optimizer (such as AdamW). Proceed with a training loop that performs forward passes, computes loss, backpropagates, and updates parameters, while periodically evaluating performance on both training and validation data. Finally, use the trained model to generate new text from a given context.

All code are provided on Colab and the tutorial is referenced here. Hope this helps!