frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

I built a FULLY private AI to keep your data from big tech.

https://chatpdf-server-shtq.onrender.com/
1•jimmyjonny•2h ago

Comments

jimmyjonny•2h ago
This is the most critical post you will make. Hacker News (HN) can crash your server with traffic if you get to the front page, so be ready.

The Golden Rule of HN: Do not "market." Explain how you built it. They care about the architecture, the code, and the hardware—not the "product benefits."

Here is the exact template to use. The Submission Fields

Title:

    Show HN: I built a public web interface that tunnels to my home RTX 3090 for inference
Url:

    [Your Render Link]
Text (The "First Comment"): (You must post this immediately after submitting the link. This is where you win them over.)

Hello HN,

I wanted to run a privacy-focused LLM service without paying for H100s or leaking data to OpenAI, so I built a hybrid architecture.

The Architecture:

    Frontend/Gateway: Hosted on Render. This handles the public traffic, auth, and UI.

    Inference: Hosted under my desk on my personal rig (RTX 3090).

    The Tunnel: The Render server acts as a dumb WebSocket relay. It accepts user prompts, encrypts them, and tunnels them to my local Python worker.

    Processing: My local worker uses Ollama for the LLM (Qwen 2.5 14B/32B) and Playwright for live web scraping/RAG.
The Stack:

    Backend: FastAPI + Python

    Protocol: Secure WebSockets (WSS)

    Inference: Ollama (Local)

    RAG: PyMuPDF (for PDF analysis) + Playwright (for "Deep Research" browsing)
Why I did this: I wanted "Sovereign AI." The cloud server never stores the unencrypted chat logs; it just passes packets. The actual intelligence lives on my hardware. It’s essentially a free way to expose a local LLM to the web for personal use (and for friends).

Rainbow Six Siege hack forces Ubisoft to shut down servers

https://www.notebookcheck.net/Rainbow-Six-Siege-hack-forces-Ubisoft-to-shut-down-servers-after-pl...
1•hellel•26s ago•0 comments

Ask HN: Best Ways to Save on Taxes?

1•silexia•2m ago•0 comments

Methanol biotransformation for production of plastic monomer L-lactate in yeast

https://www.nature.com/articles/s41467-025-65793-x
1•PaulHoule•3m ago•0 comments

Interesting things I found this year

https://www.karlsnotes.com/interesting-things-i-found-this-year/
1•valkrieco•4m ago•0 comments

A lifetime of ad-free documentaries without a recurring bill in this deal

https://www.bleepingcomputer.com/offer/deals/a-lifetime-of-ad-free-documentaries-without-a-recurr...
2•WaitWaitWha•4m ago•1 comments

Calculus for the Modern Engineer

https://github.com/michiganrobotics/rob201
1•ArmageddonIt•5m ago•0 comments

The mongo db situation is crazy [video]

https://www.youtube.com/watch?v=9Wg6tiaar9M
1•kburman•5m ago•0 comments

The Ascendance of Algorithmic Tyranny

https://www.noemamag.com/the-ascendance-of-algorithmic-tyranny/
3•nanmu42•6m ago•0 comments

All my Deutschlandtickets gone: Fraud at an industrial scale [video]

https://media.ccc.de/v/39c3-all-my-deutschlandtickets-gone-fraud-at-an-industrial-scale
1•Kyro38•8m ago•0 comments

Your brain doesn't suddenly 'fully develop' at 25 – what the neuroscience shows

https://theconversation.com/no-your-brain-doesnt-suddenly-fully-develop-at-25-heres-what-the-neur...
2•bikenaga•9m ago•0 comments

Global Memory Shortage Crisis: Market Analysis

https://www.idc.com/resource-center/blog/global-memory-shortage-crisis-market-analysis-and-the-po...
1•naves•11m ago•0 comments

The Industrial Age Roots of General Education

https://psu.pb.unizin.org/generaleducationfortheinformationsociety/chapter/the-industrial-age-roo...
2•teleforce•11m ago•0 comments

He Was a Supreme Court Lawyer. Then His Double Life Caught Up with Him

https://www.nytimes.com/2025/12/28/magazine/thomas-goldstein-supreme-court-gambling.html
2•hodgesrm•11m ago•1 comments

Don't Drag-N-Drop, Let AI Write Workflow Code

https://www.youtube.com/watch?v=zzkSC26fPPE
1•Edmond•14m ago•0 comments

IWD Development Hiatus

https://www.phoronix.com/news/Intel-IWD-Development-Halts
1•khimaros•14m ago•0 comments

Show HN: Niceform – a simple Typeform alternative with flat pricing

https://www.niceform.io/en
1•officialvikram•14m ago•0 comments

Ask HN: Resources and Tips for learning to play harmonica

1•tizzyapunkt•17m ago•0 comments

Show HN: Promode for Claude Code

https://github.com/mikekelly/promode
1•AffableSpatula•17m ago•0 comments

Show HN: Nederland Postcode API – validate Dutch addresses

https://nederlandpostcode.nl
1•tjardo•17m ago•0 comments

I Used AI to Prove the Riemann Hypothesis. Roast Me Like You Roasted Budden

https://www.academia.edu/145618833/The_Riemann_Hypothesis_via_Toroidal_Geometry_Caustic_Singulari...
1•kristintynski•19m ago•3 comments

Firefox's low-latency WebAssembly compiler

http://wingolog.org/archives/2020/03/25/firefoxs-low-latency-webassembly-compiler
1•fanf2•20m ago•0 comments

Ask HN: What are you building during the holiday break?

1•linsomniac•22m ago•1 comments

The Mathematics of Tuning Systems

https://johncarlosbaez.wordpress.com/2025/12/26/the-mathematics-of-tuning-systems/
3•chmaynard•22m ago•0 comments

Ask HN: Will AI-based 4K restoration of old content put Tubi TV out of business?

1•amichail•24m ago•0 comments

Local LLMs are how nerds now justify a big computer they don't need

https://world.hey.com/dhh/local-llms-are-how-nerds-now-justify-a-big-computer-they-don-t-need-af2...
3•janandonly•29m ago•2 comments

I removed 80% of my JavaScript and my product got better

https://clipnotebook.com/blog/removed-80-percent-javascript
5•puildupO•31m ago•3 comments

Show HN: Sapphire – A 12MB language with native UI and good performance

https://github.com/foxzyt/Sapphire
2•foxz•31m ago•0 comments

To Understand AI, Watch How It Evolves

https://www.quantamagazine.org/to-understand-ai-watch-how-it-evolves-20250924/
3•Brajeshwar•32m ago•1 comments

Michael Burry Bets He Isn't Too Early to Go Against the AI Juggernaut

https://www.wsj.com/finance/stocks/michael-burry-bets-he-isnt-too-early-to-go-against-the-ai-jugg...
3•megacorp•35m ago•1 comments

Show HN: Compare what your current rent gets you in other cities

https://rentcheckr.app/
1•Atallapr•37m ago•0 comments