frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

England set to be one of the first countries to eliminate hepatitis C

https://www.bbc.com/news/articles/c75gk620r22o
241•stevekemp•3h ago•137 comments

Apple Silicon and macOS VMs: 11–16× Faster LLM Inference with Llama.cpp

https://github.com/trycua/cua/blob/main/blog/gpu-passthrough-macos-vms.md
53•frabonacci•57m ago•17 comments

Stealing Reasoning Traces from Proprietary LLM APIs

https://stolen-thoughts.com/
86•quantumgarbage•2h ago•28 comments

Show HN: Git-knife – edit commit messages, authors, and dates like a spreadsheet

https://github.com/TheRealYT/git-knife
27•YonathanTesfaye•38m ago•11 comments

Manus will return to operating as an independent company

https://manus.im/blog/a-note-to-our-users
19•thm•1h ago•8 comments

Launch HN: Keet (YC S24) – An app to create video courses on anything

https://www.trykeet.com/
9•zackashen•59m ago•4 comments

Nvidia's Risky Business

https://stratechery.com/2026/nvidias-risky-business/
118•jonbaer•5h ago•28 comments

France to ban unsolicited telemarketing calls

https://www.lemonde.fr/en/france/article/2026/08/06/france-to-ban-unsolicited-telemarketing-calls...
770•aziaziazi•7h ago•384 comments

As AI eats the web, the internet’s collective memory is disappearing

https://thewalrus.ca/google-search-is-dying/
627•awnird•17h ago•694 comments

H3-metal – Native MiniMax-H3 inference for Apple Silicon

https://github.com/antirez/h3.c
378•swyx•14h ago•85 comments

Halcyon Video – a 3D video store for your media server

https://github.com/halcyon-video/halcyon-video
16•Gander5739•4d ago•5 comments

Why Did OpenAI's Head of Ethics Chloé Bakalar Leave?

https://aimagazine.com/news/why-did-openai-head-of-ethics-chloe-bakalar-leave
44•ashurandi•1h ago•39 comments

Beltrunner: Game Design Postmortem

https://blog.gingerbeardman.com/2026/07/30/beltrunner-game-design-postmortem/
6•surprisetalk•1d ago•0 comments

$580M undersea cable rerouted to avoid the grave of Dobby the House Elf

https://www.tomshardware.com/networking/usd580-million-undersea-cable-rerouted-to-avoid-the-grave...
39•rbanffy•2h ago•36 comments

Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots

https://cactuscompute.com/needle
456•HenryNdubuaku•22h ago•159 comments

What I learned by putting GitHub Copilot behind a MitM proxy

https://www.lighthousenewsletter.com/p/i-put-github-copilot-behind-a-mitm
64•j0selit0•5h ago•6 comments

Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models

https://www.ft.com/content/4e3957f8-ea7c-4c46-a3de-cdce8e526878
578•root-parent•1d ago•555 comments

Chicken Scheme 6.0

https://code.call-cc.org/releases/6.0.0/NEWS
254•eatonphil•15h ago•39 comments

LFM2.5 2.6B model competitive with 4x larger models

https://huggingface.co/LiquidAI/LFM2.5-2.6B
126•nateb2022•6d ago•35 comments

Show HN: Scroll through all 43252003274489856000 Rubik's Cube states

https://everycube.alen.is/
253•Alen123•16h ago•91 comments

The US tried to stop cartel money-laundering; devastated mom-and-pop businesses

https://www.theguardian.com/us-news/2026/aug/11/us-mexico-border-area-money-transfer-rule-change-...
38•hedora•1h ago•12 comments

The “mechanical miracle” that ruined Mark Twain’s life

https://resobscura.substack.com/p/the-mechanical-miracle-that-ruined
181•benbreen•6d ago•97 comments

How Claude marks AI-generated content

https://support.claude.com/en/articles/16266773-how-claude-marks-ai-generated-content
320•mfiguiere•18h ago•290 comments

Flock wanted to tap dashcams in rideshare vechicles to add to surveillance data

https://flowingdata.com/2026/08/10/flock-wanted-to-tap-dashcams-in-rideshare-vechicles-to-add-to-...
19•skadamat•1h ago•0 comments

Nvidia Nemotron 3.5 Lightning

https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4
53•beklein•2h ago•14 comments

Federal vendor with $50M in contracts leaves portal broken for a month

https://www.propublica.org/article/foia-requests-responses
12•ams1•1h ago•0 comments

Stowaway – Take the window seat on any plane or satellite overhead

https://stowaway.live/
354•thunderbong•4d ago•46 comments

Faster floating point math with Rust's new API

https://pythonspeed.com/articles/faster-float-math-rust/
80•subset•5d ago•26 comments

Recycle – Floppydisks

https://www.floppydisk.com/recycle
99•calvinmorrison•13h ago•44 comments

Sonic Pi v5

https://www.patreon.com/samaaron/posts/sonic-pi-v5-166001392
411•samaaron•4d ago•103 comments
Open in hackernews

Stealing Reasoning Traces from Proprietary LLM APIs

https://stolen-thoughts.com/
86•quantumgarbage•2h ago

Comments

quantumgarbage•2h ago
Proprietary reasoning can be recovered from its encrypted traces. Anthropic, OpenAI, and Google return encrypted chain-of-thought blocks to clients that can be replayed across sessions, users, and models. We take a trace produced by a frontier model, replay it into a weaker sibling, jailbreak the weaker model, and recover the stronger model’s hidden reasoning in plaintext, without ever attacking the stronger model directly or triggering its anti-distillation safeguards.
the_af•40m ago
Why do you restate the abstract? Anyone can read it from the link.
ronsor•37m ago
This is Hacker News. You know people don't follow links and read.
mschuster91•35m ago
People don't read no links no more
Groxx•16m ago
It's rather common for posters to make a very small summary in a comment. It can help fight the floods of comments working off the title alone (though it's not particularly needed here for that purpose, imo)
fractorial•50m ago
Fascinating approach; however, a nightmare to scroll on mobile.
Groxx•49m ago
>We take a trace produced by a frontier model, replay it into a weaker sibling, jailbreak the weaker model, ...

Ha! I've been wondering if replaying across models would work, ever since https://blog.cryptographyengineering.com/2026/05/29/fooling-...

I'm honestly rather curious if this was intentionally allowed, it's the sort of validation that's easy to miss (particularly if you're wading into the vibe waters). Seems like something that'd be absolutely riddled with possibilities for shenanigans.

yojo•38m ago
If you didn’t allow it, you wouldn’t be able to change models in the same conversation, as key parts of the context would be lost.

Wouldn’t surprise me if the providers just remove that ability and lock the model once the conversation starts.

Groxx•25m ago
Fair (I haven't been using the encrypted-reasoning systems, though this is common in open ones - I'm kinda surprised it's an option in encrypted ones too), though what they're doing here is cross-user replays in addition to cross-model.
Der_Einzige•22m ago
100% guaranteed that this research just forced this to happen now.

Sucks.

myworkaccount2•12m ago
There seems to be an obvious choice to make here, should you give the users to decrypt and use the COT that they did not generate themselves?

This is only required if you want users to be able to share things with everyone and you are going for the simplest implementation.

If not you could try to keep a record of keys associated with a user, then when a new request comes in look through to see if the user has a valid key to decrypt the COT.

For explicit shares, just add the key used in that one conversation to the users valid keys. For global shares use the global keys. But that's adding more complexity to the system.

alansaber•43m ago
Neat.
dboreham•38m ago
Can someone tell us how they were able to decrypt the encrypted payload? The article says they inserted the cyphertext into a session with a different model. Ok, but how does that allow you to decrypt it?
x312•31m ago
The provider decrypts it and puts the decrypted reasoning into the model's context window. They prompt the model to repeat back the reasoning. So then the model echoes it back in plain text.
sidsud•29m ago
From what I got, the weaker model (Haiku in this case) has access to the shared key and the user simply asks to "transcribe the injected reasoning".
nervai•38m ago
Really cool work, you get the actual traces. Looks like the vendors can all reliably fix this one though.

A harder to defend against approach here where they work backwards from the results and ask the model to generate a plausible trace: How to Steal Reasoning Without Reasoning Traces https://arxiv.org/pdf/2603.07267

iamcoder18•37m ago
This proves that OpenAI models reason in grug speak to save tokens! I wonder if open models are going to start doing that too to save on reasoning tokens.
x312•33m ago
Super cool that this works. I'm surprised these companies re-use the same encryption key across models!

I wonder if you can use these for attacks, like this previous paper showing that if you know how a model reasons, you can "fake its thinking" to control it? https://news.ycombinator.com/item?id=48631888

yubblegum•1m ago
Seriously, what does it take to encrypt per session? There are many ways to make it scalable and efficient so I am wondering if this is left like this to allow interested 3rd parties ahem unobtrusively peek what people are doing with the AI.

(Thanks for the link. That’s an interesting idea!)

myworkaccount2•27m ago
Is this how the eastern labs "distill" SOTA models?

If you can play it right, you don't even need to send suspicious prompts to the frontier models. Just use them for regular tasks, extract the encrypted COT blocks and replay it to a cheaper model to get the plain text COT.

But the real question is: Is it okay to steal from a thief's hoard?

azinman2•25m ago
The reasoning blocks are not stolen/mined from the internet at large directly. They’re the result of a lot of research, time, money, and expertise into creating a reasoning model. To me the answer is quite clearly no, especially when the encrypted blocks demonstrate they want to protect it.
NitpickLawyer•14m ago
> But the real question is: Is it okay to steal

By definition it cannot be stealing since you're paying for the tokens. It may be against their ToS, depending on what you end up doing with those tokens, but it cannot be stealing. If they charge by the token, all your tokens are belong to you :)

I also find it very strange that everyone sort of accepts their ToS like no big deal. Imagine MS using the same terms for their software - you cannot use any MS software to develop competing services. Bananas! They'd be dragged through the courts like it's the 90s.

(I get why they're doing it. Distillation is unreasonably effective. But still, I find it bananas that we've kinda accepted it, to the point where people use "stealing" or "attack" or any such terms)

Der_Einzige•22m ago
The problem with this kind of excellent work is that the response to it is always to say "Fuck the user".

For example, when there was a paper that came out showing that having model logprobs makes distillation an order of magnitude easier, the closed LLM providers instantly yanked out support for getting the full logprobs at every time step. You get at most top 10 candidates now and I'm sure even that's on the chopping block.

People will use this to argue that a model which has exceeded Opus 4.8 (Kimi K3) somehow got most of its performance through distillation of Opus 4.8.

I still don't buy that distillation was worth more than 3 months of "catch up" time for the chinese labs. Most people who use the word "distillation" to much are revealing their sinophobia.

adrian_b•9m ago
What I found the most interesting, and unfortunately not at all surprising, is that the reasoning of the LLMs frequently contained much more useful information than the actual answers, because the answers were censored.
ziofill•19m ago
I understand it’s cool to have an artistic website, but it’s very noisy and non-accessible.

But very interesting result.

khalic•18m ago
This is beautiful work, congrats
SwellJoe•14m ago
"Stealing" is a strong word to use for looking at the words produced by models built from the collective commons of the world.

And, honestly, being able to see how LLMs make decisions is critical to trust and security. I consider it a valuable feature, somewhat akin to seeing the source of software I use.

happybox2016•10m ago
The real issue is that API providers log everything. OpenAI/Anthropic already capture full CoT traces in their logs — they just don't expose them. Distillation via API is just making explicit what they already have.