Open-sourcing circuit tracing tools

https://www.anthropic.com/research/open-source-circuit-tracing

149•jlaneve•1d ago

Comments

Eduard•1d ago

thought this was about PCB tracing and was disappointed.

dvh•1d ago

If you only want to trace veroboards (stripboards) and not full blown PCBs I made a browser tool for that: https://github.com/dvhx/stripboard2schematic

Workaccount2•1d ago

By total coincidence I have a project at the prototype stage that I will be building (hopefully starting tonight) on a strip board. Thanks!

buescher•1d ago

You and me both. The reverse engineering tools are out there even if most of the search results are AI slop that recommends common layout tools. If I really needed the work done though I'd just pay one of the overseas services and clean up from there.

AdamH12113•1d ago

Yeah, I actually have a decades-old two-layer board that I need to reproduce and I would love to be able to feed images of it into some sort of tool and have it generate a schematic (or at least a netlist) automatically.

duskwuff•1d ago

It's not automatic, but one way I've seen people reverse-engineer PCBs (and ICs!) is to import scans of the subject in Kicad, then start tracing out the connections on screen.

1wheel•1d ago

It can be! Here's a circuit showing how the model processes "PCB tracing stands for" to output "printed":

https://www.neuronpedia.org/gemma-2-2b/graph?slug=pcb-tracin...

tacker2000•1d ago

haha same here

forgotpwagain•1d ago

thought this was about tracing neural circuits in the brain and was disappointed.

Henchman21•1d ago

Same here! Then I immediately thought: I wish people would stop misusing words followed by I guess I think I’m in charge of words now. Then, idly: I’m starting to resemble that “Old Man Yells at Cloud” meme

Funny things, thoughts.

asadm•1d ago

ugh same here.

mrheosuper•1d ago

Same. Those AI bros keep stealing our terminology.

Archit3ch•16h ago

I was excited for a moment.

Tostino•1d ago

This type of stuff is really important in my opinion. Getting this type of stuff open sourced allows academics and other researchers to try and do this type of interpretability research on a more level playing field.

I think the more people looking at this the better. I have a feeling there will be some breakthroughs in identifying important circuits and being able to make more efficient model architectures that are bootstrapped from some identified primitives.

sanex•1d ago

The conversation about this on Dwarkesh was interesting and I'm glad we're getting access to the tool.

https://open.spotify.com/episode/3H46XEWBlUeTY1c1mHolqh?si=L...

rob-olmos•1d ago

Anthropic employees Sholto Douglas & Trenton Bricken did an interview recently with Dwarkesh Patel, pieces here and there was about the circuit tracing insights.

https://www.dwarkesh.com/p/sholto-trenton-2 -- search the transcript for "circuit" for the quick bits.

Eg, "If you look at the circuit, you can see that it's not actually doing any of the math, it's paying attention to that you think the answer's four and then it's reasoning backwards about how it can manipulate the intermediate computation to give you an answer of four."

https://transformer-circuits.pub/

ofou•1d ago

Is this Garcon [1], or a new tool?

[1]: https://transformer-circuits.pub/2021/garcon/index.html

e_ameisen•1d ago

Hi, paper author here.

This is a new tool which relies on existing introspection libraries like TransformerLens (which is similar in spirit to Garcon) to build an attribution graph. This graph displays intermediate computational steps the model took to sample a token.

For more details on the method, see this paper: https://transformer-circuits.pub/2025/attribution-graphs/met....

For examples of using it to study Gemma 2, check out the linked notebooks: https://github.com/safety-research/circuit-tracer/blob/main/...)

We also document some findings on Claude 3.5 Haiku here: https://transformer-circuits.pub/2025/attribution-graphs/bio...)

jexp•1d ago

Imported the graph json into Neo4j

Have fun

https://gist.github.com/jexp/8d991d1e543c5a576a3f1ee70132ce7...

qtwhat•1d ago

Curious if we say "thank you", the model will be more activated and result in better answer. ^^

Photos taken inside musical instruments

Valkey Turns One: Community fork of Redis

Surprisingly fast AI-generated kernels we didn't mean to publish yet

Mary Meeker's first Trends report since 2019, focused on AI

Reverse engineering of Linear's sync engine

Beating Google's kernelCTF PoW using AVX512

Show HN: MCP Defender – OSS AI Firewall for Protecting MCP in Cursor/Claude etc.

The ‘white-collar bloodbath’ is all part of the AI hype machine

Show HN: Icepi Zero – The FPGA Raspberry Pi Zero Equivalent

How large should your sample size be?

Microsandbox: Virtual Machines that feel and perform like containers

Revenge of the Chickenized Reverse-Centaurs

Systems Correctness Practices at Amazon Web Services

Java Virtual Threads Ate My Memory: A Web Crawler's Tale of Speed vs. Memory

Ray Tracing in J

Every 5x5 Nonogram

Silicon Valley finally has a big electronics retailer again: Micro Center opens

Anthropic launches a voice mode for Claude

The Darwin Gödel Machine: AI that improves itself by rewriting its own code

How to run cron jobs in Postgres without extra infrastructure

Jerry Lewis's “The Day the Clown Cried” discovered in Sweden after 53 years

Show HN: Smart Silence – Remind your iPhone to stay quiet in quiet places

StackAI (YC W23) Is Looking for SWR and Tailwind Wizards

Adam Riess and the Hubble tension

Copy Excel to Markdown Table (and vice versa)

De Bruijn notation, and why it's useful

Show HN: Leap – Full-stack AI developer agent that deploys to AWS

A Smiling Public Man

Show HN: W++ – A Python-style scripting language for .NET with NuGet support

Radio Astronomy Software Defined Radio (Rasdr)