Open-sourcing circuit tracing tools

https://www.anthropic.com/research/open-source-circuit-tracing

161•jlaneve•8mo ago

Comments

Eduard•8mo ago

thought this was about PCB tracing and was disappointed.

dvh•8mo ago

If you only want to trace veroboards (stripboards) and not full blown PCBs I made a browser tool for that: https://github.com/dvhx/stripboard2schematic

Workaccount2•8mo ago

By total coincidence I have a project at the prototype stage that I will be building (hopefully starting tonight) on a strip board. Thanks!

buescher•8mo ago

You and me both. The reverse engineering tools are out there even if most of the search results are AI slop that recommends common layout tools. If I really needed the work done though I'd just pay one of the overseas services and clean up from there.

AdamH12113•8mo ago

Yeah, I actually have a decades-old two-layer board that I need to reproduce and I would love to be able to feed images of it into some sort of tool and have it generate a schematic (or at least a netlist) automatically.

duskwuff•8mo ago

It's not automatic, but one way I've seen people reverse-engineer PCBs (and ICs!) is to import scans of the subject in Kicad, then start tracing out the connections on screen.

1wheel•8mo ago

It can be! Here's a circuit showing how the model processes "PCB tracing stands for" to output "printed":

https://www.neuronpedia.org/gemma-2-2b/graph?slug=pcb-tracin...

tacker2000•8mo ago

haha same here

forgotpwagain•8mo ago

thought this was about tracing neural circuits in the brain and was disappointed.

Henchman21•8mo ago

Same here! Then I immediately thought: I wish people would stop misusing words followed by I guess I think I’m in charge of words now. Then, idly: I’m starting to resemble that “Old Man Yells at Cloud” meme

Funny things, thoughts.

asadm•8mo ago

ugh same here.

mrheosuper•8mo ago

Same. Those AI bros keep stealing our terminology.

Archit3ch•8mo ago

I was excited for a moment.

Tostino•8mo ago

This type of stuff is really important in my opinion. Getting this type of stuff open sourced allows academics and other researchers to try and do this type of interpretability research on a more level playing field.

I think the more people looking at this the better. I have a feeling there will be some breakthroughs in identifying important circuits and being able to make more efficient model architectures that are bootstrapped from some identified primitives.

sanex•8mo ago

The conversation about this on Dwarkesh was interesting and I'm glad we're getting access to the tool.

https://open.spotify.com/episode/3H46XEWBlUeTY1c1mHolqh?si=L...

rob-olmos•8mo ago

Anthropic employees Sholto Douglas & Trenton Bricken did an interview recently with Dwarkesh Patel, pieces here and there was about the circuit tracing insights.

https://www.dwarkesh.com/p/sholto-trenton-2 -- search the transcript for "circuit" for the quick bits.

Eg, "If you look at the circuit, you can see that it's not actually doing any of the math, it's paying attention to that you think the answer's four and then it's reasoning backwards about how it can manipulate the intermediate computation to give you an answer of four."

https://transformer-circuits.pub/

ofou•8mo ago

Is this Garcon [1], or a new tool?

[1]: https://transformer-circuits.pub/2021/garcon/index.html

e_ameisen•8mo ago

Hi, paper author here.

This is a new tool which relies on existing introspection libraries like TransformerLens (which is similar in spirit to Garcon) to build an attribution graph. This graph displays intermediate computational steps the model took to sample a token.

For more details on the method, see this paper: https://transformer-circuits.pub/2025/attribution-graphs/met....

For examples of using it to study Gemma 2, check out the linked notebooks: https://github.com/safety-research/circuit-tracer/blob/main/...)

We also document some findings on Claude 3.5 Haiku here: https://transformer-circuits.pub/2025/attribution-graphs/bio...)

jexp•8mo ago

Imported the graph json into Neo4j

Have fun

https://gist.github.com/jexp/8d991d1e543c5a576a3f1ee70132ce7...

qtwhat•8mo ago

Curious if we say "thank you", the model will be more activated and result in better answer. ^^

Tiny C Compiler

The silent death of Good Code

SectorC: A C Compiler in 512 bytes

Speed up responses with fast mode

Brookhaven Lab's RHIC concludes 25-year run with final collisions

The F Word

Software factories and the agentic moment

OpenCiv3: Open-source, cross-platform reimagining of Civilization III

Hoot: Scheme on WebAssembly

Stories from 25 Years of Software Development

FDA intends to take action against non-FDA-approved GLP-1 drugs

First Proof

Al Lowe on model trains, funny deaths and working with Disney

Vocal Guide – belt sing without killing yourself

Show HN: A luma dependent chroma compression algorithm (image compression)

I write games in C (yes, C) (2016)

Start all of your commands with a comma (2009)

Show HN: I saw this cool navigation reveal, so I made a simple HTML+CSS version

Eigen: Building a Workspace

Show HN: Browser based state machine simulator and visualizer

The AI boom is causing shortages everywhere else

Selection rather than prediction

Microsoft account bugs locked me out of Notepad – Are thin clients ruining PCs?

Reinforcement Learning from Human Feedback

Unseen Footage of Atari Battlezone Arcade Cabinet Production

A Fresh Look at IBM 3270 Information Display System

72M Points of Interest

Where did all the starships go?

Coding agents have replaced every framework I used

France's homegrown open source online office suite