Open-sourcing circuit tracing tools

https://www.anthropic.com/research/open-source-circuit-tracing

161•jlaneve•8mo ago

Comments

Eduard•8mo ago

thought this was about PCB tracing and was disappointed.

dvh•8mo ago

If you only want to trace veroboards (stripboards) and not full blown PCBs I made a browser tool for that: https://github.com/dvhx/stripboard2schematic

Workaccount2•8mo ago

By total coincidence I have a project at the prototype stage that I will be building (hopefully starting tonight) on a strip board. Thanks!

buescher•8mo ago

You and me both. The reverse engineering tools are out there even if most of the search results are AI slop that recommends common layout tools. If I really needed the work done though I'd just pay one of the overseas services and clean up from there.

AdamH12113•8mo ago

Yeah, I actually have a decades-old two-layer board that I need to reproduce and I would love to be able to feed images of it into some sort of tool and have it generate a schematic (or at least a netlist) automatically.

duskwuff•8mo ago

It's not automatic, but one way I've seen people reverse-engineer PCBs (and ICs!) is to import scans of the subject in Kicad, then start tracing out the connections on screen.

1wheel•8mo ago

It can be! Here's a circuit showing how the model processes "PCB tracing stands for" to output "printed":

https://www.neuronpedia.org/gemma-2-2b/graph?slug=pcb-tracin...

tacker2000•8mo ago

haha same here

forgotpwagain•8mo ago

thought this was about tracing neural circuits in the brain and was disappointed.

Henchman21•8mo ago

Same here! Then I immediately thought: I wish people would stop misusing words followed by I guess I think I’m in charge of words now. Then, idly: I’m starting to resemble that “Old Man Yells at Cloud” meme

Funny things, thoughts.

asadm•8mo ago

ugh same here.

mrheosuper•8mo ago

Same. Those AI bros keep stealing our terminology.

Archit3ch•8mo ago

I was excited for a moment.

Tostino•8mo ago

This type of stuff is really important in my opinion. Getting this type of stuff open sourced allows academics and other researchers to try and do this type of interpretability research on a more level playing field.

I think the more people looking at this the better. I have a feeling there will be some breakthroughs in identifying important circuits and being able to make more efficient model architectures that are bootstrapped from some identified primitives.

sanex•8mo ago

The conversation about this on Dwarkesh was interesting and I'm glad we're getting access to the tool.

https://open.spotify.com/episode/3H46XEWBlUeTY1c1mHolqh?si=L...

rob-olmos•8mo ago

Anthropic employees Sholto Douglas & Trenton Bricken did an interview recently with Dwarkesh Patel, pieces here and there was about the circuit tracing insights.

https://www.dwarkesh.com/p/sholto-trenton-2 -- search the transcript for "circuit" for the quick bits.

Eg, "If you look at the circuit, you can see that it's not actually doing any of the math, it's paying attention to that you think the answer's four and then it's reasoning backwards about how it can manipulate the intermediate computation to give you an answer of four."

https://transformer-circuits.pub/

ofou•8mo ago

Is this Garcon [1], or a new tool?

[1]: https://transformer-circuits.pub/2021/garcon/index.html

e_ameisen•8mo ago

Hi, paper author here.

This is a new tool which relies on existing introspection libraries like TransformerLens (which is similar in spirit to Garcon) to build an attribution graph. This graph displays intermediate computational steps the model took to sample a token.

For more details on the method, see this paper: https://transformer-circuits.pub/2025/attribution-graphs/met....

For examples of using it to study Gemma 2, check out the linked notebooks: https://github.com/safety-research/circuit-tracer/blob/main/...)

We also document some findings on Claude 3.5 Haiku here: https://transformer-circuits.pub/2025/attribution-graphs/bio...)

jexp•8mo ago

Imported the graph json into Neo4j

Have fun

https://gist.github.com/jexp/8d991d1e543c5a576a3f1ee70132ce7...

qtwhat•8mo ago

Curious if we say "thank you", the model will be more activated and result in better answer. ^^

We Mourn Our Craft

I Write Games in C (yes, C)

Hoot: Scheme on WebAssembly

SectorC: A C Compiler in 512 bytes

Stories from 25 Years of Software Development

U.S. Jobs Disappear at Fastest January Pace Since Great Recession

OpenCiv3: Open-source, cross-platform reimagining of Civilization III

The AI boom is causing shortages everywhere else

Al Lowe on model trains, funny deaths and working with Disney

The Waymo World Model

Reinforcement Learning from Human Feedback

Brookhaven Lab's RHIC Concludes 25-Year Run with Final Collisions

Start all of your commands with a comma (2009)

Vocal Guide – belt sing without killing yourself

France's homegrown open source online office suite

Coding agents have replaced every framework I used

A Fresh Look at IBM 3270 Information Display System

Show HN: I saw this cool navigation reveal, so I made a simple HTML+CSS version

History and Timeline of the Proco Rat Pedal (2021)

Selection Rather Than Prediction

72M Points of Interest

Unseen Footage of Atari Battlezone Arcade Cabinet Production

Where did all the starships go?

Show HN: Look Ma, No Linux: Shell, App Installer, Vi, Cc on ESP32-S3 / BreezyBox

Learning from context is harder than we thought

Monty: A minimal, secure Python interpreter written in Rust for use by AI

Show HN: Kappal – CLI to Run Docker Compose YML on Kubernetes for Local Dev

Hackers (1995) Animated Experience

Making geo joins faster with H3 indexes

Sheldon Brown's Bicycle Technical Info