Open-sourcing circuit tracing tools

https://www.anthropic.com/research/open-source-circuit-tracing

161•jlaneve•8mo ago

Comments

Eduard•8mo ago

thought this was about PCB tracing and was disappointed.

dvh•8mo ago

If you only want to trace veroboards (stripboards) and not full blown PCBs I made a browser tool for that: https://github.com/dvhx/stripboard2schematic

Workaccount2•8mo ago

By total coincidence I have a project at the prototype stage that I will be building (hopefully starting tonight) on a strip board. Thanks!

buescher•8mo ago

You and me both. The reverse engineering tools are out there even if most of the search results are AI slop that recommends common layout tools. If I really needed the work done though I'd just pay one of the overseas services and clean up from there.

AdamH12113•8mo ago

Yeah, I actually have a decades-old two-layer board that I need to reproduce and I would love to be able to feed images of it into some sort of tool and have it generate a schematic (or at least a netlist) automatically.

duskwuff•8mo ago

It's not automatic, but one way I've seen people reverse-engineer PCBs (and ICs!) is to import scans of the subject in Kicad, then start tracing out the connections on screen.

1wheel•8mo ago

It can be! Here's a circuit showing how the model processes "PCB tracing stands for" to output "printed":

https://www.neuronpedia.org/gemma-2-2b/graph?slug=pcb-tracin...

tacker2000•8mo ago

haha same here

forgotpwagain•8mo ago

thought this was about tracing neural circuits in the brain and was disappointed.

Henchman21•8mo ago

Same here! Then I immediately thought: I wish people would stop misusing words followed by I guess I think I’m in charge of words now. Then, idly: I’m starting to resemble that “Old Man Yells at Cloud” meme

Funny things, thoughts.

asadm•8mo ago

ugh same here.

mrheosuper•8mo ago

Same. Those AI bros keep stealing our terminology.

Archit3ch•8mo ago

I was excited for a moment.

Tostino•8mo ago

This type of stuff is really important in my opinion. Getting this type of stuff open sourced allows academics and other researchers to try and do this type of interpretability research on a more level playing field.

I think the more people looking at this the better. I have a feeling there will be some breakthroughs in identifying important circuits and being able to make more efficient model architectures that are bootstrapped from some identified primitives.

sanex•8mo ago

The conversation about this on Dwarkesh was interesting and I'm glad we're getting access to the tool.

https://open.spotify.com/episode/3H46XEWBlUeTY1c1mHolqh?si=L...

rob-olmos•8mo ago

Anthropic employees Sholto Douglas & Trenton Bricken did an interview recently with Dwarkesh Patel, pieces here and there was about the circuit tracing insights.

https://www.dwarkesh.com/p/sholto-trenton-2 -- search the transcript for "circuit" for the quick bits.

Eg, "If you look at the circuit, you can see that it's not actually doing any of the math, it's paying attention to that you think the answer's four and then it's reasoning backwards about how it can manipulate the intermediate computation to give you an answer of four."

https://transformer-circuits.pub/

ofou•8mo ago

Is this Garcon [1], or a new tool?

[1]: https://transformer-circuits.pub/2021/garcon/index.html

e_ameisen•8mo ago

Hi, paper author here.

This is a new tool which relies on existing introspection libraries like TransformerLens (which is similar in spirit to Garcon) to build an attribution graph. This graph displays intermediate computational steps the model took to sample a token.

For more details on the method, see this paper: https://transformer-circuits.pub/2025/attribution-graphs/met....

For examples of using it to study Gemma 2, check out the linked notebooks: https://github.com/safety-research/circuit-tracer/blob/main/...)

We also document some findings on Claude 3.5 Haiku here: https://transformer-circuits.pub/2025/attribution-graphs/bio...)

jexp•8mo ago

Imported the graph json into Neo4j

Have fun

https://gist.github.com/jexp/8d991d1e543c5a576a3f1ee70132ce7...

qtwhat•8mo ago

Curious if we say "thank you", the model will be more activated and result in better answer. ^^

Stop building automations. Start running your business

You can't QA your way to the frontier

Show HN: PalettePoint – AI color palette generator from text or images

Robust and Interactable World Models in Computer Vision [video]

Nestlé couldn't crack Japan's coffee market.Then they hired a child psychologist

Notes for February 2-7

Study confirms experience beats youthful enthusiasm

The Big Hunger by Walter J Miller, Jr. (1952)

The Genus Amanita

We have broken SHA-1 in practice

Ask HN: Was my first management job bad, or is this what management is like?

Ask HN: How to Reduce Time Spent Crimping?

KV Cache Transform Coding for Compact Storage in LLM Inference

A quantitative, multimodal wearable bioelectronic device for stress assessment

Why Big Tech Is Throwing Cash into India in Quest for AI Supremacy

How to shoot yourself in the foot – 2026 edition

Eight More Months of Agents

From Human Thought to Machine Coordination

The new X API pricing must be a joke

Show HN: RMA Dashboard fast SAST results for monorepos (SARIF and triage)

Show HN: Source code graphRAG for Java/Kotlin development based on jQAssistant

Python Only Has One Real Competitor

Tmux to Zellij (and Back)

Ask HN: How are you using specialized agents to accelerate your work?

Passing user_id through 6 services? OTel Baggage fixes this

DavMail Pop/IMAP/SMTP/Caldav/Carddav/LDAP Exchange Gateway

Visual data modelling in the browser (open source)

Show HN: Tharos – CLI to find and autofix security bugs using local LLMs

Oddly Simple GUI Programs

The New Playbook for Leaders [pdf]