Anthropic’s Interpretability Research🔒 SSL Verified

Table of Contents

• ↓ About
• ↓ Top Alternatives to transformer-circuits.pub

6-Month Traffic Trend Estimate

Visual representation extracted from transformer-circuits.pub

Content Snippets from transformer-circuits.pub

"A surprising fact about modern large language models is that nobody really knows how they work internally. The Interpretability team strives to change that — to understand these models to better plan for a future of safe AI."

"Can we reverse engineer transformer language models into human-understandable computer programs? Inspired by the Distill Circuits Thread, we’re going to try."

"We think interpretability research benefits a lot from interactive articles (see Activation Atlases for a striking example). Previously we would have submitted to Distill, but with Distill on Hiatus, we're taking a page from David Ha’s approach of simply creating websites (eg. World Models) for research projects."

"As part of our effort to reverse engineer transformers, we’ve created several other resources besides our paper which we hope will be useful. We’ve collected them on this website, and may add future content here, or even collaborations with other institutions."

Key Topics & Focus Areas for transformer-circuits.pub:

About