goodfire.com · Interpretability
Interpretability research company building tools to understand and edit the internal workings of neural networks.
Goodfire is one of 8 interpretability tools on Axiomi. See all interpretability tools or how we check facts.
// guides
What is mechanistic interpretability research? A plain guide to features, circuits, superposition, sparse autoencoders, key papers, open tools and how to start.
// related
TransformerLensgithub.comLibrary for mechanistic interpretability that exposes and edits the internal activations of GPT style models.InterpretabilityOpen source★ 4kSAELensgithub.comToolkit for training and analysing sparse autoencoders that decompose model activations into interpretable features.InterpretabilityOpen source★ 1.6k
nnsightnnsight.netLibrary for inspecting and intervening on model internals, with remote execution on large models through NDIF.InterpretabilityOpen source★ 1.1k
Transformer Circuitstransformer-circuits.pubAnthropic's interpretability publication thread, home to influential work on features, superposition and circuit tracing.InterpretabilityFreeHN 1
SHAPshap.readthedocs.ioGame theoretic approach to explaining the output of any machine learning model using Shapley values.InterpretabilityOpen source★ 25.8k
Captumcaptum.aiPyTorch library for model interpretability with integrated gradients, saliency and other attribution methods.InterpretabilityOpen source★ 5.7k