ACADEMY / TOOLS / ATTENTION-MICROSCOPEFIG. 43 · VISUALIZATION
FIG. 43 · INSTRUMENT
Attention Microscope
Inspect synthetic GPT-2-style attention layer by layer, head by head. Ablate heads, watch top-5 candidates shift.
FIG. 43Attention Microscope
INTERACTIVE
LOADING INSTRUMENT