ACADEMY / TOOLS / ATTENTION-MICROSCOPEFIG. 53 · VISUALIZATION
FIG. 53 · INSTRUMENT
Attention Microscope
Inspect synthetic GPT-2-style attention layer by layer, head by head. Ablate heads, watch top-5 candidates shift.
FIG. 53Attention Microscope
INTERACTIVE
LOADING INSTRUMENT