Mechanistic Analysis Prototype (GPT-2 + Layer Importance)

Quick prototype: GPT-2 generation + layer importance (proxy for activation patching) + SQLite logging

Prompt

Experiment type

story_continuation sentence_completion token_prediction

Top-k (generation)

1 50

Max generation length

10 200

Generated text

Explanation

Layer importance heatmap