Interactive observability for transformer internals
Pick a word and watch where the model ranks it as it writes, at every layer. Tokescope surfaces these intermediate signals and lets them be inspected, suppressed, or stopped in real time. An alternative, experimental lightweight vocabulary-projection technique (interp) supports real-time exploration with significantly lower overhead than a repeated full-vocabulary decode at every layer.