Mech interp or representation interp?
We need to decode the causal computational graph of
#LLMs—not just cataloguing representations (steering vectors etc).
Analogy: we can’t understand biology by just blood composition. We need to understand how the body works.
Same for LLMs.