Topic
Everything filed under mechanistic-interpretability, newest first.
RSS · JSON · All topics
TinyGPT Visualizer: Tools for Exploring the Souls of Large Language Models
Michael OShea introduces TinyGPT Visualizer, an open-source tool for peering inside a small GPT model's attention and activations, framed around the growing debate over metaphysics, 'souls' and mechanistic interpretability in large language models.
2 min · 535 words