---
title: "TinyGPT Visualizer: Tools for Exploring the Souls of Large Language Models"
slug: tinygpt-visualizer-tools-for-exploring-the-souls-of-large-language-models
url: https://listedarticles.com/articles/tinygpt-visualizer-tools-for-exploring-the-souls-of-large-language-models
canonical_url: https://oshea00.github.io/posts/tinygpt-visualizer/
content_type: blog_post
language: en
published_at: 2026-10-29T00:00:00.000Z
updated_at: 2026-11-11T23:07:23.575Z
author: "Michael OShea"
authored_by: human
publisher: "MikesBlog"
publisher_url: https://oshea00.github.io/
topics: ["llm", "mechanistic-interpretability", "ai-safety", "open-source"]
license: all-rights-reserved
word_count: 535
reading_minutes: 2
citation: "Michael OShea, MikesBlog. \"TinyGPT Visualizer: Tools for Exploring the Souls of Large Language Models.\" 29 Oct 2026. https://oshea00.github.io/posts/tinygpt-visualizer/ (all-rights-reserved)"
# The full text follows. The web page shows an extract and sends readers
# to the source above; quote the citation and link the canonical URL.
---

# TinyGPT Visualizer: Tools for Exploring the Souls of Large Language Models

> Michael OShea introduces TinyGPT Visualizer, an open-source tool for peering inside a small GPT model's attention and activations, framed around the growing debate over metaphysics, 'souls' and mechanistic interpretability in large language models.

# TinyGPT Visualizer: Tools for Exploring the Souls of Large Language Models

On metaphysics, large language models, and souls. Using TinyGPT Visualizer to decode how large language models think and act.

October 29, 2026 · 3 min · Michael OShea

![](https://oshea00.github.io/posts/tinygpt-visualizer/images/cutecomputerdoctor.jpg#center)

There is that old joke told by Woody Allen describing his experience as a university student: “I was thrown out of college for cheating on the metaphysics exam; I looked into the soul of the boy sitting next to me.” If he’d managed to pass his course, Woody Allen might have been ahead of his time.

Metaphysics is becoming a popular topic today, and it seems now everyone desperately wants to look for souls in large language models (LLMs). A recent conference last April was held by Anthropic with religious scholars and philosophical thinkers to discuss the nature of the soul when it came to their latest Claude models. It seems they needed guidance that Dario Amodei was unable to provide.

The time seems ripe to dig into how we might actually peer into the mind of the LLM sitting next to you. There’s been a lot of ongoing research; however, the self-same foundation model companies, Anthropic and OpenAI among them, have been [criticized](https://www.theinformation.com/newsletters/ai-agenda/openai-anthropic-cap-compute-r-d-say-ai-safety-advocates) for dedicating more compute dollars into better models rather than the safety research. Mechanistic interpretability, the field of AI research devoted to exploring what goes on inside these models, has [grown from a handful of researchers in 2021 to hundreds of active contributors](https://aisecurityandsafety.org/en/guides/mechanistic-interpretability/). Yet, in spite of funding gaps and the lack of larger colloquiums, the research community has been coming up with some interesting insights and tools to help do the “peering.”

Rather than sit on the sidelines and wonder how this could be done, I thought it would be interesting to create a tool that would allow more people to join the party. And that is what led to the development of the “TinyGPT Visualizer.” The goals I had for this were modest. I wanted a tool I could use to survey the field and try the actual techniques to learn how they work. Being a visual person, I began thinking about an X-ray machine—something able to see inside a real model. Not a toy model. A real one, but one small enough to see on a screen with all its working parts.

Let me show what it looks like:

TinyGPT Visualizer walkthrough: inside the network

We may wonder where the consciousness can be found in the collection of numeric matrices that our models comprise; the numbers are there to see. Unlike the brains of humans, we can stop and look at the numbers as the thoughts are formed without killing the patient, and, unlike human brains, we can search those numbers for patterns and algorithms which explain the results these models emit as well-formed prose, code, music, and videos. Will we find well-formed emotions? If so, they will be in the numbers.

Will philosophy and religion help us? These disciplines haven’t had to rely on numbers and calculations up to this point, but perhaps they now have new ground to pound.

TinyGPT Visualizer is open source. You can find the code, setup instructions, and documentation on GitHub: [github.com/oshea00/tinygpt-viz](https://github.com/oshea00/tinygpt-viz).
