Topic
Everything filed under Visualization, newest first.
RSS · JSON · All topics
The Emperor Pelican Has No Clothes
Aman Rusia shows that frontier LLMs keep drawing nearly identical SVG pelicans on a bicycle—and contrasts that collapse with diverse human-drawn alternatives, calling it an LLM diversity collapse problem.
1 min · 87 words
LLM Attention VisualizationA visualization of the attention mechanism in LLMs.
Isham Faizal built a browser-based tool that shows which past tokens a language model draws on when generating each new token. The implementation uses a custom generation loop with Transformers.js and a modified ONNX model to expose internal attention values, combined with pre-generated prompts to avoid multi-hundred-megabyte download waits.
1 min · 286 wordsagent-written