Topic
Everything filed under LLMs, newest first.
RSS · JSON · All topics
A technical walkthrough of what Jev-style decision models appear to be doing—single-token decisions, structured outputs, and why the architecture matters for agent tooling.
20 min · 4,510 words
Baldur Bjarnason argues chat-based LLMs work like a psychic’s cold reading: vague prompts, confirmation bias, and the user’s own meaning-making create the illusion of understanding.
22 min · 5,118 words
How Instinct's memory works: a reverse-engineering teardown
A black-box teardown of Instinct
15 min · 3,416 words
aie_2.1: building it — a conversation engine where the LLM 'remembers'
Meraki builds a Python conversation engine that shows how LLMs fake memory: every turn resends the full history so the model appears to remember, with practical notes on context and design.
9 min · 2,124 words
Keva: Running Coding Agents On-Device on Unrooted Android
Simon Lin's technical paper on Keva—an on-device Android AI coding agent running Claude Code/Codex-style loops—covering architecture, failure modes, and systems lessons without rooting the phone.
33 min · 7,580 words
Model Context Protocol with Spring AI, Building MCP Clients and Servers in Java
Ayush Shrivastava walks through building MCP clients and servers with Spring AI in Java: tool discovery, protocol basics, and wiring MCP into agentic Spring applications beyond a basic demo.
13 min · 2,972 words
I built non-autoregressive decision models with RL a year ago
Convai Innovations’ Nandakishor recounts building Laya—a ~33ms multilingual non-autoregressive decision engine with calibrated probabilities—via RLCD a year before frontier labs framed similar System One models as breakthroughs.
8 min · 1,852 words
TypeSafe's Jev AI Model in .NET: A Community SDK for Structured AI Output in C#
Laurent Kempé introduces TypeSafe’s Jev decision model and walks through a community .NET 11 / C# 15 SDK port so apps can get typed, structured decisions without brittle JSON parsing.
10 min · 2,298 wordsagent-assisted
How LLMs Actually Work: A Practical Guide for Product Managers
Abhishek Jaiswal explains tokens, transformers, attention, RAG, inference, and agents in practical PM language—so product leaders can make better build-vs-buy and quality decisions without becoming ML researchers.
20 min · 4,488 words
Your dashes suggest which model you're copy-pasting from
Will Keleher spends $2.68 on OpenRouter to show model-specific em/en dash habits—Claude often uses spaced em dashes, Gemini Flash favors spaced en dashes—and jokes about making dashes inimitable.
6 min · 1,301 words
Benchmarking LLM Inference at Scale with AIPerf
NVIDIA introduces AIPerf, the GenAI-Perf successor: a multiprocess LLM inference benchmarker that avoids client bottlenecks at high concurrency, with flexible load shapes, trace replay, and production-scale measurement guidance.
7 min · 1,661 words
How to keep enjoying programming in a world of LLMs
Are you steering towards AI burnout? Afraid of loosing your job to someone with little programming skills, no aspirations to quality, and a huge Claude account? Disappointed about the code quality in your projects, or worse in “your” own code? This is for you. There are significant and legitimate ethical concerns about frontier LLMs run by big tech companies, these have been discussed at length, I’m aware and agree, this post is not about them. Please don’t mistake me for a pro-LLM techbro. Also: Since people have mistaken my texts for LLM-generated before, I’ll tell you…
13 min · 3,046 words
ShapeLearn-Lite Held Up. ShapeLearn Did Better: Qwen 3.8 27B
ByteShape publishes full ShapeLearn GGUF builds of Qwen 3.8 27B, comparing quality and speed against ShapeLearn-Lite and other quants across RTX 3090–5090-class GPUs.
19 min · 4,316 words
A short, illustrated first-principles walkthrough of what Jev likely is—an LLM that returns a single token—and how that design compares to other projects doing the same thing.
9 min · 1,982 wordsagent-assisted
Discover, then compile downThe great unbundling of the LLM
Seldon argues Jev's launch shows frontier LLMs will unbundle into specialized decision primitives, with durable value migrating to a discover-then-compile layer that routes settled work off expensive generation.
17 min · 3,849 words
GPT-6 Astra Solves a WWI German Radio Cipher
Prinz recounts how GPT-6 Astra cracked a World War I German ADFGVX radio cipher from Scienceblogs.de’s list of unsolved cryptograms, walking through the method and what the solve implies for AI and cryptanalysis.
3 min · 655 words
What Is Jev and How Does It Work?
Shrey Shah explains TypeSafe’s Jev System One model: a decision-only API that returns choices, scores, and probabilities for software—not prose—plus use cases from routing to verification.
11 min · 2,548 words
Introducing Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint
PrismML introduces Bonsai 2 27B, a near-lossless compression of a 27B-class multimodal model into roughly a 9× smaller footprint aimed at efficient on-device and local inference.
4 min · 931 words
OpenAI announces Astra for Law: GPT-6 Astra configured for legal research, firm workflows, a Legal Search Index over 230M+ URLs, and controls aimed at confidential client work.
9 min · 2,120 words
I had Gemini train its own replacement for $9
Gemini 3.1 Pro labeled 4,290 Reddit comments for $9; a fine-tuned GLiNER model now tags brands, models and materials locally at 0.83 F1 — including the tensor-mask bug that wiped five of ten runs.
7 min · 1,532 wordsagent-assisted