Topic
Everything filed under LLMs, newest first.
RSS · JSON · All topics
The Dot and the SwarmBenefitting from the Bitter Lesson
Ethan Mollick on what he underestimated most about AI progress: agents that self-organize into swarms, what that means for tools like Muse and Dots, and why we keep relearning the Bitter Lesson.
8 min · 1,891 words
AI Models Can Provably Hide Arbitrary Capabilities
A research paper arguing that AI models can provably hide arbitrary capabilities from evaluators under formal assumptions, with implications for AI safety evaluations, capability elicitation, and how we interpret benchmark and red-team results.
53 min · 12,294 words
How we built long-term memory for Alyx: why we chose a file over a knowledge graph
Arize engineer Priyan Jindal recounts building long-term memory for the Alyx AI engineering agent: after weeks on vectors and knowledge graphs, they shipped one structured 8,000-character text file per user/space, read on every request—and how they update, compact, and test it.
23 min · 5,269 words
Claude-shaped scienceWorking on Claude-shaped problems with BootLoops, a toolkit for exact calculations in quantitative science
Harvard physicist Matthew Schwartz’s Anthropic guest post on BootLoops: an open-source harness that steers LLMs toward checkable, quantitative “Claude-shaped” problems across physics, ecology, genetics, and more—with human experts supplying scientific taste.
5 min · 1,244 words
Using Opus 5.5 to discover a new eyewitness record of the dodoFrontier models can now produce novel historical knowledge, but in a really weird way
Historian Benjamin Breen walks through how Opus 5.5 surfaced a previously unnoticed 1615 Dutch East India Company log mentioning dodos—and what AI archival sleuthing can and cannot yet do.
3 min · 631 words
Cut your AI spend with AI Gateway's Auto Router
Cloudflare AI Gateway now features a model router that evaluates request complexity using an edge-deployed classifier to select the optimal model. By balancing expected output quality against token costs, organizations can dramatically cut AI spend while maintaining performance.
7 min · 1,627 words
The Rise of Overfit Inference Engines
A hands-on essay on how local LLM inference stacks are overfit to specific models and hardware—and what that means for anyone chasing reproducible homelab performance with llama.cpp and friends.
10 min · 2,324 words
Tokenization: A Survey for Modern NLP
A comprehensive survey by 32+ tokenizer researchers covering subword algorithms, multilingual pitfalls, evaluation, theory, security, and alternatives—framing tokenization as a first-class bottleneck in the LLM era.
2 min · 376 words
Q3 2026: Smarter Routing, Airside & RealtimeLLM Gateway product roundup — 50M requests and 1.805T tokens
LLM Gateway's Q3 2026 roundup: smart and cache-aware routing, Airside provider console, realtime voice, Lounge projects, coding-tool integrations, and stronger enterprise controls—with a public traffic snapshot.
1 min · 285 words
HydraFusion in VS Code and the GitHub Copilot app
The HydraFusion research preview is now available in Visual Studio Code and the GitHub Copilot app, expanding beyond Copilot CLI. HydraFusion appears in the model picker, but rather than being…
2 min · 389 words
Gemini 4 Argon: our next era of frontier intelligence
Today, we’re announcing our new frontier model, Gemini 4 Argon, which is rolling out to a set of trusted cyber defenders through our Fairwind Program. Built to sustain deep reasoning across complex, longhorizon workflows, Argon is fundamentally changing the way we work and build at Google.
6 min · 1,378 words
Comparing Muon, NorMuon and AdamW for Fine-tuning a Dense Retriever
Qingcheng Zeng gives Muon and NorMuon the same tuning budget as AdamW when fine-tuning a contrastively pretrained dense retriever: lower training loss, no BEIR win. Learning rate and transfer matter more than the optimizer.
5 min · 1,151 words
Language Models for Text Classification: From Bag-of-Words to JevA visual guide to bag-of-words, RNNs, CNNs, transformers, Jev-like APIs, and calibration
Sebastian Raschka walks from classic bag-of-words classifiers through RNNs, CNNs, and transformers to TypeSafe AI's Jev—explaining APIs, IMDb benchmarks, calibration, and why decision models matter for agent harnesses.
5 min · 1,076 words
CLMs treat context as an editable file so models natively manage their own context—beating harness baselines on BrowseComp-Plus and long-horizon coding with fewer FLOPs, plus in-context skill evolution and RL for context management.
3 min · 699 words
How to Build a Reliable AI Assistant with the Claude API
A freeCodeCamp tutorial building ShopHelper with the Claude API: conversation history, tools, multi-block responses, workflow patterns, and evaluating whether prompt changes actually help.
9 min · 2,132 words
Casey Newton’s hands-on take on OpenAI’s Dots agents at DevDay: capable coworking inside ChatGPT, paid-only positioning versus Meta Muse, and the trust/safety tradeoffs of always-on agents.
9 min · 2,024 words
OpenAI launches the Agents API in public beta: a managed Codex harness with durable cloud sessions, sandbox compute, context compaction, subagents, and resumable multi-hour agent work for developers.
7 min · 1,539 words
Harness Learning Enables Generalizable Test-Time Adaptation
arXiv paper introducing harness learning: a proposer model revises an agent’s executable harness from execution feedback, improving test-time adaptation on unseen reasoning and multi-hop QA without weight updates.
56 min · 12,765 words
Anthropic introduces Claude Sonnet 5.5, a faster and lower-cost complement to Opus 5.5 that improves agentic coding and everyday task performance versus Sonnet 5.
8 min · 1,747 words
Build an LLM Tokenizer and Attention from Scratch in TypeScript
SitePoint tutorial that implements BPE tokenization, cosine similarity vector search, and scaled dot-product attention in TypeScript—exposing LLM primitives as ordinary readable code.
25 min · 5,827 words