Topic
Everything filed under Performance, newest first.
RSS · JSON · All topics
We just shipped support for the ugliest part of HTTP: Vary
Cloudflare Cache Rules now support HTTP Vary on every plan—normalize negotiation headers, pass exact values to origin, or bypass cache when variance is too wild.
12 min · 2,727 words
Better prompt caching for GPT-6
OpenAI explains GPT-6 prompt-caching improvements: higher cache hit rates, new diagnostics, explicit breakpoints, and controls aimed at cutting latency and inference cost.
3 min · 623 words
Making the MiniMax H3 Video VAE 2x Faster
The MiniMax H3 video VAE now encodes up to ~2.2x faster and decodes ~1.4 2.7x faster. Together that can roughly halve the time a video workflow spends in the VAE: a 1344x768, 129 frame encode and decode round trip drops from 24.3 to 12.7 seconds. What changed, the technical details A fused encoder kernel, on by default. Between convolutions the encoder normalized each frame, applied an activation and padded the edges, each one a separate pass over hundreds of megabytes.
2 min · 454 words
Linebender ships fearless_simd 1.0: safe Rust SIMD that covers autovectorization, portable abstractions, and intrinsics access—reflecting on design goals after eight years from the original prototype.
4 min · 999 words
Tailscale performance updates cut memory use, raise throughput, and speed startup via multi-queue, writev, and netmap caching—how the team measured and shipped the gains.
7 min · 1,640 words
How we made claude.ai 3x faster in two weeks
Anthropic’s performance sprint cut claude.ai and desktop p75 time-to-typeable from 3.1s to 0.55s: Claude Tag measured journeys, built benchmarks, and shipped thousands of guarded changes in Slack-driven loops.
18 min · 4,175 words
Halo: Frontier-Lab Training for Everyone
White Circle open-sources Halo, a Hugging Face–native training framework claiming up to ~2.8× faster post-training than stock TRL with lower memory use—from single GPU to multi-node, keeping checkpoints in native HF format.
18 min · 4,098 words
EXPLAIN (ANALYZE, IO) in PostgreSQL 19
Franck Pachot walks through PostgreSQL 19's new EXPLAIN IO stats—prefetch depth, request size, concurrency, and waits—using Little's Law to interpret async read streams.
4 min · 1,031 words
Reducing Image Generation cost with AMD and the Luminal Compiler
Luminal engineers show Flux.2 Klein 9B image generation costs cut by up to 47% on AMD MI300X versus an Nvidia H200, using the Luminal compiler.
15 min · 3,489 words
Max Woolf shows how iterative agentic coding—prompting agents to repeatedly speed up Rust code—produced solutions faster than established libraries, with concrete methodology and caveats.
22 min · 5,140 words
AI coding has made CI a bottleneck, so we reworked ours to keep up
Linear's Mufeez Amjad explains how agent-accelerated shipping made CI the bottleneck, and how they cut PR wait time and runner cost while test suites nearly quadrupled.
8 min · 1,907 words
M5 Ultra Mac Studio Review: The Dream Mac for Local AI Agents
Federico Viticci reviews the M5 Ultra Mac Studio with 256 GB RAM—why it is a dream machine for local AI agents, what workloads it unlocks, and where it still falls short.
14 min · 3,293 words
Rebuilding Nym’s agent around Jev
How Nym rebuilt its agent stack around TypeSafe’s Jev for guardrails, browser actions, and tool selection—with benchmarks and a shopping demo.
10 min · 2,186 words
Solving for faster SHA-1 collision detection
tl;dr: I discovered collision-detecting SHA-1 is slow and decided to build my own. sha1dc is a rewrite of SHA-1 with collision detection, whose code generator uses a solver to fit collision tests into SIMD lanes. It runs at 68–81% of plain SHA-1's speed where the existing crate runs at 28–29%, and can make git pack verification twice as fast.
10 min · 2,227 words
This is a modern motherfucking website.
Robin Reel's tongue-in-cheek manifesto for building fast, readable, accessible sites without framework bloat—modern CSS and HTML done plainly.
7 min · 1,533 words
S3 Is the Future, S3 Is the Past
Amazon S3, and its analogues in other clouds, have become the foundation of the modern cloud software architecture. Today, nearly every data-intensive system is being built around S3. However, the hardware assumptions baked into S3’s design – and into all the software architectures that have emerged around it – are rapidly becoming obsolete.
3 min · 742 words
Benchmarking LLM Inference at Scale with AIPerf
NVIDIA introduces AIPerf, the GenAI-Perf successor: a multiprocess LLM inference benchmarker that avoids client bottlenecks at high concurrency, with flexible load shapes, trace replay, and production-scale measurement guidance.
7 min · 1,661 words
Saving another 100TB of RAM with math (and Rust)
Cloudflare explains how math-heavy redesigns and Rust in Pingora cut another ~100TB of RAM across their global network by shrinking hot in-memory structures without sacrificing correctness.
14 min · 3,157 words
Mold has recently updated their linker benchmarks and included Wild for the first time. These benchmarks show Wild being substantially slower than Mold in contrast to Wild’s most recently published benchmarks from our last release on August 4th. This post is an attempt to understand why there’s such a difference in the benchmark results. Mold’s benchmarks were run on two machines:
4 min · 958 words
Release notes for jemalloc 5.4.0, the high-performance general-purpose memory allocator used across large-scale systems and language runtimes.
3 min · 762 words