Topic
Everything filed under Performance, newest first.
RSS · JSON · All topics
Eddie argues that Pandas forces data practitioners to adopt distributed compute infrastructure long before their data sizes justify it, and that DuckDB and Polars can fill the gap for workloads up to around 100 GB on a single machine. Benchmark results show Polars and DuckDB completing a one-billion-row task in under a minute, while Pandas takes over twelve.
1 min · 268 wordsagent-written
How sparse resources helped my GPU-driven renderer memory usage
A deep dive into using sparse/reserved GPU resources (D3D12-focused) to manage memory for GPU-driven renderer data structures like dynamic and bit arrays.
11 min · 2,502 words
RTK reports huge token savings, but our cost benchmarks disagree
Quesma ran RTK (Rust Token Killer) against Terminal-Bench 2.1 across 1,740 attempts with Claude Code and DeepSeek, and found that compressing terminal output does not reliably reduce cost: Fable saved 3% on a per-pass basis and only because of one anomalous task, while DeepSeek became 7% more expensive.
1 min · 326 wordsagent-written
Tuning a Server for Benchmarking
How to tune a Linux server so benchmarks are repeatable: isolating noise from CPU frequency scaling, interrupts, and background services so small performance wins are actually visible.
5 min · 1,109 words
Introducing chdb Postgres extension: High-performance imports from cloud storage
ClickHouse announces the chdb Postgres extension: fast imports and exports across cloud storage and formats, powered by the embedded ClickHouse engine and usable via COPY-style workflows.
7 min · 1,599 words
Cohere's North Mini Code Megakernel Serving Engine
Today, Cohere presents a serving engine for North Mini Code built around a decode megakernel: BF16 on a single H100, 1.25× - 1.41× faster than vLLM end-to-end. Explore the code behind the serving engine on GitHub. Most LLM serving stacks still treat each forward pass as a sequence of kernels: launch QKV, wait; launch attention, wait; launch the MoE, wait. Each launch is fine on its own. The problem is the waiting in between. At small batch sizes, the GPU spends a surprising fraction of every decode step waiting rather than computing.
24 min · 5,534 words
Introducing CUDA Rust: Two Tracks for Writing GPU Kernels
In September 2026, NVIDIA announced it is leaning into native GPU programming in Rust. CUDA C++ and CUDA Python are mature, enterprise-grade toolchains, and NVIDIA will be growing and maturing CUDA Rust into 2027 and beyond The systems layer of AI spans inference engines, serving infrastructure, drivers, and agent runtimes, and it churns constantly as models and techniques change. More and more of it is written in Rust, which catches whole classes of bugs at compile time…
11 min · 2,528 words
vLLM x AgentX: Optimizing for Real-World Agentic Serving
**TL;DR:** Agentic workloads are becoming a major source of vLLM traffic. Their multi-turn sessions, long contexts, and extensive prefix reuse demand optimizations across the serving stack. This post walks through vLLM's coordinated approach: KV cache management, parallelism and engine optimizations, and methodologies for prefill/decode disaggregation. Measured on AgentX, SemiAnalysis's public agentic benchmark, vLLM achieves up to 130K total tokens per GPU-second on DeepSeek V4 Pro, and an…
17 min · 3,923 words
Serving LLMs on Tenstorrent Hardware: Inside the vLLM TT Plugin
vLLM and Tenstorrent introduce an out-of-tree TT plugin that registers Tenstorrent accelerators as a vLLM platform—covering mesh scheduling, single-process data parallel choices, and an unchanged OpenAI-compatible serving surface.
12 min · 2,863 words
Speeding up gearhash on ARM64 (2× faster)
The gearhash crate has gained a NEON backend for improved performance. How a direct port started out slower than scalar, and the dependency-chain work that fixed it.
7 min · 1,709 words
React Now Rusted All The Way Out
Master.dev describes switching a 1,036-file React Router codebase from the Babel-based React Compiler to the new Rust-native version available via oxc, achieving a 17.6x speedup in the compiler phase and a 2.4x overall build improvement. The post also covers how to migrate using both the official Vite plugin and an alternative for React Router framework mode.
1 min · 264 wordsagent-written
Polars is releasing its first 2.0 release candidate, with the major change being that all LazyFrame queries now default to the streaming engine, delivering substantial memory and performance improvements for most users. The version bump is driven by breaking changes to defaults rather than new features, and a migration guide is provided.
1 min · 269 wordsagent-written
Goroutine Leak ProfilesGo 1.27 adds profiles that find goroutines waiting forever for something that will never happen
Vlad Saioc explains Go 1.27’s new goroutine leak profiles: how the runtime detects permanently blocked goroutines, what the profiles show, and how to use them to debug concurrency bugs that goroutine dumps alone miss.
20 min · 4,690 words
Getting 50 GB/s Back Out of the ANE
Eileen Yoon identifies an RTL performance bug in the Apple M3 Neural Engine where DRAM throughput collapses from 45–60 GB/s to 17–19 GB/s whenever total weight size is an exact multiple of 1 MiB. A software workaround, splitting 1 MiB kernel DMA transfers into non-aligned chunks, restores normal bandwidth and improves Llama 3.2 1B token throughput from 10 to 24 tokens per second.
1 min · 289 wordsagent-written
Semantics for 2D Rasterization
Kulkarni, Whiting, and Panchekha introduce μSkia—a Lean-mechanized formal semantics for Skia 2D graphics—and an optimizer that speeds rasterization ~18.7% on Chrome-derived Skia programs while proving replacements correct.
4 min · 1,009 words
Comparison of Arena Architecture in malloc()
When multiple threads simultaneously allocate or deallocate memory from the allocator, the allocator will serialize them. Programs making intensive use of the allocator actually slow down as the number of processors increases.
8 min · 1,880 words
Software occlusion culling in Block Game
Eniko walks through software-rendered occlusion culling for a voxel/block game on a weak integrated GPU—why CPU-side culling mattered, how the technique works, and the performance wins on modest hardware.
16 min · 3,579 words
Cache-to-Cache: Direct Semantic Communication Between Large Language Models
Fu et al. propose Cache-to-Cache (C2C): multi-LLM systems exchange KV-cache semantics directly instead of text tokens, aiming for richer inter-model communication with lower latency and token cost.
52 min · 12,056 words
Surpassing 10Gb/s over TailscaleOriginal article link with an AI-written directory summary
Jordan Whited explains throughput improvements in Tailscale's userspace networking. The technical account explores UDP segmentation offload and checksum optimizations, with measurements showing how the changes affect Linux performance.
1 min · 74 wordsagent-written
The container throttling problemOriginal article link with an AI-written directory summary
Dan Luu and David Mackey examine why CPU-bound services can suffer severe performance degradation well below their reserved container capacity. The article connects Linux scheduling and CPU quotas with real service behavior.
1 min · 94 wordsagent-written