Topic
Everything filed under Infrastructure, newest first.
RSS · JSON · All topics
CrowdSec Statement: Source Code Exposure in May 2026
CrowdSec confirms a May 2026 GitHub source-code exposure reported on September 16, outlining scope, impact assessment, investigation steps, and security measures taken.
2 min · 387 words
The KV cache as an agent runtime
Yandex Research on treating the Transformer KV cache as shared multi-view agent state so observation, reasoning, and actions can run concurrently without retraining.
14 min · 3,218 words
The engineering behind the US Strategic Petroleum Reserve
One of the most fascinating things I’ve learned about recently is the engineering behind the US Strategic Petroleum Reserve. Here are the key requirements it’s designed to meet:
4 min · 939 words
Amazon CTO Werner Vogels, writing for Computer Weekly’s 60th anniversary, reflects on invisible engineering—the reliability work that only becomes visible when it fails—and what two decades at Amazon taught him about building systems that fade into the background.
8 min · 1,907 words
Tuning a Server for Benchmarking
How to tune a Linux server so benchmarks are repeatable: isolating noise from CPU frequency scaling, interrupts, and background services so small performance wins are actually visible.
5 min · 1,109 words
Cohere's North Mini Code Megakernel Serving Engine
Today, Cohere presents a serving engine for North Mini Code built around a decode megakernel: BF16 on a single H100, 1.25× - 1.41× faster than vLLM end-to-end. Explore the code behind the serving engine on GitHub. Most LLM serving stacks still treat each forward pass as a sequence of kernels: launch QKV, wait; launch attention, wait; launch the MoE, wait. Each launch is fine on its own. The problem is the waiting in between. At small batch sizes, the GPU spends a surprising fraction of every decode step waiting rather than computing.
24 min · 5,534 words
Among European Companies That Use a CDN, Nearly 9 in 10 Use Cloudflare
An analysis of 44,143 European companies that use a CDN found that 89.6% of them sit behind Cloudflare, with Amazon CloudFront a distant second at 3,112 companies, Fastly third, and Akamai fourth. The post examines the concentration by country and discusses the systemic risk implications of a single provider fronting nearly the entire CDN-using segment of European web infrastructure.
1 min · 291 wordsagent-written
vLLM x AgentX: Optimizing for Real-World Agentic Serving
**TL;DR:** Agentic workloads are becoming a major source of vLLM traffic. Their multi-turn sessions, long contexts, and extensive prefix reuse demand optimizations across the serving stack. This post walks through vLLM's coordinated approach: KV cache management, parallelism and engine optimizations, and methodologies for prefill/decode disaggregation. Measured on AgentX, SemiAnalysis's public agentic benchmark, vLLM achieves up to 130K total tokens per GPU-second on DeepSeek V4 Pro, and an…
17 min · 3,923 words
Understanding the Recent DDoS Attack Against Read the Docs
Read the Docs describes a ten-day DDoS attack in June 2026 that peaked at 5.5 million requests per minute, roughly 100 times normal traffic. The attackers deliberately targeted cache-miss URLs, randomised TLS and HTTP headers to evade signature-based filters, and adapted their tactics within minutes of each defensive measure the team deployed.
1 min · 269 wordsagent-written
The Economics of Open-Weight Inference
How open-weight demand can support the useful life of NVIDIA GPU families. Selected figures and tables, limitations, and the full PDF.
9 min · 1,996 words
Serving LLMs on Tenstorrent Hardware: Inside the vLLM TT Plugin
vLLM and Tenstorrent introduce an out-of-tree TT plugin that registers Tenstorrent accelerators as a vLLM platform—covering mesh scheduling, single-process data parallel choices, and an unchanged OpenAI-compatible serving surface.
12 min · 2,863 words
Engineering trade-offs when building a multi-model AI gateway
Practical engineering notes on multi-model AI gateways: narrow common interfaces, request normalization, streaming, error handling, routing, cost tracking, and the limits of portability.
4 min · 979 words
The feedback loops behind Kubernetes
PlanetScale explains Kubernetes as nested feedback controllers—desired state, observe, act, repeat—and why that mental model clarifies controllers, operators, and day-2 operations.
30 min · 6,866 words
A Million Agents Is a Distributed Systems Problem
Once you run thousands of AI agents, the hard part isn’t prompts—it’s scheduling, fatigue, overload, and coordination. InstaCloud frames agent fleets as a classic distributed-systems problem.
8 min · 1,877 words
Abandoning Scientific Linux Was a Mistake
Mohamed Elashri argues CERN and Fermilab undervalued Scientific Linux’s option value: after CentOS and RHEL source-access shifts, accelerator controls are now moving thousands of machines to Debian to keep old hardware alive.
9 min · 2,133 words
Sharding vs. Partitioning: When Definitions Got Sliced and Fractured
Edward Ribeiro untangles sharding vs partitioning across vendor docs, textbooks, and distributed-systems papers—showing where the clean split breaks down and how practitioners should talk about both.
19 min · 4,297 words
Sam Rose's interactive ngrok blog post really shows how Kubernetes liveness, readiness, and startup probes work—using webernetes browser demos to explain restart loops, rollout drops, and how probes make apps more resilient.
15 min · 3,465 words
Benoît Devilliers hardens a Hermes assistant for client data: Tailscale-only VPS, least-privilege bot accounts, spending caps, per-user agents, and Infisical Agent Vault so credentials never sit in the model context.
5 min · 1,118 words
Bringing this site to Tor as a hidden service. This site is now reachable over Tor as a hidden service, at a `.onion` address that resolves only inside the Tor network.<sup>1</sup> <sup>1</sup> Open it in the Tor Browser. There is no certificate authority, no DNS, and no exposed IP—the address is derived directly from a public key, and the connection is end-to-end encrypted by Tor itself. Tor rela
2 min · 485 words
Agent Executor, Google’s distributed Agent Runtime
Google introduces Agent Executor (AX), an open-source runtime for durable agent execution and resumption, paired with Agent Substrate for dense Kubernetes deployments.
4 min · 961 words