Cut your AI spend with AI Gateway's Auto Router

Cloudflare AI Gateway now features a model router that evaluates request complexity using an edge-deployed classifier to select the optimal model. By balancing expected output quality against token costs, organizations can dramatically cut AI spend while maintaining performance.

Announcement · AI · LLMs · Infrastructure · Performance

Introducing WalShadow: Sub-second Postgres replication to ClickHouse from physical WAL

Today, we’re announcing WalShadow, an open-source engine that replicates Postgres data to ClickHouse directly from physical WAL. In our benchmarks, transactions committed in Postgres became visible in ClickHouse in around 200 ms, while WalShadow sustained 289K rows/sec, effectively keeping pace with the source Postgres instance. Unlike traditional CDC based systems, WalShadow doesn’t use Postgres logical replication. It consumes the same physical WAL stream used by Postgres replicas, decodes…

Announcement · Databases · Open Source · Infrastructure · Performance

Introducing Ember-1

Ember-1 is a new specialized model from Fireworks Research that delivers Kimi K3’s quality with 40% fewer tokens.

Announcement · AI · LLMs · Machine Learning · Research

Halo: Frontier-Lab Training for Everyone

White Circle open-sources Halo, a Hugging Face–native training framework claiming up to ~2.8× faster post-training than stock TRL with lower memory use—from single GPU to multi-node, keeping checkpoints in native HF format.

Announcement · AI · Machine Learning · Open Source · LLMs

Introducing Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

PrismML introduces Bonsai 2 27B, a near-lossless compression of a 27B-class multimodal model into roughly a 9× smaller footprint aimed at efficient on-device and local inference.

Announcement · AI · LLMs · Machine Learning · Hardware

Introducing CUDA Rust: Two Tracks for Writing GPU Kernels

In September 2026, NVIDIA announced it is leaning into native GPU programming in Rust. CUDA C++ and CUDA Python are mature, enterprise-grade toolchains, and NVIDIA will be growing and maturing CUDA Rust into 2027 and beyond The systems layer of AI spans inference engines, serving infrastructure, drivers, and agent runtimes, and it churns constantly as models and techniques change. More and more of it is written in Rust, which catches whole classes of bugs at compile time…

Announcement · Rust · Hardware · Programming · Performance

Pre-Release of Polars 2.0

Polars is releasing its first 2.0 release candidate, with the major change being that all LazyFrame queries now default to the streaming engine, delivering substantial memory and performance improvements for most users. The version bump is driven by breaking changes to defaults rather than new features, and a migration guide is provided.

Announcement · Python · Data Engineering · DataFrames · Performance