Topic
Everything filed under Databases, newest first.
RSS · JSON · All topics
What changes when your search index lives on S3?
Infino explains how putting a full-text search index on object storage changes the cost and latency model: every random read is a billed GET taking tens of milliseconds, and how superfiles, manifests and careful layout keep agent queries fast without packing the working set on local disks.
9 min · 2,019 words
Making COUNTs and the Rest of Search Really Fast (Part II)
How ctid-aware segment partitioning, an inverted DocId map, and bitmap postings accelerated ParadeDB's Wikipedia COUNT queries, followed by a look at the rest of the text-search benchmark against PlanetScale's TIN.
13 min · 2,929 words
Everyone is doing Git on S3 wrong
Enroute explains why Git is hard to put on object storage, where write-ahead-log designs fall short, and how its Rust, Raft and S3-backed Git server, built on modern database principles, reaches 7,600+ concurrent pushes per second on a single repository, with benchmarks and an open-source 0.3.0 release.
17 min · 3,860 words
Building a Linearizable Log on READ COMMITTED Isolation
Materialize describes how a metastable incident under PostgreSQL SERIALIZABLE led them to build a linearizable metadata log on READ COMMITTED isolation, achieving 3x write throughput, backed by a Lean 4 proof.
20 min · 4,657 words
Announcing pg_vectorsearch: Scalable Open-Source Vector Search in PostgreSQL
Tiger Data launches pg_vectorsearch, an open-source PostgreSQL extension whose PRISM index uses partitioning and compression instead of HNSW graphs to deliver faster vector queries with far less memory and quicker index builds.
11 min · 2,613 words
Radim Marek explains how PostgreSQL's TABLESAMPLE really samples: SYSTEM picks whole pages so rows come in bundles, BERNOULLI with REPEATABLE drifts after an UPDATE, and hashing a key gives a stable sample, plus when each approach fits.
12 min · 2,718 words
PGO or not PGO this is the dilemma. Step 2Step 2: How it works
The second of Marco Tusa's three-part Percona series on profile-guided optimization explains how PGO works as a two-pass build: instrumented binaries record per-edge control-flow counters during a training workload, and the compiler then uses those counts for inlining, branch layout, hot/cold splitting and code ordering, which is why MySQL's MTR test suite transfers well as training data.
5 min · 1,174 words
The reverts will continue until morale improves
PostgreSQL committer Peter Eisentraut reflects on the unusually large wave of feature reverts after PostgreSQL 19 entered beta, why quality bar and unfinished design led to cutting ~8–10 significant features, and what that means for PostgreSQL 19 and 20.
5 min · 1,145 words
Five months treating bugs like patients and coding agents like a medical team
Cockroach Labs' Adam Storm describes the "hospital", an agent system that triages GitHub issues and assigns specialist coding agents. It added IBM Db2 support to the MOLT migration tool in under two days for a $4,172 token bill, versus nine months for Oracle in 2024, and the post covers what broke, human review and training junior engineers.
19 min · 4,382 words
Push Ifs Up and Fors Down: The Idiom, Its Algebra, and Its Limits
Debasish Ghosh examines the 'push ifs up and fors down' heuristic from TigerBeetle's Tiger Style and matklad: what it actually says, how it mirrors predicate pushdown and batching in query optimization, how algebraic laws of functional programs such as filter/map fusion decide which rewrites are legal, and where the analogy stops paying off.
7 min · 1,570 words
How We Made Our MMDB Files a Third Smaller Without Changing a Byte of Data
IPinfo's Tiago Martins and Silvano Cerza explain how hash-consing the MMDB search tree, exploiting how repetitive internet address data is, shrank IPinfo's 89 daily databases from 91.2 GB to 62.8 GB (31%, up to 80% for ipinfo_privacy) with no compression and no reader changes, how they proved the output is the same database, and why the mmdbshrink tool and mmdbctl update are open source.
7 min · 1,588 words
Deepthi Sigireddi from Supabase
Phil Eaton interviews Deepthi Sigireddi, Head of Databases at Supabase and former Vitess project lead at PlanetScale, about 25 years of database scaling work, leading Vitess, sharding Postgres with Multigres, incidents she learned from, and what agents creating many tiny databases mean next.
6 min · 1,473 words
The Polars team ships Polars 2.0: initial out-of-core spill-to-disk support on by default, core engine and optimizer speedups, first-class SQL that leads DuckDB and DataFusion on TPC-H and TPC-DS style benchmarks, a new Map dtype, and stricter dtype handling, plus a detailed benchmark appendix.
6 min · 1,287 words
TidesDB now available for MySQL v9, v26
The TidesDB team announces TideSQL-MySQL v2.0.0, which loads the TidesDB LSM-tree storage engine into stock MySQL 9.7 and 26.7 as a plugin rather than a fork. The post covers per-table options via ENGINE_ATTRIBUTE, compression, value separation for large values, durability modes, TTL, encryption, optimistic MVCC, and sysbench comparisons against InnoDB.
7 min · 1,580 words
Building a Job Queue in Postgres with SKIP LOCKED
Michael Guay walks through running background jobs in Postgres instead of Redis: the jobs table, claiming work safely with SKIP LOCKED, leases for crashed workers, retries with backoff, dedup, LISTEN/NOTIFY wakeups, and when not to.
9 min · 2,138 words
How Firestore Matches Realtime Queries
Tyler Rockwood explains how Cloud Firestore matches and fans out realtime listeners efficiently as documents change—covering query indexing, target matching, and fanout tradeoffs.
5 min · 1,243 words
We ported the original Doom to SQL
CedarDB engineers describe porting the original Doom so the game’s world and logic run as SQL queries—showing what a modern analytical database can do with a playful, technical demo.
22 min · 5,155 words
Supabase is acquiring Turso to strengthen database infrastructure for agentic AI, combining Postgres strengths with Turso’s edge-oriented SQLite work.
2 min · 399 words
turbopuffer is pushing the frontier of search. To do that, we have to fundamentally redesign our storage architecture so the vector index is no longer primary.
6 min · 1,334 words
Announcing Cloudflare K2: serverless event streams
Cloudflare K2 is a serverless event streaming service built directly on top of R2 object storage for high-scale data movement and long-term retention. By decoupling producers and consumers at the edge, K2 enables durable, ordered log streams without the operational overhead of traditional broker clusters.
7 min · 1,546 words