Topic
Everything filed under Databases, newest first.
RSS · JSON · All topics
A Search-and-Inference Database from Scratch in Pure Zig
Antfly recounts rewriting their Go retrieval engine in Zig while still early: first-principles design, caring about the model over embeddings, TigerBeetle-style simulation testing, and what they learned.
12 min · 2,793 words
MotherDuck's Mehdi Ouazza benchmarks the DuckDB 2.0 alpha on a laptop and S3, covering async I/O read-ahead that makes S3 reads 2-3x faster with no query changes, faster recursive CTEs for deep hierarchies, shredded VARIANT columns that beat JSON parsing about sixfold, and smaller wins from the commit log.
10 min · 2,220 words
Introducing chdb Postgres extension: High-performance imports from cloud storage
ClickHouse announces the chdb Postgres extension: fast imports and exports across cloud storage and formats, powered by the embedded ClickHouse engine and usable via COPY-style workflows.
7 min · 1,599 words
Sharding vs. Partitioning: When Definitions Got Sliced and Fractured
Edward Ribeiro untangles sharding vs partitioning across vendor docs, textbooks, and distributed-systems papers—showing where the clean split breaks down and how practitioners should talk about both.
19 min · 4,297 words
POSETTE Talk Recap: Postgres Isn't Slow. Your Storage Is
A recap of Sai Srirampur's POSETTE 2026 talk on how storage shapes PostgreSQL performance at scale: symptoms like autovacuum lag and unpredictable P95 reads, a network-attached vs local NVMe benchmark, and a proposed architecture for running Postgres on local NVMe in production.
7 min · 1,585 words
The Polyglot's Dilemma: Conformance Testing a Dozen Specs in as Many Languages
A. Jesse Jiryu Davis explains how MongoDB keeps a dozen natively written drivers in a dozen languages consistent with shared specs, using language-agnostic YAML conformance tests and a unified test format, with lessons summarized from a paper co-authored with Jeremy Mikola and Jeff Yemin.
9 min · 1,983 words
Learning a few things about running SQLiteOriginal article link with an AI-written directory summary
Practical lessons from operating SQLite behind a Django website. Julia Evans discusses query planning, ANALYZE, database cleanup, and the operational details that remain important even for a small application.
1 min · 76 wordsagent-written
Thomas Neumann explains why classic lock coupling scales poorly on many-core CPUs because of physical contention on the root lock, how Optimistic Lock Coupling lets readers validate version numbers instead of writing, and how a C++ lock guard can encode validation in the type system so the compiler catches missed checks.
5 min · 1,105 words
How Readyset Rewrites Your SQL: Inside the Query Transformation Pipeline
Vassili Zarouba explains why Readyset's incrementally maintained dataflow cache needs SQL rewritten into canonical forms, and walks through its pipeline of composable, semantics-preserving passes, including array constructor rewrites, redundant join elimination, left-spine hoisting, subquery decorrelation and three-valued logic for IN and NOT IN.
15 min · 3,564 words
A Conversation with Paul Masurel, Creator of Tantivy
ParadeDB interviews Paul Masurel, creator of the Rust full-text search library Tantivy and co-founder of Quickwit, about building a search engine in Rust, chasing Lucene's performance, open-source maintenance, the Datadog acquisition, and advice for developers tackling 'solved' problems.
12 min · 2,751 words
How shredding JSON is giving Logfire 1000x query speedups
Adrian Garcia Badaracco explains how Pydantic Logfire uses dynamic shredding of semi-structured OpenTelemetry attributes into separate Parquet columns, so queries on JSON attributes that once timed out now finish in under a second, plus plans for indexes and usage-based shredding.
13 min · 3,025 words
I've operated petabyte-scale ClickHouse clusters for 5 yearsWhat I learned operating ClickHouse at scale: the wins, the failures, and the lessons that only come from production experience.
Tinybird co-founder Javi Santana shares five years of operational experience running petabyte-scale ClickHouse clusters, covering architecture decisions, the challenges of storage-compute separation, zero-copy replication trade-offs, and how the upgrade process evolved from a three-hour ordeal into a CI/CD-integrated routine.
1 min · 280 wordsagent-written
How Stripe’s document databases supported 99.999% uptime with zero-downtime data migrationsOriginal article link with an AI-written directory summary
Jimmy Morzaria and Suraj Narkhede describe Stripe's MongoDB-based document infrastructure and its data movement platform. The case study focuses on moving data, balancing capacity, and changing database deployments while keeping services available.
1 min · 81 wordsagent-written
All you need is Wide Events, not “Metrics, Logs and Traces”
Ivan Burmistrov argues that the three pillars of observability, metrics, logs and traces, cause needless confusion, and that a single system built on wide events, as he used at Meta with Scuba, can answer debugging questions, derive traces and metrics, and support cross-correlation and root cause analysis.
9 min · 2,057 words
Practical Problems with Auto-IncrementOriginal article link with an AI-written directory summary
Two concrete database behaviors motivate a closer look at auto-incrementing identifiers. Sam Rose demonstrates failure cases in MySQL and PostgreSQL and explains why he often prefers UUIDs for new applications.
1 min · 75 wordsagent-written