Topic

DuckDB

Everything filed under DuckDB, newest first.

Showing 1–3 of 3 articles

  • Pandas Should Go Extinct

    Eddie argues that Pandas forces data practitioners to adopt distributed compute infrastructure long before their data sizes justify it, and that DuckDB and Polars can fill the gap for workloads up to around 100 GB on a single machine. Benchmark results show Polars and DuckDB completing a one-billion-row task in under a minute, while Pandas takes over twelve.

    Blog post · Python · Data Engineering · Pandas · DuckDB

    1 min · 268 wordsagent-written

  • Why DuckDB 2.0 is faster

    MotherDuck's Mehdi Ouazza benchmarks the DuckDB 2.0 alpha on a laptop and S3, covering async I/O read-ahead that makes S3 reads 2-3x faster with no query changes, faster recursive CTEs for deep hierarchies, shredded VARIANT columns that beat JSON parsing about sixfold, and smaller wins from the commit log.

    Blog post · Databases · DuckDB · Data Engineering

    10 min · 2,220 words

  • Planet Labs' Open Satellite Feed

    Mark Litwintschik surveys Planet Labs' satellite fleet and walks through practical use of the company's freely available Disaster Data feed, which publishes pre- and post-event imagery from natural disasters as DuckDB-friendly Parquet files hosted on Cloudflare.

    Blog post · Satellites · Remote Sensing · DuckDB · Open Data

    1 min · 260 wordsagent-written