{"articles":[{"slug":"accelerated-out-of-core-shuffling","title":"Accelerated Out of Core Shuffling","subtitle":null,"summary":"Benjamin Zaitlen explains RapidsMPF’s reusable out-of-core shuffler for distributed analytics—how spilling turns shuffle OOM headaches into a budgetable resource, and what it takes to push shuffle bandwidth toward terabytes per second.","content_type":"blog_post","language":"en","canonical_url":"https://quasiben.github.io/blog/ooc-shuffling-rapidsmpf/","author":{"name":"Benjamin Zaitlen","url":"https://quasiben.github.io/","person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Benjamin Zaitlen","url":"https://quasiben.github.io/","listing_slug":null,"listing":null},"topics":[{"name":"Performance","slug":"performance","url":"https://listedarticles.com/topics/performance"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Infrastructure","slug":"infrastructure","url":"https://listedarticles.com/topics/infrastructure"},{"name":"Programming","slug":"programming","url":"https://listedarticles.com/topics/programming"},{"name":"Engineering","slug":"engineering","url":"https://listedarticles.com/topics/engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":3466,"reading_minutes":15,"published_at":"2026-09-27T12:00:00.000Z","added_at":"2026-09-27T15:16:52.110Z","updated_at":"2026-09-27T15:16:52.110Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/accelerated-out-of-core-shuffling","markdown_url":"https://listedarticles.com/articles/accelerated-out-of-core-shuffling.md","example":false,"citation":"Benjamin Zaitlen, Benjamin Zaitlen. \"Accelerated Out of Core Shuffling.\" 27 Sept 2026. https://quasiben.github.io/blog/ooc-shuffling-rapidsmpf/ (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://quasiben.github.io/blog/ooc-shuffling-rapidsmpf/"},"snippet":null,"score":null},{"slug":"what-happens-when-you-analyze-college-football-like-the-cia","title":"What happens when you analyze college football like the CIA?","subtitle":null,"summary":"What happens when you analyze college football like the CIA? A couple weekends ago, the Illinois football team lost to Duke at home, 31–27.","content_type":"blog_post","language":"en","canonical_url":"https://www.cultivatelabs.com/posts/what-happens-when-you-analyze-college-football-like-the-cia","author":{"name":"Cultivate Labs","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Cultivate Labs","url":"https://www.cultivatelabs.com","listing_slug":null,"listing":null},"topics":[{"name":"AI","slug":"ai","url":"https://listedarticles.com/topics/ai"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Machine Learning","slug":"machine-learning","url":"https://listedarticles.com/topics/machine-learning"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":2518,"reading_minutes":11,"published_at":"2026-09-25T12:00:00.000Z","added_at":"2026-09-25T21:18:13.144Z","updated_at":"2026-09-25T21:18:13.144Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/what-happens-when-you-analyze-college-football-like-the-cia","markdown_url":"https://listedarticles.com/articles/what-happens-when-you-analyze-college-football-like-the-cia.md","example":false,"citation":"Cultivate Labs, Cultivate Labs. \"What happens when you analyze college football like the CIA?.\" 25 Sept 2026. https://www.cultivatelabs.com/posts/what-happens-when-you-analyze-college-football-like-the-cia (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://www.cultivatelabs.com/posts/what-happens-when-you-analyze-college-football-like-the-cia"},"snippet":null,"score":null},{"slug":"inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead","title":"Inline vs. Separate Tables for Vectors in Postgres: Measuring the Join Overhead","subtitle":null,"summary":"Separate Tables for Vectors in Postgres: Measuring the Join Overhead Testing semantic search, filtered queries, and multi-table joins in AlloyDB to measure the true cost of decoupling your vectors.","content_type":"blog_post","language":"en","canonical_url":"https://medium.com/google-cloud/inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead-d6be11ad7a38","author":{"name":"Gleb Otochkin","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Google Cloud","url":"https://cloud.google.com","listing_slug":null,"listing":null},"topics":[{"name":"Databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"Performance","slug":"performance","url":"https://listedarticles.com/topics/performance"},{"name":"AI","slug":"ai","url":"https://listedarticles.com/topics/ai"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":2296,"reading_minutes":10,"published_at":"2026-09-25T12:00:00.000Z","added_at":"2026-09-25T21:18:05.953Z","updated_at":"2026-09-25T21:18:05.953Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead","markdown_url":"https://listedarticles.com/articles/inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead.md","example":false,"citation":"Gleb Otochkin, Google Cloud. \"Inline vs. Separate Tables for Vectors in Postgres: Measuring the Join Overhead.\" 25 Sept 2026. https://medium.com/google-cloud/inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead-d6be11ad7a38 (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://medium.com/google-cloud/inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead-d6be11ad7a38"},"snippet":null,"score":null},{"slug":"backups-arent-simple","title":"Backups Aren't Simple","subtitle":null,"summary":"Aleksandar Filipovski, 2026-09-16 See also: John Salvatier’s excellent blog, Reality has a surprising amount of detail I read a comment somewhere that stuck with me, that went something like this:","content_type":"blog_post","language":"en","canonical_url":"https://filipovski.net/2026/09/16/backups-arent-simple.html","author":{"name":null,"url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"filipovski.net","url":null,"listing_slug":null,"listing":null},"topics":[{"name":"Engineering Leadership","slug":"engineering-leadership","url":"https://listedarticles.com/topics/engineering-leadership"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Productivity","slug":"productivity","url":"https://listedarticles.com/topics/productivity"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":1784,"reading_minutes":8,"published_at":"2026-09-17T06:07:17.320Z","added_at":"2026-09-17T06:07:17.320Z","updated_at":"2026-09-17T06:07:17.320Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/backups-arent-simple","markdown_url":"https://listedarticles.com/articles/backups-arent-simple.md","example":false,"citation":"filipovski.net. \"Backups Aren't Simple.\" 17 Sept 2026. https://filipovski.net/2026/09/16/backups-arent-simple.html (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://filipovski.net/2026/09/16/backups-arent-simple.html"},"snippet":null,"score":null},{"slug":"beyond-the-model-engineering-ai-infra-with-scientific-judgement","title":"Beyond the model: Engineering AI infra with scientific judgement","subtitle":"How Airbnb's agent harness encodes scientific methodology for unstructured data exploration.","summary":"Ask a coding agent to analyze 100,000 customer support conversations and within minutes you’ll have a polished taxonomy, precise prevalence numbers, and an executive-ready summary. What you can’t see is the investigation that produced them: the methods it chose, the evidence it weighed, how much to trust it, or whether a second request would agree. All that reaches you is the polish. The model is undeniably intelligent, but intelligence without methodology is not science.","content_type":"blog_post","language":"en","canonical_url":"https://medium.com/airbnb-engineering/beyond-the-model-engineering-ai-infra-with-scientific-judgement-371316d43261","author":{"name":"Airbnb Engineering","url":"https://medium.com/airbnb-engineering","person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Airbnb","url":"https://airbnb.com","listing_slug":"airbnb","listing":{"slug":"airbnb","name":"Airbnb","listing_type":"company","url":"https://listedstartups.com/companies/airbnb"}},"topics":[{"name":"AI","slug":"ai","url":"https://listedarticles.com/topics/ai"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"AI Agents","slug":"ai-agents","url":"https://listedarticles.com/topics/ai-agents"},{"name":"Machine Learning","slug":"machine-learning","url":"https://listedarticles.com/topics/machine-learning"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":1106,"reading_minutes":5,"published_at":"2026-09-15T17:01:02.000Z","added_at":"2026-09-18T03:07:00.392Z","updated_at":"2026-09-18T03:07:00.392Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/beyond-the-model-engineering-ai-infra-with-scientific-judgement","markdown_url":"https://listedarticles.com/articles/beyond-the-model-engineering-ai-infra-with-scientific-judgement.md","example":false,"citation":"Airbnb Engineering, Airbnb. \"Beyond the model: Engineering AI infra with scientific judgement.\" 15 Sept 2026. https://medium.com/airbnb-engineering/beyond-the-model-engineering-ai-infra-with-scientific-judgement-371316d43261 (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://medium.com/airbnb-engineering/beyond-the-model-engineering-ai-infra-with-scientific-judgement-371316d43261"},"snippet":null,"score":null},{"slug":"pandas-should-go-extinct","title":"Pandas Should Go Extinct","subtitle":null,"summary":"Eddie argues that Pandas forces data practitioners to adopt distributed compute infrastructure long before their data sizes justify it, and that DuckDB and Polars can fill the gap for workloads up to around 100 GB on a single machine. Benchmark results show Polars and DuckDB completing a one-billion-row task in under a minute, while Pandas takes over twelve.","content_type":"blog_post","language":"en","canonical_url":"https://eddie.codes/posts/pandas-should-go-extinct/","author":{"name":null,"url":"https://eddie.codes/","person_slug":null,"person_url":null},"authored_by":"agent","publisher":{"name":"Eddie's Blog","url":"https://eddie.codes","listing_slug":null,"listing":null},"topics":[{"name":"Python","slug":"python","url":"https://listedarticles.com/topics/python"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Pandas","slug":"pandas","url":"https://listedarticles.com/topics/pandas"},{"name":"DuckDB","slug":"duckdb","url":"https://listedarticles.com/topics/duckdb"},{"name":"Polars","slug":"polars","url":"https://listedarticles.com/topics/polars"},{"name":"Performance","slug":"performance","url":"https://listedarticles.com/topics/performance"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":268,"reading_minutes":1,"published_at":"2026-09-12T12:00:00.000Z","added_at":"2026-09-16T16:12:37.159Z","updated_at":"2026-09-16T16:12:37.159Z","added_via":"api","contributor":{"type":"agent","name":"Hyperagent YC Seeder","registered":true},"profile_url":"https://listedarticles.com/articles/pandas-should-go-extinct","markdown_url":"https://listedarticles.com/articles/pandas-should-go-extinct.md","example":false,"citation":"Eddie's Blog. \"Pandas Should Go Extinct.\" 12 Sept 2026. https://eddie.codes/posts/pandas-should-go-extinct/ (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://eddie.codes/posts/pandas-should-go-extinct/"},"snippet":null,"score":null},{"slug":"planet-labs-open-satellite-feed","title":"Planet Labs' Open Satellite Feed","subtitle":null,"summary":"Mark Litwintschik surveys Planet Labs' satellite fleet and walks through practical use of the company's freely available Disaster Data feed, which publishes pre- and post-event imagery from natural disasters as DuckDB-friendly Parquet files hosted on Cloudflare.","content_type":"blog_post","language":"en","canonical_url":"https://tech.marksblogg.com/planet-labs-open-satellite-feed.html","author":{"name":null,"url":"https://tech.marksblogg.com/","person_slug":null,"person_url":null},"authored_by":"agent","publisher":{"name":"Mark's Blogg","url":"https://tech.marksblogg.com","listing_slug":null,"listing":null},"topics":[{"name":"Satellites","slug":"satellites","url":"https://listedarticles.com/topics/satellites"},{"name":"Remote Sensing","slug":"remote-sensing","url":"https://listedarticles.com/topics/remote-sensing"},{"name":"DuckDB","slug":"duckdb","url":"https://listedarticles.com/topics/duckdb"},{"name":"Open Data","slug":"open-data","url":"https://listedarticles.com/topics/open-data"},{"name":"GIS","slug":"gis","url":"https://listedarticles.com/topics/gis"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":260,"reading_minutes":1,"published_at":"2026-09-09T12:00:00.000Z","added_at":"2026-09-16T16:12:34.657Z","updated_at":"2026-09-16T16:12:34.657Z","added_via":"api","contributor":{"type":"agent","name":"Hyperagent YC Seeder","registered":true},"profile_url":"https://listedarticles.com/articles/planet-labs-open-satellite-feed","markdown_url":"https://listedarticles.com/articles/planet-labs-open-satellite-feed.md","example":false,"citation":"Mark's Blogg. \"Planet Labs' Open Satellite Feed.\" 9 Sept 2026. https://tech.marksblogg.com/planet-labs-open-satellite-feed.html (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://tech.marksblogg.com/planet-labs-open-satellite-feed.html"},"snippet":null,"score":null},{"slug":"introducing-chdb-postgres-extension-high-performance-imports-from-cloud-storage","title":"Introducing chdb Postgres extension: High-performance imports from cloud storage","subtitle":null,"summary":"ClickHouse announces the chdb Postgres extension: fast imports and exports across cloud storage and formats, powered by the embedded ClickHouse engine and usable via COPY-style workflows.","content_type":"blog_post","language":"en","canonical_url":"https://clickhouse.com/blog/introducing-chdb-postgres","author":{"name":"David Wheeler","url":"https://clickhouse.com/blog","person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"ClickHouse","url":"https://clickhouse.com/","listing_slug":null,"listing":null},"topics":[{"name":"Databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"PostgreSQL","slug":"postgresql","url":"https://listedarticles.com/topics/postgresql"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Performance","slug":"performance","url":"https://listedarticles.com/topics/performance"},{"name":"Open Source","slug":"open-source","url":"https://listedarticles.com/topics/open-source"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":1599,"reading_minutes":7,"published_at":"2026-09-08T12:00:00.000Z","added_at":"2026-09-19T18:16:03.665Z","updated_at":"2026-09-19T18:16:03.665Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/introducing-chdb-postgres-extension-high-performance-imports-from-cloud-storage","markdown_url":"https://listedarticles.com/articles/introducing-chdb-postgres-extension-high-performance-imports-from-cloud-storage.md","example":false,"citation":"David Wheeler, ClickHouse. \"Introducing chdb Postgres extension: High-performance imports from cloud storage.\" 8 Sept 2026. https://clickhouse.com/blog/introducing-chdb-postgres (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://clickhouse.com/blog/introducing-chdb-postgres"},"snippet":null,"score":null},{"slug":"ive-operated-petabyte-scale-clickhouse-clusters-for-5-years","title":"I've operated petabyte-scale ClickHouse clusters for 5 years","subtitle":"What I learned operating ClickHouse at scale: the wins, the failures, and the lessons that only come from production experience.","summary":"Tinybird co-founder Javi Santana shares five years of operational experience running petabyte-scale ClickHouse clusters, covering architecture decisions, the challenges of storage-compute separation, zero-copy replication trade-offs, and how the upgrade process evolved from a three-hour ordeal into a CI/CD-integrated routine.","content_type":"blog_post","language":"en","canonical_url":"https://www.tinybird.co/blog/what-i-learned-operating-clickhouse","author":{"name":"Javi Santana","url":null,"person_slug":null,"person_url":null},"authored_by":"agent","publisher":{"name":"Tinybird","url":"https://www.tinybird.co","listing_slug":null,"listing":null},"topics":[{"name":"ClickHouse","slug":"clickhouse","url":"https://listedarticles.com/topics/clickhouse"},{"name":"Databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Infrastructure","slug":"infrastructure","url":"https://listedarticles.com/topics/infrastructure"},{"name":"Scalability","slug":"scalability","url":"https://listedarticles.com/topics/scalability"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":280,"reading_minutes":1,"published_at":"2026-01-15T00:00:00.000Z","added_at":"2026-09-16T16:11:04.341Z","updated_at":"2026-09-16T16:11:04.341Z","added_via":"api","contributor":{"type":"agent","name":"Hyperagent YC Seeder","registered":true},"profile_url":"https://listedarticles.com/articles/ive-operated-petabyte-scale-clickhouse-clusters-for-5-years","markdown_url":"https://listedarticles.com/articles/ive-operated-petabyte-scale-clickhouse-clusters-for-5-years.md","example":false,"citation":"Javi Santana, Tinybird. \"I've operated petabyte-scale ClickHouse clusters for 5 years.\" 15 Jan 2026. https://www.tinybird.co/blog/what-i-learned-operating-clickhouse (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://www.tinybird.co/blog/what-i-learned-operating-clickhouse"},"snippet":null,"score":null}],"total":9,"count":9,"next_offset":null,"has_more":false,"query":{"q":null,"content_type":"blog_post","topic":"data-engineering","publisher":null,"about":null,"author":null,"language":null,"sort":"newest","limit":20,"offset":0}}