{"topic":{"slug":"data-engineering","name":"Data Engineering","article_count":28,"latest_published_at":"2026-11-11T12:00:00.000Z","url":"https://listedarticles.com/topics/data-engineering"},"articles":[{"slug":"rows-vs-columns-how-different-are-they-really","title":"Rows vs Columns: How different are they, really?","subtitle":null,"summary":"Connor Tsui of Spiral explains how storing structured data in columns rather than rows changes how a database system works, covering row versus column stores, vectorized execution and lightweight compression, using a bike-share rides dataset as a running example.","content_type":"tutorial","language":"en","canonical_url":"https://spiraldb.com/blog/rows-vs-columns","author":{"name":"Connor Tsui","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Spiral","url":"https://spiraldb.com/","listing_slug":null,"listing":null},"topics":[{"name":"databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"data-engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":5116,"reading_minutes":22,"published_at":"2026-11-11T12:00:00.000Z","added_at":"2026-11-17T13:53:05.723Z","updated_at":"2026-11-17T13:53:05.723Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/rows-vs-columns-how-different-are-they-really","markdown_url":"https://listedarticles.com/articles/rows-vs-columns-how-different-are-they-really.md","example":false,"citation":"Connor Tsui, Spiral. \"Rows vs Columns: How different are they, really?.\" 11 Nov 2026. https://spiraldb.com/blog/rows-vs-columns (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://spiraldb.com/blog/rows-vs-columns"},"snippet":null,"score":null},{"slug":"why-were-moving-our-warehouse-off-duckdb","title":"Why we're moving our warehouse off DuckDB","subtitle":null,"summary":"PostHog explains why, five months after rebuilding its data warehouse on DuckDB, it re-architected it again: single-node sizing in the cloud, DuckLake catalog limits at ~1 trillion rows, and the pain of scaling Postgres wire connections led it to rebuild on Trino with its own open table format, HogLake.","content_type":"blog_post","language":"en","canonical_url":"https://posthog.com/blog/moving-off-duckdb","author":{"name":"Benjamin Knofe-Vider","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"PostHog","url":"https://posthog.com/","listing_slug":"posthog","listing":{"slug":"posthog","name":"PostHog","listing_type":"company","url":"https://listedstartups.com/companies/posthog"}},"topics":[{"name":"data-engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"infrastructure","slug":"infrastructure","url":"https://listedarticles.com/topics/infrastructure"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":962,"reading_minutes":4,"published_at":"2026-11-02T12:00:00.000Z","added_at":"2026-11-02T17:12:31.496Z","updated_at":"2026-11-02T17:12:31.496Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/why-were-moving-our-warehouse-off-duckdb","markdown_url":"https://listedarticles.com/articles/why-were-moving-our-warehouse-off-duckdb.md","example":false,"citation":"Benjamin Knofe-Vider, PostHog. \"Why we're moving our warehouse off DuckDB.\" 2 Nov 2026. https://posthog.com/blog/moving-off-duckdb (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://posthog.com/blog/moving-off-duckdb"},"snippet":null,"score":null},{"slug":"fastbcp-1-6-export-tables-from-sql-server-backups","title":"FastBCP 1.6: Export Tables from SQL Server Backups","subtitle":null,"summary":"ARPEIO's FastBCP 1.6 exports a table straight from a SQL Server full backup (.bak) to Parquet with no restore or SQL Server instance, with benchmarks on a 320 GB backup and notes on loading results via FastTransfer.","content_type":"changelog","language":"en","canonical_url":"https://blog.arpe.io/fastbcp-1-6-export-sql-server-backup-to-parquet","author":{"name":"Romain Ferraton","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"ARPEIO","url":"https://arpe.io/","listing_slug":null,"listing":null},"topics":[{"name":"Databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Developer Tools","slug":"developer-tools","url":"https://listedarticles.com/topics/developer-tools"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":2669,"reading_minutes":12,"published_at":"2026-11-01T00:00:00.000Z","added_at":"2026-11-05T20:10:53.187Z","updated_at":"2026-11-05T20:10:53.187Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/fastbcp-1-6-export-tables-from-sql-server-backups","markdown_url":"https://listedarticles.com/articles/fastbcp-1-6-export-tables-from-sql-server-backups.md","example":false,"citation":"Romain Ferraton, ARPEIO. \"FastBCP 1.6: Export Tables from SQL Server Backups.\" 1 Nov 2026. https://blog.arpe.io/fastbcp-1-6-export-sql-server-backup-to-parquet (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://blog.arpe.io/fastbcp-1-6-export-sql-server-backup-to-parquet"},"snippet":null,"score":null},{"slug":"announcing-duckdb-2-0-0-lts-cinnamon-teal","title":"Announcing DuckDB 2.0.0 LTS “Cinnamon Teal”","subtitle":null,"summary":"The DuckDB team announces DuckDB 2.0.0 LTS, its biggest feature release so far: a polished Quack protocol for DuckDB as a server, asynchronous I/O, a first-class VARIANT type, agent mode, triggers, an extensible PEG-based SQL parser, plus breaking changes and migration notes.","content_type":"announcement","language":"en","canonical_url":"https://duckdb.org/2026/10/21/announcing-duckdb-200","author":{"name":"The DuckDB team","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"DuckDB","url":"https://duckdb.org/","listing_slug":null,"listing":null},"topics":[{"name":"Databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"Open Source","slug":"open-source","url":"https://listedarticles.com/topics/open-source"},{"name":"Announcements","slug":"announcements","url":"https://listedarticles.com/topics/announcements"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":2753,"reading_minutes":12,"published_at":"2026-10-21T00:00:00.000Z","added_at":"2026-10-21T17:16:26.339Z","updated_at":"2026-10-21T17:16:26.339Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/announcing-duckdb-2-0-0-lts-cinnamon-teal","markdown_url":"https://listedarticles.com/articles/announcing-duckdb-2-0-0-lts-cinnamon-teal.md","example":false,"citation":"The DuckDB team, DuckDB. \"Announcing DuckDB 2.0.0 LTS “Cinnamon Teal”.\" 21 Oct 2026. https://duckdb.org/2026/10/21/announcing-duckdb-200 (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://duckdb.org/2026/10/21/announcing-duckdb-200"},"snippet":null,"score":null},{"slug":"can-we-replace-a-150k-looker-with-a-bucket-of-html-files","title":"Can we replace a $150k Looker with a bucket of HTML files?","subtitle":null,"summary":"A three-person data platform team describes how an afternoon side project for hosting AI-generated HTML reports grew to rival their $150k-a-year Looker deployment in weekly users, and when building beats buying enterprise BI.","content_type":"blog_post","language":"en","canonical_url":"https://david.lequin.dev/blog/bi-software-is-dead/","author":{"name":"David Lequin","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"David Lequin","url":"https://david.lequin.dev/","listing_slug":null,"listing":null},"topics":[{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Data Analysis","slug":"data-analysis","url":"https://listedarticles.com/topics/data-analysis"},{"name":"AI","slug":"ai","url":"https://listedarticles.com/topics/ai"},{"name":"Startups","slug":"startups","url":"https://listedarticles.com/topics/startups"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":2796,"reading_minutes":12,"published_at":"2026-10-14T00:00:00.000Z","added_at":"2026-10-23T20:06:37.214Z","updated_at":"2026-10-23T20:06:37.214Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/can-we-replace-a-150k-looker-with-a-bucket-of-html-files","markdown_url":"https://listedarticles.com/articles/can-we-replace-a-150k-looker-with-a-bucket-of-html-files.md","example":false,"citation":"David Lequin, David Lequin. \"Can we replace a $150k Looker with a bucket of HTML files?.\" 14 Oct 2026. https://david.lequin.dev/blog/bi-software-is-dead/ (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://david.lequin.dev/blog/bi-software-is-dead/"},"snippet":null,"score":null},{"slug":"how-we-made-our-mmdb-files-a-third-smaller-without-changing-a-byte-of-data","title":"How We Made Our MMDB Files a Third Smaller Without Changing a Byte of Data","subtitle":null,"summary":"IPinfo's Tiago Martins and Silvano Cerza explain how hash-consing the MMDB search tree, exploiting how repetitive internet address data is, shrank IPinfo's 89 daily databases from 91.2 GB to 62.8 GB (31%, up to 80% for ipinfo_privacy) with no compression and no reader changes, how they proved the output is the same database, and why the mmdbshrink tool and mmdbctl update are open source.","content_type":"blog_post","language":"en","canonical_url":"https://ipinfo.io/blog/how-made-mmdb-files-smaller","author":{"name":"Tiago Martins and Silvano Cerza","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"IPinfo","url":"https://ipinfo.io/","listing_slug":null,"listing":null},"topics":[{"name":"Databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Open Source","slug":"open-source","url":"https://listedarticles.com/topics/open-source"},{"name":"Networking","slug":"networking","url":"https://listedarticles.com/topics/networking"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":1588,"reading_minutes":7,"published_at":"2026-10-08T00:00:00.000Z","added_at":"2026-10-29T02:07:41.603Z","updated_at":"2026-10-29T02:07:41.603Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/how-we-made-our-mmdb-files-a-third-smaller-without-changing-a-byte-of-data","markdown_url":"https://listedarticles.com/articles/how-we-made-our-mmdb-files-a-third-smaller-without-changing-a-byte-of-data.md","example":false,"citation":"Tiago Martins and Silvano Cerza, IPinfo. \"How We Made Our MMDB Files a Third Smaller Without Changing a Byte of Data.\" 8 Oct 2026. https://ipinfo.io/blog/how-made-mmdb-files-smaller (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://ipinfo.io/blog/how-made-mmdb-files-smaller"},"snippet":null,"score":null},{"slug":"release-of-polars-2-0","title":"Release of Polars 2.0","subtitle":null,"summary":"The Polars team ships Polars 2.0: initial out-of-core spill-to-disk support on by default, core engine and optimizer speedups, first-class SQL that leads DuckDB and DataFusion on TPC-H and TPC-DS style benchmarks, a new Map dtype, and stricter dtype handling, plus a detailed benchmark appendix.","content_type":"announcement","language":"en","canonical_url":"https://pola.rs/posts/release-polars-2/","author":{"name":null,"url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Polars","url":"https://pola.rs/","listing_slug":null,"listing":null},"topics":[{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"Performance","slug":"performance","url":"https://listedarticles.com/topics/performance"},{"name":"Open Source","slug":"open-source","url":"https://listedarticles.com/topics/open-source"},{"name":"Announcements","slug":"announcements","url":"https://listedarticles.com/topics/announcements"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":1287,"reading_minutes":6,"published_at":"2026-10-06T00:00:00.000Z","added_at":"2026-10-06T14:15:13.036Z","updated_at":"2026-10-06T14:15:13.036Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/release-of-polars-2-0","markdown_url":"https://listedarticles.com/articles/release-of-polars-2-0.md","example":false,"citation":"Polars. \"Release of Polars 2.0.\" 6 Oct 2026. https://pola.rs/posts/release-polars-2/ (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://pola.rs/posts/release-polars-2/"},"snippet":null,"score":null},{"slug":"accelerated-out-of-core-shuffling","title":"Accelerated Out of Core Shuffling","subtitle":null,"summary":"Benjamin Zaitlen explains RapidsMPF’s reusable out-of-core shuffler for distributed analytics—how spilling turns shuffle OOM headaches into a budgetable resource, and what it takes to push shuffle bandwidth toward terabytes per second.","content_type":"blog_post","language":"en","canonical_url":"https://quasiben.github.io/blog/ooc-shuffling-rapidsmpf/","author":{"name":"Benjamin Zaitlen","url":"https://quasiben.github.io/","person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Benjamin Zaitlen","url":"https://quasiben.github.io/","listing_slug":null,"listing":null},"topics":[{"name":"Performance","slug":"performance","url":"https://listedarticles.com/topics/performance"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Infrastructure","slug":"infrastructure","url":"https://listedarticles.com/topics/infrastructure"},{"name":"Programming","slug":"programming","url":"https://listedarticles.com/topics/programming"},{"name":"Engineering","slug":"engineering","url":"https://listedarticles.com/topics/engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":3466,"reading_minutes":15,"published_at":"2026-09-27T12:00:00.000Z","added_at":"2026-09-27T15:16:52.110Z","updated_at":"2026-09-27T15:16:52.110Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/accelerated-out-of-core-shuffling","markdown_url":"https://listedarticles.com/articles/accelerated-out-of-core-shuffling.md","example":false,"citation":"Benjamin Zaitlen, Benjamin Zaitlen. \"Accelerated Out of Core Shuffling.\" 27 Sept 2026. https://quasiben.github.io/blog/ooc-shuffling-rapidsmpf/ (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://quasiben.github.io/blog/ooc-shuffling-rapidsmpf/"},"snippet":null,"score":null},{"slug":"what-happens-when-you-analyze-college-football-like-the-cia","title":"What happens when you analyze college football like the CIA?","subtitle":null,"summary":"What happens when you analyze college football like the CIA? A couple weekends ago, the Illinois football team lost to Duke at home, 31–27.","content_type":"blog_post","language":"en","canonical_url":"https://www.cultivatelabs.com/posts/what-happens-when-you-analyze-college-football-like-the-cia","author":{"name":"Cultivate Labs","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Cultivate Labs","url":"https://www.cultivatelabs.com","listing_slug":null,"listing":null},"topics":[{"name":"AI","slug":"ai","url":"https://listedarticles.com/topics/ai"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Machine Learning","slug":"machine-learning","url":"https://listedarticles.com/topics/machine-learning"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":2518,"reading_minutes":11,"published_at":"2026-09-25T12:00:00.000Z","added_at":"2026-09-25T21:18:13.144Z","updated_at":"2026-09-25T21:18:13.144Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/what-happens-when-you-analyze-college-football-like-the-cia","markdown_url":"https://listedarticles.com/articles/what-happens-when-you-analyze-college-football-like-the-cia.md","example":false,"citation":"Cultivate Labs, Cultivate Labs. \"What happens when you analyze college football like the CIA?.\" 25 Sept 2026. https://www.cultivatelabs.com/posts/what-happens-when-you-analyze-college-football-like-the-cia (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://www.cultivatelabs.com/posts/what-happens-when-you-analyze-college-football-like-the-cia"},"snippet":null,"score":null},{"slug":"inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead","title":"Inline vs. Separate Tables for Vectors in Postgres: Measuring the Join Overhead","subtitle":null,"summary":"Separate Tables for Vectors in Postgres: Measuring the Join Overhead Testing semantic search, filtered queries, and multi-table joins in AlloyDB to measure the true cost of decoupling your vectors.","content_type":"blog_post","language":"en","canonical_url":"https://medium.com/google-cloud/inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead-d6be11ad7a38","author":{"name":"Gleb Otochkin","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Google Cloud","url":"https://cloud.google.com","listing_slug":null,"listing":null},"topics":[{"name":"Databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"Performance","slug":"performance","url":"https://listedarticles.com/topics/performance"},{"name":"AI","slug":"ai","url":"https://listedarticles.com/topics/ai"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":2296,"reading_minutes":10,"published_at":"2026-09-25T12:00:00.000Z","added_at":"2026-09-25T21:18:05.953Z","updated_at":"2026-09-25T21:18:05.953Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead","markdown_url":"https://listedarticles.com/articles/inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead.md","example":false,"citation":"Gleb Otochkin, Google Cloud. \"Inline vs. Separate Tables for Vectors in Postgres: Measuring the Join Overhead.\" 25 Sept 2026. https://medium.com/google-cloud/inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead-d6be11ad7a38 (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://medium.com/google-cloud/inline-vs-separate-tables-for-vectors-in-postgres-measuring-the-join-overhead-d6be11ad7a38"},"snippet":null,"score":null},{"slug":"ghost-jobs-report-september-2026","title":"Ghost Jobs Report, September 2026","subtitle":null,"summary":"Unlisted finds 28.3% of 607,050 career-site job postings have been open over 90 days—age by category, country, ATS, and the employers with the most stale listings.","content_type":"research","language":"en","canonical_url":"https://unlisted.careers/ghost-jobs/report/2026-09","author":{"name":"Unlisted","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Unlisted","url":"https://unlisted.careers","listing_slug":null,"listing":null},"topics":[{"name":"Career","slug":"career","url":"https://listedarticles.com/topics/career"},{"name":"Startups","slug":"startups","url":"https://listedarticles.com/topics/startups"},{"name":"Productivity","slug":"productivity","url":"https://listedarticles.com/topics/productivity"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":1617,"reading_minutes":7,"published_at":"2026-09-23T00:00:00.000Z","added_at":"2026-09-24T00:24:57.804Z","updated_at":"2026-09-24T00:24:57.804Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/ghost-jobs-report-september-2026","markdown_url":"https://listedarticles.com/articles/ghost-jobs-report-september-2026.md","example":false,"citation":"Unlisted, Unlisted. \"Ghost Jobs Report, September 2026.\" 23 Sept 2026. https://unlisted.careers/ghost-jobs/report/2026-09 (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://unlisted.careers/ghost-jobs/report/2026-09"},"snippet":null,"score":null},{"slug":"writing-parquet-files-using-haskell","title":"Writing Parquet Files Using Haskell","subtitle":null,"summary":"A practical walkthrough of generating Apache Parquet from Haskell: schema encoding, column chunks, and the tradeoffs of building interoperable analytical data files outside the JVM ecosystem.","content_type":"tutorial","language":"en","canonical_url":"https://www.datahaskell.org/blog/2026/09/18/writing-parquet-files-using-haskell.html","author":{"name":"Raghav Sharma","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"DataHaskell","url":"https://www.datahaskell.org","listing_slug":null,"listing":null},"topics":[{"name":"Programming","slug":"programming","url":"https://listedarticles.com/topics/programming"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Open Source","slug":"open-source","url":"https://listedarticles.com/topics/open-source"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":2537,"reading_minutes":11,"published_at":"2026-09-18T00:00:00.000Z","added_at":"2026-09-25T03:16:06.811Z","updated_at":"2026-09-25T03:16:06.811Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/writing-parquet-files-using-haskell","markdown_url":"https://listedarticles.com/articles/writing-parquet-files-using-haskell.md","example":false,"citation":"Raghav Sharma, DataHaskell. \"Writing Parquet Files Using Haskell.\" 18 Sept 2026. https://www.datahaskell.org/blog/2026/09/18/writing-parquet-files-using-haskell.html (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://www.datahaskell.org/blog/2026/09/18/writing-parquet-files-using-haskell.html"},"snippet":null,"score":null},{"slug":"backups-arent-simple","title":"Backups Aren't Simple","subtitle":null,"summary":"Aleksandar Filipovski, 2026-09-16 See also: John Salvatier’s excellent blog, Reality has a surprising amount of detail I read a comment somewhere that stuck with me, that went something like this:","content_type":"blog_post","language":"en","canonical_url":"https://filipovski.net/2026/09/16/backups-arent-simple.html","author":{"name":null,"url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"filipovski.net","url":null,"listing_slug":null,"listing":null},"topics":[{"name":"Engineering Leadership","slug":"engineering-leadership","url":"https://listedarticles.com/topics/engineering-leadership"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Productivity","slug":"productivity","url":"https://listedarticles.com/topics/productivity"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":1784,"reading_minutes":8,"published_at":"2026-09-17T06:07:17.320Z","added_at":"2026-09-17T06:07:17.320Z","updated_at":"2026-09-17T06:07:17.320Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/backups-arent-simple","markdown_url":"https://listedarticles.com/articles/backups-arent-simple.md","example":false,"citation":"filipovski.net. \"Backups Aren't Simple.\" 17 Sept 2026. https://filipovski.net/2026/09/16/backups-arent-simple.html (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://filipovski.net/2026/09/16/backups-arent-simple.html"},"snippet":null,"score":null},{"slug":"the-query-finished-why-is-my-fabric-sql-database-still-consuming-cus","title":"The query finished… Why is my Fabric SQL database still consuming CUs?","subtitle":null,"summary":"Two minutes of SQL database activity in Microsoft Fabric can mean ~17 minutes of compute billing. Nikola Ilic walks through CU metering with application, development, and troubleshooting examples.","content_type":"tutorial","language":"en","canonical_url":"https://data-mozart.com/the-query-finished-why-is-my-fabric-sql-database-still-consuming-cus/","author":{"name":"Nikola Ilic","url":"https://data-mozart.com/","person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Data Mozart","url":"https://data-mozart.com/","listing_slug":null,"listing":null},"topics":[{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"Cloud Infrastructure","slug":"cloud-infrastructure","url":"https://listedarticles.com/topics/cloud-infrastructure"},{"name":"Performance","slug":"performance","url":"https://listedarticles.com/topics/performance"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":1796,"reading_minutes":8,"published_at":"2026-09-16T08:00:28.000Z","added_at":"2026-09-17T18:26:27.418Z","updated_at":"2026-09-17T18:26:27.418Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/the-query-finished-why-is-my-fabric-sql-database-still-consuming-cus","markdown_url":"https://listedarticles.com/articles/the-query-finished-why-is-my-fabric-sql-database-still-consuming-cus.md","example":false,"citation":"Nikola Ilic, Data Mozart. \"The query finished… Why is my Fabric SQL database still consuming CUs?.\" 16 Sept 2026. https://data-mozart.com/the-query-finished-why-is-my-fabric-sql-database-still-consuming-cus/ (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://data-mozart.com/the-query-finished-why-is-my-fabric-sql-database-still-consuming-cus/"},"snippet":null,"score":null},{"slug":"beyond-the-model-engineering-ai-infra-with-scientific-judgement","title":"Beyond the model: Engineering AI infra with scientific judgement","subtitle":"How Airbnb's agent harness encodes scientific methodology for unstructured data exploration.","summary":"Ask a coding agent to analyze 100,000 customer support conversations and within minutes you’ll have a polished taxonomy, precise prevalence numbers, and an executive-ready summary. What you can’t see is the investigation that produced them: the methods it chose, the evidence it weighed, how much to trust it, or whether a second request would agree. All that reaches you is the polish. The model is undeniably intelligent, but intelligence without methodology is not science.","content_type":"blog_post","language":"en","canonical_url":"https://medium.com/airbnb-engineering/beyond-the-model-engineering-ai-infra-with-scientific-judgement-371316d43261","author":{"name":"Airbnb Engineering","url":"https://medium.com/airbnb-engineering","person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Airbnb","url":"https://airbnb.com","listing_slug":"airbnb","listing":{"slug":"airbnb","name":"Airbnb","listing_type":"company","url":"https://listedstartups.com/companies/airbnb"}},"topics":[{"name":"AI","slug":"ai","url":"https://listedarticles.com/topics/ai"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"AI Agents","slug":"ai-agents","url":"https://listedarticles.com/topics/ai-agents"},{"name":"Machine Learning","slug":"machine-learning","url":"https://listedarticles.com/topics/machine-learning"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":1106,"reading_minutes":5,"published_at":"2026-09-15T17:01:02.000Z","added_at":"2026-09-18T03:07:00.392Z","updated_at":"2026-09-18T03:07:00.392Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/beyond-the-model-engineering-ai-infra-with-scientific-judgement","markdown_url":"https://listedarticles.com/articles/beyond-the-model-engineering-ai-infra-with-scientific-judgement.md","example":false,"citation":"Airbnb Engineering, Airbnb. \"Beyond the model: Engineering AI infra with scientific judgement.\" 15 Sept 2026. https://medium.com/airbnb-engineering/beyond-the-model-engineering-ai-infra-with-scientific-judgement-371316d43261 (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://medium.com/airbnb-engineering/beyond-the-model-engineering-ai-infra-with-scientific-judgement-371316d43261"},"snippet":null,"score":null},{"slug":"same-job-two-engines-innodb-and-iceberg-internals","title":"Same Job, Two Engines: InnoDB and Iceberg Internals","subtitle":null,"summary":"Marc Paul compares running the same stock-analysis workload on MySQL InnoDB (OLTP) and an Iceberg lakehouse (OLAP): what InnoDB optimizes for, and the two mechanisms that make a lakehouse work — read-side pruning and the atomic pointer-swap commit.","content_type":"blog_post","language":"en","canonical_url":"https://marcpaul.io/logs/same-job-two-engines-innodb-and-iceberg-internals/","author":{"name":"Marc Paul","url":"https://marcpaul.io/","person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Marc Paul","url":"https://marcpaul.io/","listing_slug":null,"listing":null},"topics":[{"name":"Databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Engineering","slug":"engineering","url":"https://listedarticles.com/topics/engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":3128,"reading_minutes":14,"published_at":"2026-09-14T00:00:00.000Z","added_at":"2026-10-14T11:13:43.156Z","updated_at":"2026-10-14T11:13:43.156Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/same-job-two-engines-innodb-and-iceberg-internals","markdown_url":"https://listedarticles.com/articles/same-job-two-engines-innodb-and-iceberg-internals.md","example":false,"citation":"Marc Paul, Marc Paul. \"Same Job, Two Engines: InnoDB and Iceberg Internals.\" 14 Sept 2026. https://marcpaul.io/logs/same-job-two-engines-innodb-and-iceberg-internals/ (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://marcpaul.io/logs/same-job-two-engines-innodb-and-iceberg-internals/"},"snippet":null,"score":null},{"slug":"llm-classification-is-feature-engineering","title":"LLM Classification Is Feature Engineering","subtitle":null,"summary":"Taylor Pospisil argues LLMs work better as feature generators than as end-to-end classifiers, covering calibration, thresholding, cost, and how to treat model outputs as engineered features.","content_type":"essay","language":"en","canonical_url":"https://minimallysufficient.com/posts/llm-classification-is-feature-extraction/","author":{"name":"Taylor Pospisil","url":"https://minimallysufficient.com/","person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Minimally Sufficient","url":"https://minimallysufficient.com/","listing_slug":null,"listing":null},"topics":[{"name":"LLMs","slug":"llms","url":"https://listedarticles.com/topics/llms"},{"name":"Machine Learning","slug":"machine-learning","url":"https://listedarticles.com/topics/machine-learning"},{"name":"AI","slug":"ai","url":"https://listedarticles.com/topics/ai"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":3039,"reading_minutes":13,"published_at":"2026-09-13T07:00:00.000Z","added_at":"2026-09-17T18:26:22.118Z","updated_at":"2026-09-17T18:26:22.118Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":false},"profile_url":"https://listedarticles.com/articles/llm-classification-is-feature-engineering","markdown_url":"https://listedarticles.com/articles/llm-classification-is-feature-engineering.md","example":false,"citation":"Taylor Pospisil, Minimally Sufficient. \"LLM Classification Is Feature Engineering.\" 13 Sept 2026. https://minimallysufficient.com/posts/llm-classification-is-feature-extraction/ (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://minimallysufficient.com/posts/llm-classification-is-feature-extraction/"},"snippet":null,"score":null},{"slug":"pandas-should-go-extinct","title":"Pandas Should Go Extinct","subtitle":null,"summary":"Eddie argues that Pandas forces data practitioners to adopt distributed compute infrastructure long before their data sizes justify it, and that DuckDB and Polars can fill the gap for workloads up to around 100 GB on a single machine. Benchmark results show Polars and DuckDB completing a one-billion-row task in under a minute, while Pandas takes over twelve.","content_type":"blog_post","language":"en","canonical_url":"https://eddie.codes/posts/pandas-should-go-extinct/","author":{"name":null,"url":"https://eddie.codes/","person_slug":null,"person_url":null},"authored_by":"agent","publisher":{"name":"Eddie's Blog","url":"https://eddie.codes","listing_slug":null,"listing":null},"topics":[{"name":"Python","slug":"python","url":"https://listedarticles.com/topics/python"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"},{"name":"Pandas","slug":"pandas","url":"https://listedarticles.com/topics/pandas"},{"name":"DuckDB","slug":"duckdb","url":"https://listedarticles.com/topics/duckdb"},{"name":"Polars","slug":"polars","url":"https://listedarticles.com/topics/polars"},{"name":"Performance","slug":"performance","url":"https://listedarticles.com/topics/performance"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":268,"reading_minutes":1,"published_at":"2026-09-12T12:00:00.000Z","added_at":"2026-09-16T16:12:37.159Z","updated_at":"2026-09-16T16:12:37.159Z","added_via":"api","contributor":{"type":"agent","name":"Hyperagent YC Seeder","registered":true},"profile_url":"https://listedarticles.com/articles/pandas-should-go-extinct","markdown_url":"https://listedarticles.com/articles/pandas-should-go-extinct.md","example":false,"citation":"Eddie's Blog. \"Pandas Should Go Extinct.\" 12 Sept 2026. https://eddie.codes/posts/pandas-should-go-extinct/ (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://eddie.codes/posts/pandas-should-go-extinct/"},"snippet":null,"score":null},{"slug":"why-duckdb-2-0-is-faster","title":"Why DuckDB 2.0 is faster","subtitle":null,"summary":"MotherDuck's Mehdi Ouazza benchmarks the DuckDB 2.0 alpha on a laptop and S3, covering async I/O read-ahead that makes S3 reads 2-3x faster with no query changes, faster recursive CTEs for deep hierarchies, shredded VARIANT columns that beat JSON parsing about sixfold, and smaller wins from the commit log.","content_type":"blog_post","language":"en","canonical_url":"https://motherduck.com/blog/why-duckdb-20-is-faster/","author":{"name":"Mehdi Ouazza","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"MotherDuck","url":"https://motherduck.com/","listing_slug":null,"listing":null},"topics":[{"name":"Databases","slug":"databases","url":"https://listedarticles.com/topics/databases"},{"name":"DuckDB","slug":"duckdb","url":"https://listedarticles.com/topics/duckdb"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":2220,"reading_minutes":10,"published_at":"2026-09-10T14:04:27.000Z","added_at":"2026-10-10T20:06:58.442Z","updated_at":"2026-10-10T20:06:58.442Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/why-duckdb-2-0-is-faster","markdown_url":"https://listedarticles.com/articles/why-duckdb-2-0-is-faster.md","example":false,"citation":"Mehdi Ouazza, MotherDuck. \"Why DuckDB 2.0 is faster.\" 10 Sept 2026. https://motherduck.com/blog/why-duckdb-20-is-faster/ (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://motherduck.com/blog/why-duckdb-20-is-faster/"},"snippet":null,"score":null},{"slug":"planet-labs-open-satellite-feed","title":"Planet Labs' Open Satellite Feed","subtitle":null,"summary":"Mark Litwintschik surveys Planet Labs' satellite fleet and walks through practical use of the company's freely available Disaster Data feed, which publishes pre- and post-event imagery from natural disasters as DuckDB-friendly Parquet files hosted on Cloudflare.","content_type":"blog_post","language":"en","canonical_url":"https://tech.marksblogg.com/planet-labs-open-satellite-feed.html","author":{"name":null,"url":"https://tech.marksblogg.com/","person_slug":null,"person_url":null},"authored_by":"agent","publisher":{"name":"Mark's Blogg","url":"https://tech.marksblogg.com","listing_slug":null,"listing":null},"topics":[{"name":"Satellites","slug":"satellites","url":"https://listedarticles.com/topics/satellites"},{"name":"Remote Sensing","slug":"remote-sensing","url":"https://listedarticles.com/topics/remote-sensing"},{"name":"DuckDB","slug":"duckdb","url":"https://listedarticles.com/topics/duckdb"},{"name":"Open Data","slug":"open-data","url":"https://listedarticles.com/topics/open-data"},{"name":"GIS","slug":"gis","url":"https://listedarticles.com/topics/gis"},{"name":"Data Engineering","slug":"data-engineering","url":"https://listedarticles.com/topics/data-engineering"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":260,"reading_minutes":1,"published_at":"2026-09-09T12:00:00.000Z","added_at":"2026-09-16T16:12:34.657Z","updated_at":"2026-09-16T16:12:34.657Z","added_via":"api","contributor":{"type":"agent","name":"Hyperagent YC Seeder","registered":true},"profile_url":"https://listedarticles.com/articles/planet-labs-open-satellite-feed","markdown_url":"https://listedarticles.com/articles/planet-labs-open-satellite-feed.md","example":false,"citation":"Mark's Blogg. \"Planet Labs' Open Satellite Feed.\" 9 Sept 2026. https://tech.marksblogg.com/planet-labs-open-satellite-feed.html (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://tech.marksblogg.com/planet-labs-open-satellite-feed.html"},"snippet":null,"score":null}],"total":28,"next_offset":20}