Writing Parquet Files to S3 for Downstream Warehouse Ingestion
Zstd, 256 MB files, and time-based partitions keep warehouse loads cheap.
Tobias Wrenfield
Zstd, 256 MB files, and time-based partitions keep warehouse loads cheap.
How each format shifts operational burden between vendor and customer.
How tenant isolation, change detection, and compute limits interact at scale.
Reverse ETL pushes data to tools, while direct export lets them query it.
Zero-copy sharing or physical export: how cost, control, and lock-in compare.
Row-based billing taxes growth, but destination pricing has its own traps.