Simon Willison's TILs personal blog

Summing columns in remote Parquet files using DuckDB

vivym/midjourney-messages on Hugging Face is a large (~8GB) dataset consisting of 55,082,563 Midjourney images - each one with the prompt and a URL to the image hosted on Discord.
Points
146
HN comments
75
Submissions
1
Cited by
0 commenters

Databases & DataTools & Productivity2023

On Hacker News

SubmittedTitle on HNPointsComments
Nov 14, 2023Summing columns in remote Parquet files using DuckDB by simonw14675

More from Simon Willison's TILs

All 13 posts →

Related posts from the same era