3391
Can GROUP BY still be optimized after all these years?
An optimization that made Pivot significantly faster on GROUP BY queries with a Top-K operator above them, and a walkthrough of how analytical databases run GROUP BY in the first place.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
3392
3393
Faster PostgresSQL to BigQuery Transfers
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
3394
Prolly Trees
A deep dive into the Probabilistic B-tree or Prolly Tree data structure including examples. Prolly Trees are used to create version controlled databases.
3395
3396
Applied Monotonicity: A Brief History of CRDTs in Riak
RiakAround 2013, Riak was at the forefront of Conflict-Free Replicated Data Type (CRDT) development with the engineers at Basho Technologies working hard to integrate efficient, usable CRDTs from t...
3397
Merklizing the key/value store for fun and profit
Joel Gustafson
3398
Analyzing and breaking an externally encrypted HDD
Analyzing and breaking external encrypted HDD has been a “hobby” of mine for quite some time. With my colleagues Joffrey Czarny and Julien Lenoir we looked at several models in the past :
3399
3400
Words growing or shrinking in Hacker News titles: a tidy analysis
In May, some friends and I built Tagger News, a real-time automatic classifier of Hacker News articles based on their text (see here for more about how we built it). This process started me down some interesting paths, particularly analyzing trends in titles. By finding words that became more or less common in Hacker…
3401
Getting Started with QGIS, PostgreSQL and PostGIS
Visualizing spatial data is an important task. This tutorial helps you with getting started with visualizing OSM data with PostGIS and QGIS.
3402
3403
Do you really need foreign keys?
Foreign keys are a bit like that well-intentioned friend who insists on double-checking everything you do. They’re often recommended as a must-have for enforcing referential integrity checks in your database.
3404
3405
A sequel to SQL? An intro to Malloy
Homepage of Carlin Eng
3406
3407
Taxi, Uber, and Lyft Usage in New York City
Open NYC data reveals the taxi industry’s contraction, Uber’s growth, and the scramble for market share
3408
How do cash transfers impact the people who don’t receive them? (2019)
GiveDirectly partnered with academic researchers to find out how cash transfers affect local economies, including nearby non-recipients. Read the results.
3409
A little bit of the one-time MacOS version still lingers in ZFS
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
3410
3411
Prime Day 2017: 12.9M DynamoDB requests per second
The third annual Prime Day set another round of records for global orders, topping Black Friday and Cyber Monday, making it the biggest day in Amazon retail history. Over the course of the 30 hour event, tens of millions of Prime members purchased things like Echo Dots, Fire tablets, programmable pressure cookers…
3412
The PostgreSQL documentation and the limitations of community
In my opinion, the PostgreSQL documentation is simultaneously excellent and fairly poor, and both its excellence and its shortcomings are di...
3413
We collected 10k hours of neuro-language data in our basement
Over the last 6 months, we collected ~10k hours of data across thousands of unique individuals. As far as we know, this is the largest neuro-language dataset in the world. [1] See here , here , here , here , and here (discussion only, no data available) for some of the larger datasets. See recent papers discussing the…
3414
3415
Streaming joins are hard
Why are streaming joins so tricky? Discover the hidden complexities of real-time data, and learn how to tame the infinite stream!
3416
TimescaleDB 2.7 vs. PostgreSQL 14
TimescaleDB expands PostgreSQL query performance by 1000x, reduces storage utilization by 90%, and provides time-saving features for time-series and analytical.
3417
3418
Kids these days: the quality of new Wikipedia editors over time
As part of the 2011 Wikimedia Summer of Research, we uncovered a possible correlation between the decline in new active editors that began in 2007 and the rise of warnings issued to new users by bo…
3419
Pg_ClickHouse: A Postgres extension for querying ClickHouse
Today, we’re pleased to release pg_clickhouse, an Apache 2-licensed PostgreSQL extension to transparently execute analytics queries on ClickHouse directly from PostgreSQL.
3420