Is the "modern data stack" still a useful idea?
My vote: no.
Topics /
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
My vote: no.
Why Postgres postmaster contention becomes a bottleneck at scale, how connection bursts and worker churn trigger it, and which fixes helped in production.
We're proud to announce that Apache Airflow 2.0.0 has been released.
Learn how to use PostgreSQL with the Go programming language using the pgx driver and toolkit in a very productive manner. Furthermore, with the provided source code, you'll be able to learn how to write efficient and sound unit and integration tests, ready to be run locally or on a Continuous Integration environment…
It’s funny. I’m the statistician, but I’m more skeptical about statistics, compared to these renowned scientists.
What Observability 2.0 means in practice, how wide events replace siloed metrics/logs/traces, and why GreptimeDB is purpose-built as the database foundation.
Why and how I migrated from distributed postgres to distributed sqlite on kentcdodds.com
Shortly after I started Per Square Mile, I produced an infographic that showed how big a city would have to be to house the world’s 7 billion people.
Deno KV, the easiest way to add a strongly consistent database to your app, is now in open beta.
Learn how to download fundamentals data with Python using the yahoo_fin package, including P/E and P/S ratios, return on equity, and more.
Something I didn't understand for a while is that the process of turning row-oriented data into column-oriented data isn't a totally bespoke, foreign concept...
In a previous article, I introduced what is new in SQL:2023. Now I want to show the status of SQL:2023 support in PostgreSQL. See the previous article for details on these features.
DuckDB, a free and open source analytical data management system, can run SQL queries directly on Parquet files and automatically take advantage of the advanced features of the Parquet format.
How we built our first iteration of content matching at Canva.
In the era of big data and AI, many data-intensive applications exhibit requirements that cannot be satisfied by traditional batch processing models. Streaming applications, such as click stream analytics , IoT data processing, network monitoring , or financial fraud detection , must support high processing rates…
Dash knows your context, your team, and your work, so your team can stay organized, easily find and share knowledge, and keep projects secure, all from one place.
DuckDB, a free and open-source analytical data management system, has a new highly efficient parallel sorting implementation that can sort much more data than fits in main memory.
An exploration of NFL play-by-play statistics with Bokeh and Pandas.
Alexander Spangher discusses recent work that’s been done to revamp our article recommendation algorithm.
Documenting a pattern for making multi-tenant applications global by distributing the data, using only standard PostgreSQL functionality.
In many information systems, we work with arrays of integers. For example, maybe you need to keep track of which records in a database contain a given value. This sort of mapping can be expressed as an array of integers. These arrays can end up taking up a large fraction of your memory or disk … Continue reading…
Go inside the WAL file with this in-depth look at WAL file Log Sequence Number (LSN), WAL segment positions, WAL file names, and pg_switch_wal.
Today is Y Combinator’s 25th Demo Day. With 124 companies presenting over the next two days, this is the largest Demo Day in YC’s 12.5 year history. We wanted to share some stats about YC and about the batch. For the more visually inclined, see the graphic below created by YC alum SketchDeck…