Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 2,337 posts.
Sorry ARIMA, but I’m Going Bayesian
When people think of “data science” they probably think of algorithms that scan large datasets to predict a customer’s next move or interpret unstructured te...
Demystifying Database Performance for Developers
For developers, databases are basically magic. Like Penn & Teller, this blog post is set to break the illusion. Databases are just like any other code, they have algorithms and processes. These algorithms and processes are meant to improve performance, but can cause limitations if they are not expected.
Parallelism in PostgreSQL
Parallelism in PostgreSQL was implemented as part of multiple features which cover sequential scans, aggregates, and joins.
What time-weighted averages are and why you should care
Learn how time-weighted averages are calculated and why they’re so powerful for data analysis. Read the full article on the Tiger Data blog.
Rules of schema growth (2017)
The free database designed for immutable values and a time-aware information model.
PostgreSQL 13 Beta 1 Released
The PostgreSQL Global Development Group announces that the first beta release of PostgreSQL 13 is now [available for download](https://www.postgresql.org/download/). This …
Data looks better naked
Rather than dressing data up, strip it down—remove to improve.
Billions of Messages a Day – Yelp's Real-Time Data Pipeline
Billions of Messages a Day - Yelp's Real-time Data Pipeline Justin C., Software Engineer Jul 14, 2016 This post is part of a series covering Yelp's real-time streaming data infrastructure....
Elasticsearch – the definitive guide
Powered by Elasticsearch. Ready to deploy your data? Start free.
Mode Studio – Python, R and SQL Editor
Today, we're releasing two of the biggest updates in Mode's history, designed not only to make Mode more powerful, but also to make that power accessible to everyone.
Vectors are over, hashes are the future
Get an introduction into the thinking behind the rise of neural hashing technology — and learn why this may end up being an enormous shift in AI advancement.
Jepsen: Scylla 4.2-rc3
Scylla is a distributed wide-column 1 database which originated as a C++ port of Cassandra, aiming for improved performance. It supports both Cassandra- and DynamoDB -compatible APIs, and is intended for high-throughput, low-latency workloads, including analytics, messaging, and other time-series data.
Lucene: The Good Parts
Before MongoDB, before Cassandra, before “NoSQL”, there was Lucene. Did you know that Doug Cutting wrote the first versions of …
A Performance Cheat Sheet for PostgreSQL
Performance tuning is not trivial, but you can go a long way with a few basic guidelines. In this blog, we will discuss how you analyze the workload of the database, and then review a list of important configuration parameters to improve the performance of PostgreSQL.
Inside Cloud Spanner and the CAP Theorem
Building systems that manage globally distributed data, provide data consistency and are also highly available is really hard. The beauty of the cloud is that someone else can build that for you.
Google Cloud SQL now supports PostgreSQL 13
Fully managed Cloud SQL cloud database service now supports PostgreSQL 13.
Using SIMD to aggregate billions of values per second
How SIMD instructions make aggregations faster in QuestDB, including benchmark results and a comparison with Postgres.
A distributed queue in a single JSON file on object storage
How to build a single global queue for distributed systems on object storage: Start with a single file on object storage, then add write batching, a stateless broker, and high-availability.
We need new data books, so we published one
A site around enabling companies and knowledge workers to be informed and enabled with the data they need for their work.
Jepsen: TiDB 2.1.7
In 2010, Google engineers Daniel Peng & Frank Dabek published Large-scale Incremental Processing Using Distributed Transactions and Notifications , which described Percolator: a Google-internal database for random access transactional workloads where low latencies are not required. Percolator uses a global…
Study: carpooling apps could reduce traffic 3x in NYC
Traffic is not just a nuisance for drivers: it’s also a public-health hazard and bad news for the economy. Transportation studies put the annual cost of congestion at $160 billion , which includes 7 billion hours of time lost to sitting in traffic and an extra 3 billion gallons of fuel burned. One way to improve…
Amazon S3 Object Lambda
March 15, 2023 – You can now use S3 Object Lambda with Amazon CloudFront to tailor content for end users. August 13, 2024 – Added a note clarifying that, when following the walkthrough, you should not mark the Specify Lambda function version option that was added after this post was published. When you store data in…