151
How PostgreSQL aggregation works and how it inspired our hyperfunctions’ design
A discussion of aggregation in PostgreSQL and how it integrates with the design of Timescale’s hyperfunctions.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 314 posts.
152
153
No general method to detect fraud
The parts of a convincing deception
154
Redis Anti-Patterns
Learn to dodge common Redis pitfalls like large keys and hot keys. Boost both your performance and stability. Try it today.
155
Breakdown of data on homeless populations across the U.S.
Many people see a homelessness crisis, but what does the data say? We examine different locations, rates of change, types of homelessness, and mental health and substance abuse issues.
156
Web Applications from the Future: A Database in the Browser
If progress follows it's usual strategy, then whatever is difficult and valuable to do today will become easy and normal tomorrow. I imagine we'll discover new abstractions, which will make writing Google Docs as easy as the average web app is today.
157
158
How we achieved write speeds of 1.4M rows per second
The detailed story of how to build a vector-based storage model from scratch.
159
Zero-downtime schema migrations in Postgres using views
Schema migrations are tricky, especially when planned downtime is not an option. Changes need to be carefully designed to stay backwards compatible so that…
160
How to create a 1M record table with a single query
With recursive CTE and randomized data.
161
Rqlite 6.0: the evolution of a distributed database design
rqlite is a lightweight, open-source, distributed relational database written in Go, which uses SQLite as its storage engine. v6.0.0 is out now and makes clustering more robust. It also lays the foundation for more important features. What's new in 6.0? 6.0 multiplexes multiple logical connections between rqlite nodes…
162
Encoding Data in Dubstep Drops
[Warning: Those who can’t stand EDM/dubstep, oh boy do I have bad news for you in regards to this blog post]
163
How We Proved the Eth2 Deposit Contract Is Free of Runtime Errors
Consensys is a blockchain software company building the tools, infrastructure and research that power the new Era of Decentralized Finance, for a more secure and open economy
164
Index bloat reduced in PostgreSQL v14
This article describes how PostgreSQL v14 reduces B-tree index bloat with "bottom-up index tuple deletion". A test case shows the difference.
165
Using a disk-based Redis clone to reduce AWS S3 bill
Using SSDB to solve the Redis RAM limitation.
166
Wikidata or Scraping Wikipedia
Yesterday I was pointed to a blog post describing how to answer an interesting project: how many generations from Alfred the Great to Elizabeth II ? Alfred the Great was a king in England at the end of the 9th century, and Elizabeth II is the current Queen of England (and a bit more).
167
Why we spent the last month eliminating PostgreSQL subtransactions
How a mysterious stall in database queries uncovered a performance limitation with PostgreSQL.
168
New Machine Learning Gems for Ruby
In August, I set out to improve the machine learning ecosystem for Ruby and wasn’t sure where it would go. Over the next 5 months, I ended up...
169
Common data model mistakes made by startups
Data modeling is hard. Here are some missteps to avoid when you're developing your models.
170
Is BI dead? – On dismantling data's ship of Theseus
On dismantling data's ship of Theseus.
171
Postgres audit tables saved us from taking down production
Learn how audit tables helped us avoid a serious incident, and how you can create audit tables in your own Postgres databases.
172
How to make any immutable data structure distributed
Spark-style distributed datasets can be modeled with a few lines of code, using Unison's distributed computing library. This article teaches you how.
173
Building a recommendation engine inside Postgres with Python and Pandas (2020)
Learn how you can leverage Python and Pandas from directly inside PostgreSQL to build your own recommendation engine.
174
What time-weighted averages are and why you should care
Learn how time-weighted averages are calculated and why they’re so powerful for data analysis. Read the full article on the Tiger Data blog.
175
176
We need new data books, so we published one
A site around enabling companies and knowledge workers to be informed and enabled with the data they need for their work.
177
Amazon S3 Object Lambda
March 15, 2023 – You can now use S3 Object Lambda with Amazon CloudFront to tailor content for end users. August 13, 2024 – Added a note clarifying that, when following the walkthrough, you should not mark the Specify Lambda function version option that was added after this post was published. When you store data in…
178
Tao: Facebook’s distributed data store for the social graph
The papers over the next few weeks will be from (or related to) research from VLDB 2021 - on the horizon is one of my favorite systems conferences SOSP . As always, feel free to reach out on Twitter with feedback or suggestions about papers to read! These paper reviews can be delivered weekly to your inbox , or you…
179
Open-Source Babelfish for Postgres
Babelfish for PostgreSQL is an Apache-2.0 and PostgreSQL open source project that adds a Microsoft SQL Server-compatible end-point to PostgreSQL to enable your PostgreSQL database to understand the SQL Server wire protocol and commonly used SQL Server commands.
180
Realtime Postgres Row Level Security
Realtime database changes are now broadcast to authenticated users, respecting the same PostgreSQL policies that you use for Row Level Security.