Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
Kafka Is Not a Database
Get insights on Materialize's latest updates & trends in streaming databases & data products.
Glom – Restructured Data for Python
Thoughts on FOSS and fintech, layered by Mahmoud Hashemi
Postgres full-text search: A search engine in a database (2021)
With Postgres, you don't need to immediately look farther than your own database management system for a full-text search solution. If you haven't yet given Postgres' built-in full-text search a try, read on for a simple intro.
Postgres Auditing in 150 lines of SQL
PostgreSQL has a robust set of features which we can leverage to create a generic auditing solution in 150 lines of SQL.
Understanding Parquet, Iceberg and Data Lakehouses
In the past few years, I've heard a lot about Avro, Parquet, ORC, Arrow and Feather, but I also keep hearing about Iceberg and Delta Lake. As a "database person", I’ve been struggling to understand all of these different things, and how they relate to Data Lakes and
Securing a Postgres Database
A comprehensive overview of the best practices for securing access to PostgreSQL databases.
A Data-Driven Guide to Becoming a Consistent Billionaire
Did You Really Think All Billionaires Were the Same? Recently, I became a bit obsessed with the one percent of the one percent – Billionaires. I was intrigued when I stumbled on articles telling us…
TIL–Python has a built-in persistent key-value store (2018)
Simplex Sigillum Veri
Google Cloud Spanner is now half the cost of Amazon DynamoDB
Alongside lower costs, Cloud Spanner provides single-digit ms latencies and strong consistency across multiple availability zones in the same region.
Do you even need a database?
We built the same HTTP server in Go, Bun, and Rust using two storage strategies: read the file on every request, or load everything into memory. Then we ran real benchmarks. The results are more interesting than you'd expect.
President Signs Government-Wide Open Data Bill
The Data Coalition is dedicated to improving government, business, and society through open data and evidence-informed public policy
Why DuckDB is my first choice for data processing
Why DuckDB has become my go-to tool for data processing, offering simplicity, speed, and powerful features.
The pedantic checklist for changing your data model in a web application
Let's say you have a web app with some database. In your database you have an Invoice model, where you store things you are charging your customers.
Hstore development for 9.4 release
I returned back home from PGCon.EU-2013 conference, Dublin, Ireland, where we gave two talks - Next Generation of GIN and Binary storage for nested data structures and application to hstore data type . These projects as well as visiting the conference (I, Teodor Sigaev and Alexander Korotkov) were…
AWS AppSync – Build data-driven apps with real-time and off-line capabilities
September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. In this day and age, it is almost impossible to do without our mobile devices and the applications that help make our lives easier. As our dependency on our mobile phone grows, the mobile application market has…
Electric (Postgres sync engine) beta release
The Electric sync engine is now in BETA. If you haven't checked out Electric recently, it's a great time to take another look.
CockroachDB beta-20161013
CockroachDB is a distributed SQL database, loosely patterned after Google Spanner and designed for semi-synchronous networks. It speaks the PostgreSQL wire protocol , supports a reasonable dialect of SQL , and combines replication for durability with transparent scale-out sharding for large tables. Its most…
My ridiculously robust photo management system (Immich edition)
How I added Immich to my already robust photo management system to make it ridiculously robust.
Bayesian Statistics: The three cultures
A traditional subjective Bayesian will assume a data generating distribution (aka a likelihood when viewed as a function of the parameters). Then, conditional on this assumption, they encode their prior beliefs as a prior distribution over parameters. After this, they turn the crank on posterior inference and don’t…
The LZ4 introduced in PostgreSQL 14 provides faster compression
Haiying Tang takes you on a tour of LZ$ TOAST, the new column opton compression in PostgreSQL 14, and shows the speed and compression ratio gains.
Contextual Retrieval
Contextual retrieval improves how AI systems access and use information, reducing retrieval failures in large knowledge bases.
I analyzed chord progressions in 680k songs
And the results surprised me
TimescaleDB raises $40M
We just raised a $40M Series B to bring our relational database for time-series to developers everywhere. Learn how we got started and what’s still yet to come.
Charts built for Chat
We're open sourcing dbt Charts, a declarative language for dashboards, so that even the dashboards you build by chatting with an agent can be governed.
ORMs Are Backwards
Not bad just backwards