Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
US Presidential Election $25k Database Bounty Review
Blog for DoltHub, a website hosting databases made with Dolt, an open-source version-controlled SQL database with Git-like semantics.
Introducing HypoPG, hypothetical indexes for PostgreSQL
_Paris, June 24 2015_ DALIBO is proud to present the first release of HypoPG, an extension that adds hypothetical indexes …
Postgres 15 Merge Command with Examples
We’re excited about the MERGE command in PostgreSQL 15. We have some ideas about using it for data loading with an example use case for remote sensors.
Modern Text Features in R
ragg has taken a major leap forward in text-rendering capabilities with the latest releases of systemfonts, textshaping, and ragg itself. This post will go into detail with what is now possible and how it compares to the build in devices.
Data Factories
Facebook and Google and other advertising businesses are data factories, and regulation will be most effective if it lets users look inside
Knowledge Graphs in RAG: Hype vs. Ragas Analysis
A deep dive on Microsoft's GraphRAG paper found questionable metrics with vaguely defined lift, so I analyzed knowledge graphs in RAG overall using Neo4j vs FAISS
Trade-offs between Different CRDTs
🔰If CRDTs are new to you, here are some introductory links. - An interactive intro to CRDTs - An introduction to state-based CRDTs - CRDTs for non-academics - CRDT: The Hard Parts - Readings in CRDTs - crdt.tech What are the trade-offs between different kinds of CRDTs (Conflict-free Replicated
Let's Build PlanetScale from Scratch: Infrastructure
Homescale, PlanetScale at home.
Haunted by Data
This is the text version of a talk I gave on October 1, 2015, at the Strata+Hadoop World conference in New York City. The video version is here (20 mins).
What MongoDB got right
MongoDB is perhaps the most-widely-mocked piece of software out there right now. While some of the mockery is out-of-date or rooted in misunderstandings, much of it is well-deserved, and it’s difficult to disagree that much of MongoDB’s engineering is incredibly simplistic, inefficient, and immature compared to…
What's left of NoSQL?
What’s left of NoSQL if they start adding ACID and SQL support?
Sharding Pinterest: How we scaled our MySQL fleet
Building the platform where people around the world come to search, save and shop
AlloyDB Omni – run AlloyDB anywhere
Today, we’re excited to announce the technology preview of AlloyDB Omni, a downloadable edition of AlloyDB designed to run on premises, at the edge, across clouds, or even on developer laptops.
SQLite: Infinite loop due to the ‘order by limit’ optimization
Verify that you are human by typing in the 8-character text password shown below.
No, QuestDB is not Faster than ClickHouse
QuestDB created a minor stir in the small but active world of analytics database benchmarking with this blog article: https://questdb.io/blog/2022/05/26/query-benchmark-questdb-versus-clickhouse-timescale. This is the money quote: “QuestDB is an order of magnitude faster than both TimescaleDB and ClickHouse in this…
The HDFS Juggernaut
There's been much focus on MongoDB, Elastic and Redis in terms of data exposure on the Internet due to their general popularity in the developer community. However, in terms of data volume it turns out that HDFS is the real juggernaut. To give you a better idea here's a quick
Apache Arrow 4.0
The Apache Arrow team is pleased to announce the 4.0.0 release. This covers 3 months of development work and includes 711 resolved issues from 114 distinct contributors. See the Install Page to learn how to get the libraries for your platform. The release notes below are not exhaustive and only expose selected…
The PlanetScale serverless driver for JavaScript
You can now use PlanetScale in HTTP-only environments like Cloudflare Workers, Vercel Edge Functions, and Netlify Edge Functions.
The new local data stack: Integrating Dagster, dbt and DuckDB
Lean and efficient MDS experience: Delivers better software engineering practices to the data ecosystem with the new local MDS stack comprised of Dagster, dbt and DuckDB which offers better developer productivity by enhancing testability of the E2E pipeline.
A Data Pipeline Is a Materialized View
Say you run an online book store and want to build a data pipeline that figures out who the top-selling authors are. Logically, the input to the pipeline is a log of every individual book purchase on the store for all time, along with details about each book like who authored it. And the output is a list of the…
Cargo cult data science
Data science as a cargo cult
What it means to be a Postgres extension
Because Citus is an extension to PostgreSQL and not a fork, the effort required to remain compatible with the latest versions of the open source PostgreSQL database has been dramatically reduced. After a new PostgreSQL version is released, Citus packages are often updated and in sync within days.