661
Migrating to Postgres
Since early 2022, Motion was on CockroachDB. Cockroach has many qualities going for it: effortless horizontal scaling, especially when…
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 2,337 posts.
662
Jepsen: TigerBeetle 0.16.11
TigerBeetle is an Online Transactional Processing (OLTP) database built for double-entry accounting with a strong emphasis on safety and speed. It builds on the Viewstamped Replication (VR) consensus protocol to offer Strong Serializable consistency. Unlike general-purpose databases, TigerBeetle stores only accounts…
663
PartiQL: One query language for all your data
Data is being gathered and created at rates unprecedented in history. Much of this data is intended to drive business outcomes but, according to the Harvard Business Review, “…on average, less than half of an organization’s structured data is actively used in making decisions…” The root of the problem is that data is…
664
A race condition in Aurora RDS
See how we diagnosed and confirmed an AWS Aurora RDS race condition impacting failovers.
665
Build a search engine, not a vector DB
Don’t confuse embeddings with memory. To build effective RAG, start with a search engine, not just a vector database.
666
We scaled PgBouncer to 4x throughput
PgBouncer is single-threaded, so a single process caps out at one CPU core no matter the box size. See how ClickHouse Managed Postgres runs a peered fleet of PgBouncer processes with so_reuseport to scale pooling across every core — with benchmarks showin
667
Designing a SaaS Database for Scale with Postgres
Exploration of different architectures for designing a SaaS database that scales for multi-tenant data models, including one database per tenant, one schema per tenant, and having all tenants share the same tables. The right choice for you depends on whether you’re optimizing for scale or isolation.
668
PageRank algorithm for graph databases
What is PageRank algorithm? How can it be used in various graph database use cases? How to use it in Memgraph? If these questions are keeping you up at night, here is a blog post that will finally put your mind at ease.
669
What Unsustainable Growth Looks Like: Herbalife, Groupon, and More
Sometimes growth hides the fact that a business is on the verge of failure. Here's how.
670
How SQLite scales read concurrency
Understanding how the write-ahead log turns your scaling up to 11.
671
Pyxley: Python Powered Dashboards
Web-based dashboards are the most straightforward way to share insights with clients and business partners. For R users, Shiny provides a framework that allows data scientists to create interactive web applications without having to write Javascript, HTML, or CSS. Despite Shiny’s utility and success as a dashboard…
672
Phlare: open-source database for continuous profiling at scale
Grafana Labs is helping enable continuous profiling at cloud native scale for the open source community and enterprises, giving developers a better understanding of resource usage of their code.
673
PostgreSQL 14 Internals book – Part II
I’m pleased to announce that Part II of the “ PostgreSQL 14 Internals ” book is available now. This part explores the purpose and design of the buffer cache and explains the need for write-ahead logging. Please download the book freely in PDF. There are three more parts to come, so stay tuned! Thanks to Matthew Daniel…
674
Building and scaling Notion's data lake
How Notion build and grew our data lake to keep up with rapid growth
675
We put a distributed database in the browser and made a game of it
TigerBeetle is a distributed financial transactions database, designed for mission critical safety. How do you test something so critical? Well, we could tell you (and we will), but why not show you?
676
Hunting a 16-year-old SQLite WAL bug with TLA+
This article was written by Marco Manino and Alberto Carretero, dqlite team at Canonical. 1. Anatomy of a SQLite bug Recently SQLite published a new version with a fix to a long-standing bug in the way that the Write Ahead Log (WAL) is checkpointed that leads to the corruption of the database. The important aspect […]
677
Rally, a novel privacy-first data sharing platform
Mozilla teams up with Princeton University researchers to enable crowdsourced science for public good; collaborates with research groups at Princeton, Stan
678
Databases are the endgame for data-oriented design
For the first SpacetimeDB blog post, I’d like to clear up some confusion that I’ve seen arise in discussions about SpacetimeDB and address some general misperceptions about databases. My sense is tha…
679
Backblaze Hard Drive Stats Q3 2020
A look at the performance of 150,757 hard drives in the Backblaze data centers.
680
LiteFS Cloud: Distributed SQLite with Managed Backups
Documentation and guides from the team at Fly.io.
681
I want flexible queries, not RAG
There is a lot of excitement around retrieval augmented generation or “RAG.” Roughly the idea is: some of the deficiencies in current generative AI or large language models (LLMs) can b…
682
683
684
Use DuckDB-WASM to query TB of data in browser
The Library Innovation Lab is growing knowledge and community by bringing library principles to technological frontiers.
685
102TB of New Crawl Data Available
We are very please to announce that new crawl data is now available! The data was collected in 2013, contains approximately 2 billion web pages and is 102TB in size (uncompressed).
686
Technical Challenges Developing a Distributed SQL Database
Here is an outline of some of architectural issues addressed as we build YugabyteDB, our high-performance distributed SQL database.
687
Upgrading Uber's MySQL Fleet
Learn all about our journey of successfully upgrading our MySQL fleet at Uber from v5.7 to v8.0, enhancing performance and reliability.
688
689
Partitioning GitHub’s relational databases to handle scale
In 2019, to meet growth and availability challenges, we set a plan in motion to improve our tooling and ability to partition relational databases.
690
