Deno KV internals: building a database for the modern web
How we built a performant, scalable, ACID-compliant, JavaScript-native database on FoundationDB.
Topics /
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
How we built a performant, scalable, ACID-compliant, JavaScript-native database on FoundationDB.
Spoiler alert: many of the good projects didn’t survive
You may have seen isolation levels in the documentation for your database, felt mildly uneasy, and went on with life. Few day-to-day examples of using transactions really mention isolation. Most use the database’s default isolation level and hope for the best. It’s a fundamental topic to understand however and you’ll…
If we attentively look at IT industry at 2017, all of us will see “containers” and “Docker” as the top buzzwords ever. We started to package developed software in Docker containers in every field. …
Distributed coordination makes application complex and brittle. Because all systems eventually build on logs, we can use a shared-log approach to eliminate most coordination. We discuss this conceptually and show how this is practically implemented in the open source project Restate.
Redis 8.8 is now available in Open Source. Explore the new array data type, window counter rate limiter, streams NACK, and more performance-focused updates.
Updated 2024-09-17 to reflect updated PgBouncer support for protocol-level prepared statements 🐘 To start, I want to say that I’m appreciative that PgBouncer exists and the work its open source maintainers put into it. I also love working with PostgreSQL, and I’m thankful for the incredible amount of work and…
Content-aware fill is a powerful tool designers and photographers use to fill in unwanted or missing parts of images. Image completion and inpainting are closely related technologies used to fill in missing or corrupted parts of images. There are many ways to do content-aware fill, image completion, and inpainting. In…
Statistical analysis and mining of huge multi-terabyte data sets is a common task nowadays, especially in the areas like web analytics and Internet advertising. Analysis of such large data sets oft…
Binance Scales its Log Service to 100PB and Saves Millions with Quickwit
the portable Python dataframe library
Differential dataflow is a library that lets you write simple dataflow programs and a) then runs them in parallel and b) efficiently updates the outputs when new inputs arrive. Compared to competition like spark and kafka streams , it can handle more complex computations and provides dramatically better throughput and…
The Foundation sponsored feature reflows existing data to rewrite it onto a new arrangement of disks thereby freeing space at the end of the logical RAID-Z group The FreeBSD Foundation funded the project to ensure the completion and release of an easy-to-use and practical application. The project came in under budget…
An in-depth look at the challenges faced when scaling the GitLab database and the solutions we applied to help solve the problems with our database setup.
Timescale just raised $110 million in our Series C, led by Tiger Global alongside all existing investors: Benchmark, New Enterprise Associates.
There’s fast and there’s fast. This post is about Anna*, a key/value database design from our team at Berkeley that’s got phenomenal speed and buttery smooth scaling, with an unpr…
Learn how we discovered what was slowing down large database queries, and what we did to make Postgres queries 1000x faster.
This blog takes a deep dive into the hows and whys of time series databases—and why Honeycomb couldn't be limited to a TSDB implementation.
Research and cultural heritage institutions are facing increasing costs to provide long-term public access to historically valuable collections of scientific data, born-digital records, and other digital artifacts. With many institutions moving data to cloud services, data sharing and access costs have become more…
Last year I wrote a blog post when we hit 10 million photos, to mark the date and thank everyone who helped us get there together. Today, we just passed 100 million.
States now offer a vast menu of personalized plate options for a dizzying array of organizations, professions, sports teams, causes and other groups.
Anecdotally, this might be the most requested feature in SQL: Allow some trailing commas.
A memory image replaces database interactions with in-memory data using event sourcing to record persistent changes
We need to talk about the data. Crap data. We’re destroying our environment to create and store trillions of blurred images, half-baked videos, rip-off AI ‘songs’, rip-off AI animations, videos and images, emails with mega attachments, never-to-be-watched-again presentations, never-to-be-read-again reports, files and…