421
Saving cloud costs by writing our own database
What is the first rule of programming? Maybe something like “do not repeat yourself” or “if it works, don’t touch it”? Or, how about “do not write your own database!”… That’s a good one.
New
The latest blog posts to take off on Hacker News. 2,337 posts.
422
Tokens, n-grams, and bag-of-words models (2023)
This post covers Natural Language Processing fundamentals that are essential to understanding all of today’s language models.
423
424
Cloudflare R2 IA storage tier
We’re excited to announce three new features for Cloudflare R2: event notifications, support for migrations from Google Cloud Storage, and an infrequent access storage tier
425
Redict 7.3.0, a copyleft fork of Redis, is now available
The Redict community is pleased to announce the release of Redict 7.3.0, the first stable version of our copyleft fork of Redis® OSS 7.2.4.1 You can download the release on Codeberg, or download one of our official container images from registry.redict.io. We have written comprehensive documentation detailing our…
426
10 Years of Hacker News "Ask HN: Who Is Hiring" Trends
The "Ask HN: Who is hiring" monthly post on Hacker News, available on the first day of each month, provides a platform for users to share tech job listings for free. Analyzing 10 years of these posts with a Python script reveals significant shifts in hiring trends. This insight into the evolving tech job market can…
427
The Great Migration from MongoDB to PostgreSQL
How Infisical migrated from MongoDB to PostgreSQL.
428
Finding memory leaks in Postgres C code
I spent the last week looking for a memory leak in Postgres’s WAL Sender process. I spent a few days getting more acquainted with Valgrind and gcc/clang sanitizers, but ultimately got nowhere useful with them. Finally, I stumbled on the memleak program from the bcc tools collection which led me right to the source…
429
430
431
Introducing pgzx: create PostgreSQL extensions using Zig
We are excited to introduce pgzx, a framework for creating Postgres extensions using the Zig programming language.
432
Redis adopts dual source-available licensing
Developers love Redis. Unlock the full potential of the Redis database with Redis Enterprise and start building blazing fast apps.
433
PostgreSQL is eating the database world
PostgreSQL isn’t just a simple relational database; it’s a data management framework with the potential to engulf the entire database realm. The trend of “Using Postgres for Everything” is no longer limited to a few elite teams but is becoming a mainstream best practice.
434
Quickwit 0.8: Indexing and Search at Petabyte Scale
Quickwit 0.8 brings indexing and search at an unprecedented scale, indexing at 1PB/day and searching through 50 PB is a reality.
435
Building a streaming SQL engine with Arrow and DataFusion
Arroyo 0.10 has an entirely new SQL engine built with Apache Arrow and DataFusion. It's much faster, smaller, and easier to run. Read on for why and how we're making this change.
436
How Figma's databases team lived to tell the scale
Our nine month journey to horizontally shard Figma’s Postgres stack, and the key to unlocking (nearly) infinite scalability.
437
Perf Is Not Enough
Are database benchmarks still relevant ? Let's understand why it's a poor way to choose a database. | Reading time: 17 min read
438
Prolly Trees
A deep dive into the Probabilistic B-tree or Prolly Tree data structure including examples. Prolly Trees are used to create version controlled databases.
439
Interactive SQLite Documentation: Experiment with Queries in Real-Time
At SQLite Cloud, we are dedicated to making database management as seamless and intuitive as possible. Today, we are thrilled to unveil a groundbreaking addition to our platform - the Interactive SQLite Documentation! Now, alongside our comprehensive...
440
JPEG XL and the Pareto Front
Full details on libjxl v. 0.10 and how it affects jpeg xl lossless compression using Pareto Front for a closer analysis.
441
Is Tableau Dead?
Is Tableau dead? The future looks mixed.
442
The Ultimate Guide to PostgreSQL Data Change Tracking
Explore five methods of data change tracking in PostgreSQL available in 2024.
443
A Distributed File System in Go Cut Average Metadata Memory Usage to 100 Bytes
Learn JuiceFS Enterprise Edition’s metadata engine design and optimization methods that reduced its metadata memory usage by 90%.
444
Moving a billion Postgres rows on a $100 budget
Inspired by the 1BR Challenge, I wanted to see how much it would cost to transfer 1 billion rows from Postgres to Snowflake. Moving 1 billion rows is no…
445
LlamaCloud and LlamaParse
LlamaIndex introduces LlamaParse and LlamaParse for production-grade RAG. Unlock complex PDF data to improve LLM response quality. Discover how today.
446
Ledger: Stripe's system for tracking and validating money movement
Technical details on how Stripe built Ledger, a state-of-the-art money movement tracking system, including how teams at Stripe interact with the data quality metrics that underlie our payment processing network.
447
We sped up time series by 20-30x
This is a follow up post that dives into how we managed to achieve such huge performance gains for time series (among other things), and why it was so hard in the first place.
448
A bird's eye view of Polars
Read how Polars executes your query from planning, optimizing to execution.
449
450
Is the "modern data stack" still a useful idea?
My vote: no.