The latest blog posts to take off on Hacker News. 4,224 posts.
Recently, I’ve been interested in the DuckDB project (like a SQLite geared towards data applications). And one of the amazing features is that it has many data importers included without requiring extra dependencies. This means it can natively read and parse JSON as a database table, among many other formats.
We are excited to introduce pgzx, a framework for creating Postgres extensions using the Zig programming language.
Developers love Redis. Unlock the full potential of the Redis database with Redis Enterprise and start building blazing fast apps.
The other day I was implementing multi-threaded stat() calls in bfs . When I ran some benchmarks, I saw something that made my heart skip a beat:
PostgreSQL isn’t just a simple relational database; it’s a data management framework with the potential to engulf the entire database realm. The trend of “Using Postgres for Everything” is no longer limited to a few elite teams but is becoming a mainstream best practice.
Quickwit 0.8 brings indexing and search at an unprecedented scale, indexing at 1PB/day and searching through 50 PB is a reality.
This idea is particularly sticky because it was more or less true 50 years ago, and it's a passable mental model to use when learning sql. But it's an inadequate mental model for building new sql frontends, designing new query languages, or writing tools likes ORMs that abstract over sql.
Sometimes, I don’t know why I do things. It’s one of these times. A few months ago, Python 3.13 got its JIT engine, built with a new JIT compiler construction methodology (copy-patch, cf. research paper ). After reading the paper, I was sold and I just had to try it with PostgreSQL. And what a fun ride it’s been so…
Arroyo 0.10 has an entirely new SQL engine built with Apache Arrow and DataFusion. It's much faster, smaller, and easier to run. Read on for why and how we're making this change.
PostgreSQL isn’t just a simple relational database; it’s a data management framework with the potential to engulf the entire database…
Our nine month journey to horizontally shard Figma’s Postgres stack, and the key to unlocking (nearly) infinite scalability.
The existence claim for the singular value decomposition (SVD) is quite strong: “Every matrix is diagonal, provided one uses the proper bases for the domain and range spaces” (Trefethen & Bau III, 1997) . MIT professor Gilbert Strang has a wonderful lecture on the SVD, and he includes an existence proof for the SVD…
My name is Taras Kloba, Chief Partner Architect at Microsoft. This blog captures my journey through data engineering, certifications, and technology insights.
Are database benchmarks still relevant ? Let's understand why it's a poor way to choose a database. | Reading time: 17 min read
"Deep" modules, mismatched interfaces - and why SAP is so painful
The CAP theorem is too simplistic and too widely misunderstood to be of much use for characterizing systems.
A deep dive into the Probabilistic B-tree or Prolly Tree data structure including examples. Prolly Trees are used to create version controlled databases.
It has been said that the most popular programming language in the world is the spreadsheet (and in particular these days, Excel). There...
This post is a response to/inspired by The Hunt for the Missing Data Type ( HN ) by Hillel Wayne. I suggest reading his article first.
At SQLite Cloud, we are dedicated to making database management as seamless and intuitive as possible. Today, we are thrilled to unveil a groundbreaking addition to our platform - the Interactive SQLite Documentation! Now, alongside our comprehensive...
Full details on libjxl v. 0.10 and how it affects jpeg xl lossless compression using Pareto Front for a closer analysis.
This quote from Charity Majors is probably the best summary of the current state of observability in the tech industry - a total, mass confusion.
Is Tableau dead? The future looks mixed.
The State Space Model taking on Transformers
Modern AI rewards being very weird.
Explore five methods of data change tracking in PostgreSQL available in 2024.
A complete GPT2 implementation as a single SQL query in PostgreSQL.
Learn JuiceFS Enterprise Edition’s metadata engine design and optimization methods that reduced its metadata memory usage by 90%.
Inspired by the 1BR Challenge, I wanted to see how much it would cost to transfer 1 billion rows from Postgres to Snowflake. Moving 1 billion rows is no…
How disappointing it is to learn that the best ideas rarely come from data after 15 years of working in the field.
