151
Pg_jsonschema – JSON Schema Support for Postgres
Today we're releasing pg_jsonschema, a Postgres extension for JSON validation.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 371 posts.
152
ClickHouse Keeper: A ZooKeeper alternative written in C++
Read about why we built a resource-efficient alternative for Zookeeper from scratch in C++, what our next big step with it is, and how you can join the Keeper community.
153
Text Editor Data Structures: Rethinking Undo
Undo and redo have been a staple operation of text editors probably since the first typo was ever made, yet there has not been a lot of innovation around refining the idea of what undo and redo could be. Let’s explore what I mean…
154
Kafka vs. Redpanda performance – do the claims add up?
Apache Kafka has been the most popular open source event streaming system for many years and it continues to grow in popularity. Within the wider ecosystem there are other open source and source available competitors to Kafka such as Apache Pulsar, NATS Streaming, Redis Streams, RabbitMQ and more re
155
Bayesians moving from defense to offense
Erik van Zwet, Sander Greenland, Guido Imbens, Simon Schwab, Steve Goodman, and I write :
156
ChatGPT is now finding bugs in databases
Engineering notes and product news from the PhoenixAI team — real-time analytics, AI agent workloads, lakehouse architecture, and what we're shipping.
157
There is no data engineering roadmap
Data Engineering is booming and many are looking for a cheat sheet to get started. Do you really need to learn 200 tools before you get your first job?
158
Retrieval in LangChain
Build better AI apps with flexible retrieval methods in LangChain. Use any retriever—from semantic to hybrid—to create personalized ChatGPT for your data.
159
160
Fine-tuning GPT-3.5-turbo for natural language to SQL
Tutorial and comparison with RAG methods
161
The Sell ∀ ∃ as ∃ ∀ Scam
Artificial intelligence, like machine learning before it, is making big money off what I call the “sell ∀ ∃ as ∃ ∀ scam.” The scam works as follows. Build a sy…
162
Backblaze Drive Stats for 2022
Check out the 2022 year-end Drive Stats data, and let us know your thoughts in the comments.
163
164
CRDT-richtext: Rust implementation of Peritext and Fugue
Made in Notion, the connected workspace where AI agents and teams organize docs, projects and knowledge together.
165
Retool Database
Get a free Postgres DB with the speed + convenience of a spreadsheet. No setup required. Get started today.
166
Data diffs: Algorithms for explaining what changed in a dataset (2022)
tl;dr: part 1 explains what an explanation algorithm is, and part 2 describes an open source SQL data differ.
167
168
Near-lossless image formats using ultra-fast LZ codecs
I think simple ultra-high speed lossy (or near-lossless) image codecs, built from the new generation of fast LZ codecs, are going to become ...
169
SQLite-based databases on the Postgres protocol? Yes we can
libSQL “server mode” (sqld) enables access to SQLite-based databases using Postgres and HTTP network protocols.
170
How to get transactions between almost any data stores
How to get ACID transactions between almost any data stores, with the Epoxy protocol.
171
Do you need a vector database?
Spoiler alert: the answer is maybe! Although, my inclusion of the word “actually” betrays my bias. Vector databases are having their day right now. Three different vector DB companies have raised money on valuations up to $700 million (paywall link). Surprisingly, their rise in popularity is not for their “original”…
172
173
Explaining the Postgres iceberg
Have you seen this legendary SQL iceberg meme? Let's talk about it while wearing our PostgreSQL hat!
174
They say that stocks go down during the day and up at night
Prompted by your blog post this morning, I attach a plot from Figure 3 of They Still Haven’t Told You showing overnight and intraday returns to AIG (with logarithmic vertical scale, updated with data through the end of October).
175
176
Finding Java Thread Leaks with JDK Flight Recorder and a Bit of SQL
The other day at work, we had a situation where we suspected a thread leak in one particular service, i.e. code which continuously starts new threads, without taking care of ever stopping them again. …
177
Demystifying Apache Arrow (2020)
Demystifying Apache Arrow - some observations from a data scientist. Learning more about a tool that can filter and aggregate two billion rows on a laptop in two seconds
178
Understanding Kafka with Factorio (2019)
While playing Factorio the other day, I was struck by the many similarities with Apache Kafka.
179
Debunking the Myth of "Anonymous" Data
Today, almost everything about our lives is digitally recorded and stored somewhere. Each credit card purchase, personal medical diagnosis, and preference about music and books is recorded and then used to predict what we like and dislike, and—ultimately—who we are. This often happens without our...
180
Making PostgreSQL tick: New features in pg_cron
Since pg_cron 1.5, you can easily schedule jobs that run every 1-59 seconds. And pg_cron 1.6 added support for Postgres 16. This blog post walks you through the benefits of second granularity jobs with the pg_cron open source extension to Postgres.