1
Datomic is Free
Nubank is making all editions of Datomic free of licensing fees, released under Apache 2.0 and available directly from Maven Central, no signup required.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 371 posts.
2
My favourite API is a zipfile on the European Central Bank's website
Simple data pipeline powertools: sqlite, pandas, gnuplot and friends
3
Big data is dead
Big data is dead. Long live easy data. | Reading time: 18 min read
4
5
Database Fundamentals
The fundamental problems a database engineer thinks about in the shower
6
Choose Postgres queue technology
Introduction Postgres queue tech is a thing of beauty, but far from mainstream. Its relative obscurity is partially attributable to the cargo cult of “scale”. The scalability cult has decreed that there are several queue technologies with greater “scalability” than Postgres, and for that reason alone, Postgres isn’t…
7
The technology behind GitHub’s new code search
A look at what went into building the world's largest public code search index.
8
Ways to shoot yourself in the foot with Postgres
Personal website of Phil Booth
9
Goodbye integers, hello UUIDv7
The journey Buildkite took from sequential integer primary keys, through randomly generated UUIDs, to adopting time-ordered UUIDv7 — and the database index tradeoffs along the way.
10
JSONB has landed
JSONB is a rewrite of the SQLite JSON functions that, depending on usage patterns, could be several times faster than the original JSON functions. This enhancement has now landed on trunk .
11
Embeddings: What they are and why they matter
Embeddings are a really neat trick that often come wrapped in a pile of intimidating jargon. If you can make it through that jargon, they unlock powerful and exciting techniques …
12
13
SQL Maxis: Why We Ditched RabbitMQ and Replaced It with a Postgres Queue
Embracing our SQL Maxi nature: how we ripped out RabbitMQ from our infrastructure and replaced it with a Postgres queue.
14
Postgres as a graph database
You don't need Neo4j for graph data. Walking through nodes, edges, and recursive traversals in plain Postgres, with working SQL.
15
Most data work seems fundamentally worthless
After going viral, there is one comment I'd like to address. One guy pointed out how comfortable this work seemed, how high the pay was, and said I am out-of-touch and privileged. To that I say, yes, obviously . I moved to the first-world to have first-world problems. Mission accomplished.
16
17
PostgreSQL 16
September 14, 2023 - The PostgreSQL Global Development Group today announced the release of PostgreSQL 16, the latest version of …
18
Accidental database programming
Join me as we take a look at common application data patterns, and how they relate to the inner-workings of databases. In this post, we discuss data caching, indexing, optimistic mutations, and recursive cache invalidation. We will see how life might be easier if we could just use a frontend optimized database like…
19
Retrieving 1TB of data from a faulty drive with the help of woodworking tools
So, a while ago I built a gaming PC with the following specification: Case Dan A4 v4.1 Motherboard Z690I Strix Gaming Pro...
20
Joins 13 Ways
Relational (inner) joins are really common in the world of databases, and one weird thing about them is that it seems like everyone has a different idea of what they are. In this post I’ve aggregated a bunch of different definitions, ways of thinking about them, and ways of implementing them that will hopefully be…
21
Creating a search engine with PostgreSQL
PostgreSQL provides the necessary building blocks for you to combine and create your own search engine for full-text search. Let's see how far we can take it.
22
From deep to long learning?
For the last two years , a line of work in our lab has been to increase sequence length. We thought longer sequences would enable a new era of machine learning foundation models: they could learn from longer contexts, multiple media sources, complex demonstrations, and more. All data ready and waiting to be learned…
23
SciPy builds for Python 3.12 on Windows are a minor miracle
Moving SciPy to Meson meant finding a different Fortran compiler on Windows, which was particularly tricky to pull off for conda-forge. This blog tells the story about how things looked pretty grim for the Python 3.12 release, and how things ended up working out just in the nick of time.
24
How to build a IP geolocation database from scratch?
Download a free IPv4 and IPv6 geolocation database (CSV, CC BY-SA 4.0), or the commercial one with full coverage in CSV and MMDB, updated at least twice a week.
25
Meilisearch 1.0 – Open-source search engine built in Rust
Meilisearch launches the first completely stable, forward-compatible, and enterprise-ready version of its highly performant open-source search engine.
26
New health insurance “transparency data” looks suspiciously wrong
Blog for DoltHub, a website hosting databases made with Dolt, an open-source version-controlled SQL database with Git-like semantics.
27
What if OpenDocument used SQLite? (2014)
Suppose the OpenDocument file format, and specifically the "ODP" OpenDocument Presentation format, were built around SQLite. Benefits would include:
28
Case study: Algorithmic trading with Go
In this case study, we are excited to share an insider's perspective and look under the hood of how a Massive.com customer built an automated retail trading bot that is capable of monitoring the entire stock market in real-time.
29
30
SQL should be the default choice for data transformation logic
SQL should be the first option considered for new data engineering work. It’s robust, fast, future-proof and testable. With a bit of care, it’s clear and readable.