Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
Visual Introduction to Self Supervised Learning
A visual introduction to self-supervised learning methods for visual representations.
How to install TrueNAS on a Raspberry Pi
Now that Joel0 in the TrueNAS community has created a fork of TrueNAS that runs on Arm, I thought I'd give it a spin—on a Raspberry Pi. I currently run an Ampere Arm server in my rack with Linux and ZFS as my primary storage server, and a Raspberry Pi with four SATA SSDs and ZFS as backup replica in my studio. My…
Why LLMs still have problems with OCR
LLMs excel at text generation but fail at precise document extraction due to nondeterminism. | Pulse AI
ClickHouse Keeper: A ZooKeeper alternative written in C++
Read about why we built a resource-efficient alternative for Zookeeper from scratch in C++, what our next big step with it is, and how you can join the Keeper community.
Bento: Jupyter Notebooks at Meta
This episode of the Meta Tech Podcast is all about Bento, Meta’s internal distribution of Jupyter Notebooks, an open-source web-based computing platform. Bento allows our engineers to mix code, tex…
100M Posts Analyzed: What You Need to Write the Best Headlines
Write better headlines with tactics from our analysis of 100 million headlines. Discover the best headline trigrams for Facebook, Twitter & more.
Extracting data from Wikipedia using curl, grep, cut and other bash commands
By using a combination of curl, grep, cut, sort, uniq and other common bash utilities it is possible to extract structured data from Wikipedia and compute insights without writing a full program.
Total security in a PostgreSQL database
The technologies used to build or run their apps
Keeping CALM: when distributed consistency is easy
Keeping CALM: when distributed consistency is easy Hellerstein & Alvaro, arXiv 2019 The CALM conjecture (and later theorem) was first introduced to the world in a 2010 keynote talk at PODS. Beh…
How to create a blog post title optimizer with GPT-3 and Hacker News data
GPT-3 says the title for this post is very bad.
House Address “Twins” Proximity
In a previous post, I did a bit of analysis of the names of towns and streets . However, that clearly wasn’t enough to sate my bizarre interest in all things address-based, so here I am again with more street-name-based nerdery.
Databricks response to Snowflake's accusation of lacking integrity
Analyze the claims made by Snowflake regarding price/performance compared to Databricks and the counterarguments presented.
Hard Drive Cost per Gigabyte
For hard drive prices, the race to zero is over: nobody won. As you’ll see, the hard drive pricing curve has flattened out.
Using reinforcement learning and $4.80 of GPU time to find the best HN post
The OpenPipe platform has migrated to Weights & Biases and CoreWeave. Browse migration details and the OpenPipe technical archive.
Introducing WAL-G: Faster Disaster Recovery for Postgres
A key part of running a reliable database as a service is ensuring you have a good plan for disaster recovery. This post introduces WAL-G, the successor to WAL-E for Postgres, a complete rewrite of WAL-E that provides the same functionality plus 4x faster restores on recovery.
PostgreSQL Basics by Example
Connecting to a database 1 2 $ psql postgres # the default database $ psql database_name Connecting as a specific user 1 2 $ psql postgres john $ …
SQL is syntactic sugar for relational algebra
This idea is particularly sticky because it was more or less true 50 years ago, and it's a passable mental model to use when learning sql. But it's an inadequate mental model for building new sql frontends, designing new query languages, or writing tools likes ORMs that abstract over sql.
Bug Prediction at Google
What's the problem? Here at Google, we have thousands of engineers working on our code base every day. In fact, as previously noted , 50%...
ClickHouse cost-efficiency in action: analyzing 500B rows on an Intel NUC
See how ClickHouse delivers faster query performance on 500 billion rows of data compared to ScyllaDB, leveraging an Intel NUC mini PC, advanced compression, and materialized views.
Text Editor Data Structures: Rethinking Undo
Undo and redo have been a staple operation of text editors probably since the first typo was ever made, yet there has not been a lot of innovation around refining the idea of what undo and redo could be. Let’s explore what I mean…
Harvesting LinkedIn data for fun and profit
A few years ago, before the GDPR era, I was involved in a stealth marketing startup. We went out of
Ribbon filter: Practically smaller than Bloom and Xor
What the research is: The Ribbon filter is a new data structure that is more space-efficient than the popular Bloom filters that are widely used for optimizing data retrieval. One of the ways that …
SQLite's Automatic Indexes
SQLite's optimizer creates indexes automatically to improve query performance with only nested loop joins.
Using SQL to find my best photo of a pelican according to Apple Photos
According to the Apple Photos internal SQLite database, this is the most aesthetically pleasing photograph I have ever taken of a pelican: Here’s the SQL query that found me my …
Build your own SQLite in Rust, Part 5: Evaluating queries
In the previous posts, we've explored the SQLite file format and built a simple SQL parser. It's time to put these pieces together and implement a query…