Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
FoundationDB Document Layer
Today we’re open sourcing the FoundationDB Document Layer, a document-oriented database that extends the core functionality of the FoundationDB key-value store.
SQL Anti-Patterns
Introduction
Using a Keras Long Short-Term Memory Model to Predict Stock Prices
Editor’s note: This tutorial illustrates how to get started forecasting time series with LSTM models. Stock market data is a great choice for this because it’s quite regular and widely available to everyone. Please don’t take this as financial advice… Continue reading Using a Keras Long Short-Term Memory (LSTM) Model…
Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS
Today is a very exciting day as we release Amazon DynamoDB, a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. Several years ago we published…
Reddit's database has only two tables
Steve Huffman talks about Reddit’s approach to data storage in a High Scalability post from 2010. I was surprised to learn that they only have two tables in their database.
Why xkcd-style graphs are important
For most data scientists, a toolkit like scipy/matplotlib or R becomes so familiar that it becomes almost an extension of their own mind. When fleshing out an idea, we will just open up ipython, write a few lines of code, and display the plot on the screen to get …
Amazon Aurora Update – PostgreSQL Compatibility
Just two years ago (it seems like yesterday), I introduced you to Amazon Aurora in my post Amazon Aurora – New Cost-Effective MySQL-Compatible Database Engine for Amazon RDS. In that post I told you how the RDS team took a fresh, unconstrained look at the relational database model and explained how they built a…
A simple search engine from scratch
*if you include word2vec.
Damn Cool Algorithms: Log structured storage (2009)
Typically, if you're designing a storage system - such as a filesystem, or a database - one of your major concerns is how to store the data on disk. You have to take care of allocating space for the objects to be stored, as well as storing the indexing data; you have to worry about what happens when you want to extend…
Stochastic gradient descent written in SQL
Edit – this post generated a few insightful comments on Hacker News. I’ve also put the code in a notebook for ease of use. Introduction Modern MLOps is complex because it involves too many components. …
SQLite Index Visualization
Explores SQLite B-Tree index structure with visualizations, explaining on-disk and in-memory storage mechanisms
Facebook's software architecture
I had summarized/discussed a couple papers ( Haystack , Memcache caching ) about Facebook's architecture before. Facebook uses simple arch...
EBCDIC is incompatible with GDPR
Welcome to acronym city! The Court of Appeal of Brussels has made an interesting ruling. A customer complained that their bank was spelling the customer's name incorrectly. The bank didn't have support for diacritical marks. Things like á, è, ô, ü, ç etc. Those accents are common in many languages. So it was a little…
Database “sharding” came from Ultima Online? (2009)
Lessons Learned: Sharding for startups is a technical post about database scalability. What caught my eye was the term . What an odd term — “sharding.” Why would a database be described that way?
Backblaze Hard Drive Stats Q2 2020
Hard drive failure rates on an annualized and quarterly basis for 139,867 hard drives by make and manufacturer.
DuckDB: Querying JSON files as if they were tables
We recently improved DuckDB's JSON extension so JSON files can be directly queried as if they were tables.
Top Books on Amazon Based on Number of HN Users Linking Them in Comments
This visualization shows the top 29 books ranked by the number of unique users linking to corresponding Amazon pages in Hacker News comments from Oct 2006 to Oct 2015.
Amazon S3 and Glacier Price Reductions
Back in 2006, we launched S3 with a revolutionary pay-as-you-go pricing model, with an initial price of 15 cents per GB per month. Over the intervening decade, we reduced the price per GB by 80%, launched S3 in every AWS Region, and enhanced the original one-size-fits-all model with user-driven features such as web…
OpenZFS launch
Anubis could not load its JavaScript. The server may be overloaded. Please reload the page to try again.
How We Went All In on sqlc/pgx for Postgres and Go
Touring the ORM and Postgres landscape in Go, and why sqlc is today’s top pick.
Database Design for Google Calendar: A Tutorial
Author: Alexey Makhotkin squadette@gmail.com. Introduction In this database design tutorial (~9000 words) I’m going to show how to design the database tables for a real-world project of substantial complexity. We’ll design a clone of Google Calendar. We will model as much as possible of the functionality that is…
Call Me Maybe: MariaDB Galera Cluster
Previously, on Jepsen, we saw Chronos fail to run jobs after a network partition . In this post, we’ll see MariaDB Galera Cluster allow transactions to read partially committed state.
A beginners guide to thinking in SQL
In this tutorial we will learn about the concepts behind the SQL syntax. We will go through the basics of how to use the FROM and WHERE clauses, and move on to more advanced topics like joins, aggregations and subqueries.