Topics /
The most popular blog posts about databases & data on Hacker News. 125 posts.
This week at USENIX ATC’22, a group of my colleagues 1 from the AWS DynamoDB team are going to be presenting their paper Amazon DynamoDB: A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service . This paper is a rare look at a real-world distributed system that runs at massive scale.
I wanted to share the attached paper on choice prediction that I recently co-authored with Itamar Simonson in case it’s of interest.
PostgreSQL query planner is full of surprises, so a common-sense approach to writing performant queries is sometimes misleading. In this blog post, I'll describe examples of optimizing seemingly obvious queries with the help of EXPLAIN ANALYZE and Postgres metadata analysis.
This is my journey of creating a proof-of-concept of persisting an SQLite database in a Cloudflare Durable Object. It is not meant as a tutorial, but rather as something I myself can get back to it, to revisit what and why I did certain things.
Explore SQLite Internals: How The World's Most Used Database Works by Abdur-Rahmaan Janhangeer. Deep dive into database internals, systems engineering, and advanced Python.
tl;dr: I believe HN Who is Hiring? posts are down; scroll to the bottom for the chart, code lives here. Hacker News. The Orange Site. Since April 2011, it’s had a thread every month, which dares potential employers to answer one question: who is hiring? I take a quick skim through this thread every month. ... Hacker…
Prior attempts to calculate Starlink’s potential for service have been theoretical. We simulate based on the actual constellation.
I show toy implementations of Python decorator patterns that may be useful for Data Scientists.
Faster JSON handling in a relational database.
A detailed primer on Roaring bitmaps explaining what they are, how they're different from traditional bitmaps, and how they work internally.
This week I published the first alpha release of Datasette 1.0, with a significant new feature: Datasette core now includes a JSON API for creating and dropping tables and inserting, …
Article explaining how to leverage Zig's compile time metaprogramming to build a SQLite wrapper that can type check SQL queries
These paper reviews can be delivered weekly to your inbox , or you can subscribe to the Atom feed . As always, feel free to reach out on Twitter with feedback or suggestions!
Datasette Lite is a new way to run Datasette: entirely in a browser, taking advantage of the incredible Pyodide project which provides Python compiled to WebAssembly plus a whole suite …
GPT-3 says the title for this post is very bad.
SQLite's optimizer creates indexes automatically to improve query performance with only nested loop joins.
Tabular data is everywhere. I support reading and writing tabular data in various formats in all 3 of my software application. It is an important part of my data transformation software. But all th…
What UUIDs and ULIDs are under the hood, and how to encode and use them.
My databases class at UCLA wasn’t very challenging so I never truly understood the internals of databases. This always bothered me so I vowed to build a simple database from scratch to learn the fundamentals. MIT's Database Systems course has their students implement a simple database from scratch and it provided me…
Steve Huffman talks about Reddit’s approach to data storage in a High Scalability post from 2010. I was surprised to learn that they only have two tables in their database.
CRDTs are a family of data structures that are designed to be replicated across multiple computers without needing to worry about conflicts when people write data to the same place.
Databricks, Snowflake, and the end of an overhyped era.
This paper from Sigmod 2021 presents FoundationDB, a transactional key-value store that supports multi-key strictly serializable transacti...
SQLite: Past, Present, and Future is a newly published paper authored by Kevin P. Gaffney, Martin Prammer and Jignesh M. Patel from the University of Wisconsin-Madison and D. Richard Hipp, …
Why I enjoy PostgreSQL - Infrastructure Engineer's Perspective
Homepage of Carlin Eng
The recent (2022) compromise of Lastpass included email addresses, home addresses, names, and encrypted customer vaults. In this post I will demonstrate how attackers may leverage tools like Hashcat to crack an encrypted vault with a weak password.
Personal website of Samuel Burer, Tippie Rollins Professor of Business Analytics, University of Iowa.
This is a note on, the Turing Award laureate, Ted Codd’s revolutionary paper — A Relational Model of Data for Large Shared Data Banks. In this post, I will review the paper and add my comments with a perspective from modern distributed databases.
