91
Modeling Starlink Capacity
Prior attempts to calculate Starlink’s potential for service have been theoretical. We simulate based on the actual constellation.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 300 posts.
92
Useful Python decorators for data scientists
I show toy implementations of Python decorator patterns that may be useful for Data Scientists.
93
JSON and Virtual Columns in SQLite
Faster JSON handling in a relational database.
94
Raid-Z Expansion Feature for ZFS Goes Live
The Foundation sponsored feature reflows existing data to rewrite it onto a new arrangement of disks thereby freeing space at the end of the logical RAID-Z group The FreeBSD Foundation funded the project to ensure the completion and release of an easy-to-use and practical application. The project came in under budget…
95
Timescale raises $110M Series C
Timescale just raised $110 million in our Series C, led by Tiger Global alongside all existing investors: Benchmark, New Enterprise Associates.
96
Roaring bitmaps: what they are and how they work
A detailed primer on Roaring bitmaps explaining what they are, how they're different from traditional bitmaps, and how they work internally.
97
Algolia Acquires Search.io
Acquisition creates world’s first and only hybrid search engine combining Keyword and Vector Search in a single API.
98
Datasette’s new JSON write API: The first alpha of Datasette 1.0
This week I published the first alpha release of Datasette 1.0, with a significant new feature: Datasette core now includes a JSON API for creating and dropping tables and inserting, …
99
How I Built Zig-SQLite
Article explaining how to leverage Zig's compile time metaprogramming to build a SQLite wrapper that can type check SQL queries
100
GraphQL is now available on Supabase
GraphQL support is now in general availability on the Supabase platform via our open source PostgreSQL extension, pg_graphql.
101
Understanding Google’s File System (2020)
These paper reviews can be delivered weekly to your inbox , or you can subscribe to the Atom feed . As always, feel free to reach out on Twitter with feedback or suggestions!
102
Datasette Lite: a server-side Python web application running in a browser
Datasette Lite is a new way to run Datasette: entirely in a browser, taking advantage of the incredible Pyodide project which provides Python compiled to WebAssembly plus a whole suite …
103
How to create a blog post title optimizer with GPT-3 and Hacker News data
GPT-3 says the title for this post is very bad.
104
SQLite's Automatic Indexes
SQLite's optimizer creates indexes automatically to improve query performance with only nested loop joins.
105
Why isn’t there a decent file format for tabular data?
Tabular data is everywhere. I support reading and writing tabular data in various formats in all 3 of my software application. It is an important part of my data transformation software. But all th…
106
One million queries per second with MySQL
Discover how PlanetScale handles one million queries per second (QPS) with horizontal sharding in MySQL
107
Understanding UUIDs, ULIDs and string representations
What UUIDs and ULIDs are under the hood, and how to encode and use them.
108
The implementation of the UK Covid-19 dashboard
Why and how the UK Coronavirus Dashboard team built their analytics service on top of PostgreSQL & Citus on Azure.
109
SimpleDB: A Basic RDBMS Built from Scratch
My databases class at UCLA wasn’t very challenging so I never truly understood the internals of databases. This always bothered me so I vowed to build a simple database from scratch to learn the fundamentals. MIT's Database Systems course has their students implement a simple database from scratch and it provided me…
110
PlanetScale Boost
PlanetScale offers the world’s fastest and most scalable cloud hosting for Vitess, Neki, and Postgres.
111
Column order in PostgreSQL does matter
Column order can determine how quickly your data is processed in PostgreSQL. Find out how to troubleshoot performance problems in wide tables
112
IKEA’s knowledge graph and why it has three layers
At IKEA we are building a knowledge graph to improve the overall experience of our customers in the physical and digital space. I like to…
113
Reddit’s database has two tables (2012)
Steve Huffman talks about Reddit’s approach to data storage in a High Scalability post from 2010. I was surprised to learn that they only have two tables in their database.
114
How PlanetScale Boost serves SQL queries faster
PlanetScale offers the world’s fastest and most scalable cloud hosting for Vitess, Neki, and Postgres.
115
Why we moved from AWS RDS to Postgres in Kubernetes
Every new Nhost project now gets a dedicated PostgreSQL instance on Kubernetes with root access, custom extensions, and direct connections.
116
Building a BFT JSON CRDT
CRDTs are a family of data structures that are designed to be replicated across multiple computers without needing to worry about conflicts when people write data to the same place.
117
Shopify's Data Science and Engineering Foundations (2020)
Shopify’s Data team uses these foundational approaches to data warehousing and analysis empowering us to deliver the best results for our ecosystem.
118
How discord stores billions of messages (2017)
We decided early on to store all chat history forever so users can come back at any time and have their data available. This is a lot of data: how do we do it?
119
Wikimedia Enterprise announces Google and Internet Archive as first customers
Wikimedia Enterprise announced its first customers: multinational technology company Google and nonprofit digital library Internet Archive. Wikimedia Enterprise was recently launched by the Wikimedia Foundation as an opt-in product.
120
The end of big data
Databricks, Snowflake, and the end of an overhyped era.