241
Personal Data Warehouses: Reclaiming Your Data
I gave a talk yesterday about personal data warehouses for GitHub’s OCTO Speaker Series, focusing on my Datasette and Dogsheep projects. The video of the talk is now available, and …
Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 561 posts.
242
How Discord stores trillions of messages (2023)
Engineer Bo Ingram shares insight into how Discord shoulders its traffic and provides a platform for our users to communicate.
243
JPEG XL: How it started, how it’s going
Significance of Apple's support for JPEG XL and what this means for the widespread adoption of this next-generation image compression format.
244
Friendlier SQL with DuckDB
DuckDB offers several extensions to the SQL syntax. For a full list of these features, see the Friendly SQL documentation page.
245
Consider SQLite
If you were creating a web app from scratch today, what database would you use? Probably the most frequent answer I see to this is Postgres, although there are a wide range of common answers: MySQL, MariaDB, Microsoft SQL Server, MongoDB, etc. Today I want you to consider: what if SQLite would do just fine?
246
247
Backblaze Durability Is Eleven 9s – And Why It Doesn’t Matter
We’ve calculated Backblaze’s storage durability at 99.999999999%. What does that impressively large number mean, and does it actually matter for your data?
248
Scaling Django to 8 Billion Page Views
At more than 8 billion page views per month and 45k requests per second, we’ve learned a couple things about delivering comments at scale.
249
250
Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS
Today is a very exciting day as we release Amazon DynamoDB, a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. Several years ago we published…
251
EBCDIC is incompatible with GDPR
Welcome to acronym city! The Court of Appeal of Brussels has made an interesting ruling. A customer complained that their bank was spelling the customer's name incorrectly. The bank didn't have support for diacritical marks. Things like á, è, ô, ü, ç etc. Those accents are common in many languages. So it was a little…
252
Database “sharding” came from Ultima Online? (2009)
Lessons Learned: Sharding for startups is a technical post about database scalability. What caught my eye was the term . What an odd term — “sharding.” Why would a database be described that way?
253
SQL:2023 is finished: Here is what's new
SQL:2023 has been wrapped. The final text has been submitted by the working group to ISO Central Secretariat, and it’s now up to the ISO gods when it will be published. Based on past experience, it could be between a few weeks and a few months.
254
Pebble: A RocksDB Inspired Key-Value Store Written in Go
Today we’re introducing Pebble, a RocksDB-inspired and RocksDB compatible key-value store written in Go that brings greater stability to CockroachDB.
255
Postgres 9.2 will feature linear read scalability up to 64 cores
Remember when I blogged about linear read scalability out to 32 cores ? Well, the awesome Nate Boley provided me with access to his brand n...
256
Storing OpenAI embeddings in Postgres with pgvector
An example of how to build an AI-powered search engine using OpenAI's embeddings and PostgreSQL.
257
258
YC Stats
We get asked (a lot) for statistics on the YC portfolio about valuation and fundraising. Although these are very imperfect indicators of success, here they are. All of these companies actually went through a YC batch and got their start with us (e.g. we do not include Quora). Also, the YC application for the next…
259
Jepsen: MongoDB 3.6.4
MongoDB is a long-time user of Jepsen . Over the past three years, Jepsen has performed several analyses for MongoDB, and MongoDB has integrated an expansive Jepsen test suite into their CI system. In March, MongoDB requested Jepsen perform an analysis on a previously untested configuration: sharded clusters. We also…
260
Excel will allow certain auto data conversions to be turned off
Based on your feedback, we've improved the Automatic Data Conversion settings, and made them also available in Excel for Mac.
261
Call me maybe: RabbitMQ
RabbitMQ is a distributed message queue, and is probably the most popular open-source implementation of the AMQP messaging protocol. It supports a wealth of durability, routing, and fanout strategies, and combines excellent documentation with well-designed protocol extensions. I’d like to set all these wonderful…
262
263
Useful Unix commands for data science
The command line tools that ship with any Unix-like system are extremely handy for many data tasks. Here are some of the ones that I've found most useful.
264
Jepsen: Etcd 3.4.3
The etcd key-value store is a distributed system intended for use as a coordination primitive. Like Zookeeper and Consul , etcd stores a small volume of infrequently-updated state ( by default, up to 8 GB ) in a key-value map, and offers strict-serializable reads, writes and micro-transactions across the entire…
265
266
Debunking the Myth of "Anonymous" Data
Today, almost everything about our lives is digitally recorded and stored somewhere. Each credit card purchase, personal medical diagnosis, and preference about music and books is recorded and then used to predict what we like and dislike, and—ultimately—who we are. This often happens without our...
267
268
269
270