31
Datasette is my data hammer
If you're exploring or publishing data, you should give this open source tool a go.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 159 posts.
32
Stochastic gradient descent written in SQL
Edit – this post generated a few insightful comments on Hacker News. I’ve also put the code in a notebook for ease of use. Introduction Modern MLOps is complex because it involves too many components. …
33
34
How RocksDB Works
Over the past years, the adoption of RocksDB increased dramatically. It became a standard for embeddable key-value stores.
35
SQL:2023 is finished: Here is what's new
SQL:2023 has been wrapped. The final text has been submitted by the working group to ISO Central Secretariat, and it’s now up to the ISO gods when it will be published. Based on past experience, it could be between a few weeks and a few months.
36
Easy, alternative soft deletion: `deleted_record_insert`
An alternate to traditional <code>deleted_at</code> soft deletion that stays out of the way and minimizes bugs.
37
How FoundationDB works and why it works (2021)
FoundationDB is a very impressive database. Its paper won the best industry paper award in SIGMOD’21. In this post, I will explain, in detail, how FDB works and discuss a few very interesting design choices they made. It’s a dense paper packed with neat ideas. Many details (sometimes even proof of correctness) are not…
38
Implementing a distributed key-value store on top of implementing Raft in Go
Implementing the Raft distributed consensus protocol in Go
39
Text Editor: Data Structures
The first step in building my text editor is to implement the core API. If you’re wondering why I want to do this, the original article is here.
40
41
What are embeddings?
A deep-dive into machine learning embeddings.
42
So, you want to deploy on the edge?
Application developers often deploy their apps into a single area, generally represented by a handful of AZs in a single region. No matter where their …
43
Gzip beats BERT? Part 2: dataset issues, improved speed, and results
Summary : Update to my last post analyzing the gzip+knn paper. Some of the datasets have heavily contaminated train/test tests. I show some ways to significantly speed-up the gzip method. I present more results of my "fair" reimplementation .
44
What is Temperature in NLP?
Temperature is a parameter used in natural language processing models to increase or decrease the “confidence” a model has in its most likely response.
45
Cases where full scans are better than indexes
Sometimes you have a lot of data, and one approach to support quick searches is pre-processing it to build an index so a search can involve only looking at a small fraction of the total data. The threshold at which it's worth switching to indexing, though, might be higher than you'd guess. Here are some cases I've…
46
Moving from relational data to events
Knock knock? Who’s there? It’s me, Oskar, the end is near, did you know that? Ah, you know it but don’t know how to proceed? Let’s talk about the end of the CRUD world…
47
My favorite database shirts
Andy reviews his favorite NoSQL and NewSQL database shirts.
48
The broad set of computer science problems faced at cloud database companies
A couple of weeks ago, I was in an internal meeting where our CTO (Adam Prout) was giving a talk to our summer interns. The talk was about the current state of database companies, and how different providers are competing on different facets of their products. As the talk was
49
Features I'd Like in PostgreSQL
I’ve put in my fair share of time with PostgreSQL. It has no shortage of functionality and I believe its expansive feature set drove a lot of its growing popularity in the 2010s. As my time with the database has worn on I’ve come up with a handful of features that I wish the database had. Some of these are ideas…
50
PostgreSQL internals: Things to know about update statements
I recently finished reading PostgreSQL 14 Internals by Egor Rogov. It is one of the great books that teach applied computer science without watering down the difficult parts. One particularly interesting topic is PostgreSQL’s execution of UPDATE statements. Updates in relational databases are inherently complex. They…
51
52
Every database will become a vector database sooner or later
Why every database will become a vector database, sooner or later
53
Things that surprised me while running SQLite in production
I've been using SQLite in several production projects for six months, and I've encountered some surprising aspects.
54
Track HN: Survival Rate of Show HN Stories
Spoiler alert: many of the good projects didn’t survive
55
PgBouncer is useful, important, and fraught with peril
Updated 2024-09-17 to reflect updated PgBouncer support for protocol-level prepared statements 🐘 To start, I want to say that I’m appreciative that PgBouncer exists and the work its open source maintainers put into it. I also love working with PostgreSQL, and I’m thankful for the incredible amount of work and…
56
All of the vehicle license plates available in America
States now offer a vast menu of personalized plate options for a dizzying array of organizations, professions, sports teams, causes and other groups.
57
Causal inference as a blind spot of data scientists
Throughout much of the 20th century, frequentist statistics dominated the field of statistics and scientific research. Frequentist statistics primarily focus on the analysis of data in terms of probabilities and observed frequencies. Causal inference, on the other hand, involves making inferences about…
58
Python: Just Write SQL
I have been writing a lot more Go this past year. For those not familiar, Go favours a non-ORM, non-query-builder approach to interacting with databases. This comes naturally due to the sql package : A common interface to be used alongside database drivers. It’s very common to see actual SQL in Go, even in large…
59
I analyzed Stack Overflow for secrets
I analyzed stackoverflow for secrets and leaks.
60
A data corruption bug in OpenZFS?
The Thanksgiving long weekend (23-26 November) in 2023 was an interesting one for OpenZFS, that I managed to land myself in the middle of. The short version of events is that an apparent silent data corruption bug was discovered, which is kind of the worst case scenario for a data storage system. It was a pretty…