181
Fun facts about SQLite
Some of the interesting and insane facts I learned about SQLite
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
182
Call me maybe: Elasticsearch
This post covers Elasticsearch 1.1.0. In the months since its publication, Elasticsearch has added a comprehensive overview of correctness issues and their progress towards fixing some of these bugs.
183
Postgres 11 – A First Look
Postgres 11 is almost here, in fact the latest beta shipped today, and it features a lot of exciting improvements. If you want to get the full list of features it is definitely worth checking out the release notes, but for those who don’t read the release notes I put together a run down of some what I consider the…
184
Sculpture of Housing Prices Ripping San Francisco Apart
This data sculpture depicts a map of housing prices in San Francisco. It's a map of the city, torn at the seams. The height of each area represents the average price per square foot for recent home sales. Where neighboring areas are close in value they are connected, but if neighboring areas are too far
185
I wrote one of the fastest DataFrame libraries
At the time of writing this, the coronavirus has been in our country for a year, which means I have been sitting at home for a very long time. At the start of the pandemic, I had a few pet projects in Rust under my belt and I noticed that the “are we DataFrame yet” , wasn’t anywhere near my satisfaction. So I wondered…
186
187
The satellite imagery industry still has no idea what customers want
The satellite imagery industry still has no idea what customers actually want
188
Are LLMs able to notice the “gorilla in the data”?
One paper that caught my attention a bit ago was Selective attention in hypothesis-driven data analysis by Itai Yanai and Martin Lercher. In their study, students who were given specific hypotheses to test were much less likely to notice an obvious “gorilla in the data” compared to students who explored the data…
189
I almost failed to search a 37 GB text file in under 1 millisecond
... in which we check if your password has been compromised in many inconvenient ways, in a tale of destruction, obsession, and self-discovery.
190
Call me maybe: Aerospike
Previously, on Jepsen, we reviewed Elasticsearch’s progress in addressing data-loss bugs during network partitions. Today, we’ll see Aerospike 3.5.4, an “ACID database”, react violently to a basic partition.
191
MVCC – the part of PostgreSQL we hate the most (2023)
As much as Andy loves PostgreSQL, there is one part that is terrible and causes many headaches for people. Learn what it is and why it sucks.
192
The Case Against PGVector
The real limitations of pgvector in production: index choice between IVFFlat and HNSW, why real-time search is hard, pre- vs post-filtering pain, how performance degrades at scale, and when a dedicated vector database is the better call.
193
Bad numbers in the “gzip beats BERT” paper?
The recent paper, “Low-Resource” Text Classification: A Parameter-Free Classification Method with Compressors by Jiang et al. [ link ] recently received a lot of attention on twitter.
194
Building a full-text search engine in 150 lines of Python code
Full-text search is everywhere. From finding a book on Scribd, a movie on Netflix, toilet paper on Amazon, or anything else on the web through Google (like [how to do your job as a software engineer](https://localghost.dev/2019/09/everything-i-googled-in-a-week-as-a-professional-software-engineer/)), you've searched…
195
Cassandra vs MongoDB vs CouchDB vs Redis vs Riak comparison
The big Cassandra vs Mongodb vs CouchDB vs Redis, vs Riak vs HBase vs Couchbase (ex-Membase) vs OrientDB vs Aerospike vs Neo4j vs Hypertable vs ElasticSearch vs Accumulo vs VoltDB vs Scalaris vs RethinkDB vs Kyoto Tycoon comparison. While SQL databases are insanely useful tools, their monopoly in the last decades is…
196
What ORMs have taught me: just learn SQL (2014)
I’ve come to the conclusion that, for me, ORMs are more detriment than benefit. In short, they can be used to nicely augment working with SQL in a program, but they should not replace it.
197
198
Python For Finance: Algorithmic Trading
Originally published at https://www.datacamp.com/community/tutorials/finance-python-trading
199
S3 Files
Andy Warfield writes about the hard-won lessons dealing with data friction that lead to S3 Files
200
Jepsen: RethinkDB 2.1.5
In this Jepsen report, we’ll verify RethinkDB’s support for linearizable operations using majority reads and writes, and explore assorted read and write anomalies when consistency levels are relaxed. This work was funded by RethinkDB, and conducted in accordance with the Jepsen ethics policy .
201
Bullshit graph database performance benchmarks
Hey HackerNews, let me just drop my mixtape, checkout my soundcloud and “Death Row” is the label that pays me. How is the Graph Database category supposed to grow when vendors keep spou…
202
Avoid UUID Version 4 Primary Keys in Postgres
Introduction Over the last decade, when working on databases with UUID Version 41 as the primary key data type, these databases have usually had bad performance and excessive IO. https://datatracker.ietf.org/doc/html/rfc4122#section-4.4 ↩
203
204
205
Excel is pretty dang cool
It's like discovering a treasure chest under my kitchen sink
206
The database I wish I had
I watched the talk " Platform as a Reflection of Values: Joyent, Node.js and beyond " by Bryan Cantrill, and I think he was able to put into words something I already felt for some time: if there’s no piece of software out there that reflects your values, it’s time for you to build that softwarefootnote:talk-time[ At…
207
An unexpected find that freed 20GB of unused index space in PostgreSQL
How to free space without dropping indexes or deleting data
208
209
Effectively Using Matplotlib
Matplotlib is a valuable but misunderstood foundation of the python data science stack.
210
How Postgres Makes Transactions Atomic
A dive into the mechanics that allow Postgres to provide strong atomic guarantees despite the chaotic entropy of production.