601
P99 0 ms* autocomplete for 240M domain names
How Wirewiki's domain-name autocomplete renders suggestions next frame for 99% of keystrokes.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
602
603
Postgres as queue
The team I've been working in for the last year or so have had great success using Postgres-as-queue. We've managed to avoid the following:
604
How much faster is Redis at storing a blob of JSON compared to Postgres?
tl;dr; Redis is 16 times faster at reading these JSON blobs.*
605
I don't think Elasticsearch is a good logging system
I’ve been a heavy user of ElasticSearch for coming up 7 years now. During that time I’ve used it for a few main usecases: A Search Engine, An APM Solution (after NewRelic started being stupidly expensive), a backend for Jaeger, and as a log storage system. In all of those usecases I’ve really pushed ElasticSearch to…
606
MinIO Is Dead, Long Live MinIO
MinIO’s repo is officially archived and abandoned. And how AI Agents helped bring it back from the dead. This post explains how a community fork restores the admin console and ships binaries via CI/CD pipeline.
607
608
609
Surviving Data Science at the Speed of Hype
john-foreman.com is your first and best source for information about john foreman. Here you will also find topics relating to issues of general interest. We hope you find what you are looking for!
610
Reads Causing Writes in Postgres
It is good practice to regularly inspect the statements running in the hot path of your Postgres instance. One way to do this is to examine the pg_stat_statements view , which shows various statistics about the SQL statements executed by the Postgres server.
611
American solar farms
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
612
Python: Just Write SQL
I have been writing a lot more Go this past year. For those not familiar, Go favours a non-ORM, non-query-builder approach to interacting with databases. This comes naturally due to the sql package : A common interface to be used alongside database drivers. It’s very common to see actual SQL in Go, even in large…
613
I analyzed Stack Overflow for secrets
I analyzed stackoverflow for secrets and leaks.
614
Sensible SQLite Defaults
SQLite is cool now. DHH uses it, Laravel defaults to it. Here is a list of _sensible defaults_ when using sqlite.
615
CRDTs Turned Inside Out
🔰If CRDTs are new to you, here are some introductory links. - An interactive intro to CRDTs [https://jakelazaroff.com/words/an-interactive-intro-to-crdts/] - An introduction to state-based CRDTs [https://www.bartoszsypytkowski.com/the-state-of-a-state-based-crdts/] - CRDTs for non-academics…
616
Literate SQL
Complex queries are hard to read. Literate SQL is about writing queries that are as easy to read as a good novel.
617
Useful Unix commands for data science
The command line tools that ship with any Unix-like system are extremely handy for many data tasks. Here are some of the ones that I've found most useful.
618
Scaling Postgres with Read Replicas and Using WAL to Counter Stale Reads
Scaling out operation with read replicas and avoiding the downside of stale reads by observing replication progress.
619
Problems with Japan's Covid-19 reports
The Japanese government seems incapable of getting their act together so that they can provide meaningful data to the public.
620
NFL players: height and weight over time
An animated look at just how much bigger NFL players have gotten over time.
621
Understanding Google’s File System (2020)
These paper reviews can be delivered weekly to your inbox , or you can subscribe to the Atom feed . As always, feel free to reach out on Twitter with feedback or suggestions!
622
A data corruption bug in OpenZFS?
The Thanksgiving long weekend (23-26 November) in 2023 was an interesting one for OpenZFS, that I managed to land myself in the middle of. The short version of events is that an apparent silent data corruption bug was discovered, which is kind of the worst case scenario for a data storage system. It was a pretty…
623
624
The CRDT Dictionary: A Field Guide to Conflict-Free Replicated Data Types
A comprehensive guide to CRDTs and their tradeoffs, from counters to sequences. Written in the spirit of the Typeclassopedia, exploring how different CRDTs solve the distributed consensus puzzle.
625
SQLite performance tuning: concurrent reads, multiple GBs and 100k SELECTs/s
SQLite is an embedded SQL database. It’s extremely easy to setup, buildable as a single C file with libraries existing for basically all common programming languages. It doesn’t need any server setup or configuration since the SQL logic is run in the host process, and the database consists of only
626
627
A new approach to domain ranking
This is a very brief post announcing a fascinating discovery. It appears to be possible to use the cosine similarity approach powering explore2.marginalia.nu as a substitute for the link graph in an eigenvector-based ranking algorithm (i.e. PageRank). The original PageRank algorithm can be conceptualized as a…
628
Playing “Moneyball” on EA FIFA 16
I'm an EA FIFA enthusiast. More than that, I’ve played since 1994. Last year, I was talking with a friend about the game and he asked me if I was playing Career Mode. My first answer was: "That is boring ... I want to play the real game and not play as a manager". From that day, he decided to convince me to play…
629
A Missing Link in Postgres 11: Fast Column Creation with Defaults
How a seemingly minor enhancement in Postgres 11 fills one of the system’s biggest operational holes.
630
Datasette Lite: a server-side Python web application running in a browser
Datasette Lite is a new way to run Datasette: entirely in a browser, taking advantage of the incredible Pyodide project which provides Python compiled to WebAssembly plus a whole suite …