Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
Our humble attempt at “how much data do you need to fine-tune”
Efficacy of OpenAI Fine-tuning API, Cost/Latency Considerations, Experiencing Catastrophic Forgetting, and...Getting Roasted by a Fine-tuned GPT-3.5
Moving all your data, 9TB edition
At GitLab B.V. we are working on an infrastructure upgrade to give more CPU power and storage space to GitLab.com. Learn more here!
We upgraded an old, 3PB large, Elasticsearch cluster without downtime
Back in 2018, now five years ago, we published a blog post describing our 400+ node Elasticsearch cluster. In that post we brought up an important topic: So far, we have elected to not upgrade the cluster. We would like to, but so far there have been more urgent tasks. How we actually perform the upgrade is undecided…
PlanetScale for Postgres
PlanetScale now supports Postgres
Sqlite – Most Deployed Database in the World
SQLite is likely used more than all other database engines combined. Billions and billions of copies of SQLite exist in the wild. SQLite is found in:
We're wasting money by only supporting gzip for raw DNA files
Stylised graphics of money with DNA helix in the foreground.
SQL needed structure
The data on the page is presented in a hierarchichal structure. The movie page contains a director, a list of genres, a list of actors, and each actor in the list contains a list of characters they played in the movie. You can't sensibly fit all of this into a single flat structure like a relation.
What Does a Database for SSDs Look Like?
What does a relational database designed specifically for local SSDs look like? Postgres, MySQL, SQLite and many others were invented in the 90s and 00s, the era of spinning disks. A local NVMe SSD has ~1000x improvement in both throughput and latency. Design decisions like write-ahead logs, large page sizes, and…
Things I Hate About PostgreSQL (2013)
PostgreSQL Talk
Google Street View in 2026
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
Databricks is an RDBMS
Databricks combines the best of data lakes and data warehouses.
Do NLP Beyond English
7000+ languages are spoken around the world but NLP research has mostly focused on English. This post outlines why you should work on languages other than English.
The World's 2.75B Buildings
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
PostgreSQL vs MySQL: an apples to oranges comparison
Every time we see people look at PostgreSQL and MySQL on the internet it falls into a flame war fast. I think that a large part of the pr...
Query Engines: Push vs. Pull
People talk a lot about “pull” vs. “push” based query engines, and it’s pretty obvious what that means colloquially, but some of the details can be a bit hard to figure out.
The Most Cited AI Papers in 2022
Who Is publishing the most Impactful AI research right now? With the breakneck pace of innovation in AI, it is crucial to pick up some signal as soon as possible. No one has the time to read everything, but these 100 papers are sure to bend the road as to where our AI technology is going. The real test of impact of…
Announcing Google Refine 2.0, a power tool for data wranglers
The latest news from Google on open source releases, major projects, events, and outreach programs for early career developers.
A Short Chronology of Deep Learning for Tabular Data
Occasionally, I share research papers proposing new deep learning approaches for tabular data on social media, which is typically an excellent discussion…