91
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 332 posts.
92
93
94
Migrating 1200 databases from MySQL to Postgres
Once Upon a Time there was a company called Base7Booking that by the beginning of 2016 it was supporting around 1200 databases on MySQL 5...
95
Efficient pagination of a SQL table with 100M records
Compilation of my favorite SQL queries after a decade of dealing with relational databases. Today we talk about scanning a table with 100 million records.
96
Hazelcast 3.8.3
2017-10-07: IMap is not the only datatype supporting merge: ICache is mergable as well.
97
Getting Started on Geospatial Analysis with Python, GeoJSON and GeoPandas
Learn to perform the basics of geospatial analysis using Python along with the GeoJSON and GeoPandas libraries.
98
Plans for partitioning in PostgreSQL v11
The reaction to the new table partitioning feature in PostgreSQL 10 has been overwhelmingly positive, but a number of people have already as...
99
Mathematicians becoming data scientists
I was talking the other day with a former student at UW, Sarah Rich, who’s done degrees in both math and CS and then went off to Twitter. I asked her: so what would you say to a math Ph.D. …
100
IBM scientists demonstrate 10x faster large-scale machine learning using GPUs
The IBM Research blog is the home for stories told by the researchers, scientists, and engineers inventing What’s Next in science and technology.
101
Scientists make huge dataset of nearby stars available to public
Members of the public can search a newly released database of 1,600 stars to find signs of undiscovered exoplanets. The dataset, taken over two decades by the W.M. Keck Observatory in Hawaii, comes with an open-source software package and an online tutorial.
102
There are very few suitable use cases for DynamoDB
Edit: This article is firmly out of date now. I have not gone back to try dynamoDB but I have heard they have changed how throughput is…
103
104
Practical Guide to SQL Transaction Isolation
You may have seen isolation levels in the documentation for your database, felt mildly uneasy, and went on with life. Few day-to-day examples of using transactions really mention isolation. Most use the database’s default isolation level and hope for the best. It’s a fundamental topic to understand however and you’ll…
105
Why Databases Are Not for Docker Containers
If we attentively look at IT industry at 2017, all of us will see “containers” and “Docker” as the top buzzwords ever. We started to package developed software in Docker containers in every field. …
106
Scaling the GitLab database
An in-depth look at the challenges faced when scaling the GitLab database and the solutions we applied to help solve the problems with our database setup.
107
108
MongoDB 3.4.0-rc3
In the past year and a half, MongoDB has put a good deal of work into improved read safety, enabled by the adoption of their new replication protocol and the WiredTiger storage engine. Dirty reads were addressed in 3.2 by introducing a majority read concern , and stale reads were addressed with the introduction of the…
109
110
The AWS and MongoDB Infrastructure of Parse
This is the extended form of a comment that got some interest on Hackernews. After a grace period of one year, Parse is now offline. This…
111
Literate SQL
Complex queries are hard to read. Literate SQL is about writing queries that are as easy to read as a good novel.
112
Scaling Postgres with Read Replicas and Using WAL to Counter Stale Reads
Scaling out operation with read replicas and avoiding the downside of stale reads by observing replication progress.
113
114
115
116
House Address “Twins” Proximity
In a previous post, I did a bit of analysis of the names of towns and streets . However, that clearly wasn’t enough to sate my bizarre interest in all things address-based, so here I am again with more street-name-based nerdery.
117
Hard Drive Cost per Gigabyte
For hard drive prices, the race to zero is over: nobody won. As you’ll see, the hard drive pricing curve has flattened out.
118
Introducing WAL-G: Faster Disaster Recovery for Postgres
A key part of running a reliable database as a service is ensuring you have a good plan for disaster recovery. This post introduces WAL-G, the successor to WAL-E for Postgres, a complete rewrite of WAL-E that provides the same functionality plus 4x faster restores on recovery.
119
PostgreSQL's Hash Indexes Are Now Cool
Since I just committed the last pending patch to improve hash indexes to PostgreSQL 11, and since most of the improvements to hash indexes w...
120
When Citi Bikes Are Faster Than Taxis in New York City
Over 50% of peak hour taxi trips would be faster as Citi Bike rides, and taxis are only getting slower