Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 140 posts.
Most Female and Male Occupations Since 1950
The shifting majorities of the sexes in the workplace.
Damn Cool Algorithms: Log structured storage (2009)
Typically, if you're designing a storage system - such as a filesystem, or a database - one of your major concerns is how to store the data on disk. You have to take care of allocating space for the objects to be stored, as well as storing the indexing data; you have to worry about what happens when you want to extend…
Some Reflections on Being Turned Down for a Lot of Data Science Jobs
👉 The decision was close, but the team has decided to keep looking for someone who might have more direct neural net experience.\n👉 Honestly, I think the way you communicated your thought process and results was confusing for some people in the room.\n👉 He’s needing someone with an image analysis background for data…
The Decline of Imgur on Reddit and the Rise of Reddit's Native Image Hosting
Before Reddit added native image hosting, Imgur accounted for 15% of all submissions to Reddit. Now it’s below 9%.
Tesla Model S battery degradation data
Want to read about the acceleration we are seeing in our society in the area of mobility? Read our new book ‘Forward’. Updated June 9, 2020. Today, Tesla Motors published their 2019 Imp…
An Introduction to Stock Market Data Analysis with R – Part 1
This is my first article in a two-part series introducing stock data analysis using R.
PostgreSQL Parallel Query v2
A recent Twitter poll asked What is your favorite upcoming feature of PostgreSQL V10? In this admittedly unscientific survey, "better para...
Redis Streams and the Unified Log
Building a log-based architecture that’s fast, efficient, and resilient on the new stream data structure in Redis.
What Does It Take to Track a Million Cell Phones?
You can find anything and everything on the internet, yet nothing that explains how to track cell phones. Let us clarify right away, we are not talking about how to track your own cell phone in cas…
Migrating 1200 databases from MySQL to Postgres
Once Upon a Time there was a company called Base7Booking that by the beginning of 2016 it was supporting around 1200 databases on MySQL 5...
Efficient pagination of a SQL table with 100M records
Compilation of my favorite SQL queries after a decade of dealing with relational databases. Today we talk about scanning a table with 100 million records.
Plans for partitioning in PostgreSQL v11
The reaction to the new table partitioning feature in PostgreSQL 10 has been overwhelmingly positive, but a number of people have already as...
Mathematicians becoming data scientists
I was talking the other day with a former student at UW, Sarah Rich, who’s done degrees in both math and CS and then went off to Twitter. I asked her: so what would you say to a math Ph.D. …
Practical Guide to SQL Transaction Isolation
You may have seen isolation levels in the documentation for your database, felt mildly uneasy, and went on with life. Few day-to-day examples of using transactions really mention isolation. Most use the database’s default isolation level and hope for the best. It’s a fundamental topic to understand however and you’ll…
Why Databases Are Not for Docker Containers
If we attentively look at IT industry at 2017, all of us will see “containers” and “Docker” as the top buzzwords ever. We started to package developed software in Docker containers in every field. …
Literate SQL
Complex queries are hard to read. Literate SQL is about writing queries that are as easy to read as a good novel.
Scaling Postgres with Read Replicas and Using WAL to Counter Stale Reads
Scaling out operation with read replicas and avoiding the downside of stale reads by observing replication progress.
House Address “Twins” Proximity
In a previous post, I did a bit of analysis of the names of towns and streets . However, that clearly wasn’t enough to sate my bizarre interest in all things address-based, so here I am again with more street-name-based nerdery.
PostgreSQL's Hash Indexes Are Now Cool
Since I just committed the last pending patch to improve hash indexes to PostgreSQL 11, and since most of the improvements to hash indexes w...
When Citi Bikes Are Faster Than Taxis in New York City
Over 50% of peak hour taxi trips would be faster as Citi Bike rides, and taxis are only getting slower
How We Found All of Optimizely's Clients
Search Engine For Source Code. Find websites using technology, HTML, Javascript, CSS Tags.
Distributed Consensus – How Shared Data Is Stored
If you don’t work in computers, you probably haven’t spent much time thinking about how data gets stored on computers or in the cloud. I’m…
How I Reduced My DB Server Load by 80%
Database load can be a silent performance killer. I’ve been optimizing the query performance of a web app I run designed to get people involved in open sourc...
The often-overlooked random forest kernel
Ryan Marcus, assistant professor at the University of Pennsylvania. Using machine learning to build the next generation of data systems.
Hash indexes are faster than btree indexes?
PostgreSQL have supported Hash Index for a long time, but they are not much used in production mainly because they are not durable. Now, ...