Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
RethinkDB 1.14: binary data, seamless migration, and Python 3 support
Upgrading on Ubuntu? If you’re upgrading from 1.12 or earlier, first set up the new RethinkDB PPA .
Announcing Apache Spark 1.4
Apache Spark 1.4 introduces SparkR, new DataFrame features, ML pipelines, and enhanced visualization and monitoring tools for better production debugging.
More on Postgres Performance
If you missed my previous post on Understanding Postgres Performance its a great starting point. On this particular post I’m going to dig in to some real life examples of optimizing queries and indexes. It all starts with stats I wrote about some of the great new features in Postgres 9.2 in the recent announcement on…
Looking Forward to Postgres 19: It's About Time
Postgres 19 brings native temporal table support. Shaun Thomas covers WITHOUT OVERLAPS, FOR PORTION OF, and temporal foreign keys - and what's still missing.
Google acquires Metaweb (Freebase)
Insights from Googlers into our products, technology, and the Google culture
Postgres geography type is not limited to Earth
It's a little known fact that the PostGIS geography type since PostGIS 2.2 (well was introduced in 2.1 I think but had a bug in it until 2.1.4 or so), supports any spheroidal spatial reference system that measures in degrees. When an srid is not specified, it defaults to using 4326, Earth WGS 84 long lat.
Seeing Like a Data Structure
Our data-centric way of seeing the world isn't serving us well. Barath Raghavan and Bruce Schneier argue that we need new socio-technical systems that leave room for the inherent messiness of reality.
Foursquare Open Source Places: A new foundational dataset
I did not expect this! [...] we are announcing today the general availability of a foundational open data set, Foursquare Open Source Places ("FSQ OS Places"). This base layer of …
Improving Stack Overflow jobs search with machine learning and R
A journey into making Stack Overflow job search results relevant to you
Cloudera taken private for $5.3B, acquires Datacoral and Cazena
Cloudera Blog is your source for expert guidance on the latest data and AI trends, technology innovation, best practices, success stories, and more.
Moving a billion Postgres rows on a $100 budget
Inspired by the 1BR Challenge, I wanted to see how much it would cost to transfer 1 billion rows from Postgres to Snowflake. Moving 1 billion rows is no…
England and Wales House Price Analysis
The last time I looked at house prices it went pretty well, and I ended up winning a data science competition. There I was only dealing with a million or so records, and a relatively small 120 MB dataset. Then I found out it was possible to download 3.7GB of property sale records for all of England and Wales since…
Give me /events, not webhooks
Learn about the challenges of webhooks for service-to-service notifications. And why an `/events` endpoint is often preferable.
De-anonymizing ransomware domains on the dark web
* We have developed three techniques to identify ransomware operators' dark websites hosted on public IP addresses, allowing us to uncover previously unknown infrastructure for the DarkAngels, Snatch, Quantum and Nokoyawa ransomware groups. * The methods we used to identify the public internet IPs involved matching…
IPv6 Support for Amazon S3
Update October 1, 2021 – This post has been edited to remove outdated S3 buckets. As you probably know, every server and device that is connected to the Internet must have a unique IP address. Way back in 1981, RFC 791 (“Internet Protocol”) defined an IP address as a 32-bit entity, with three distinct network […]
Efficient String Compression for Modern Database Systems
CedarDB is a database system that delivers unmatched performance for transactions and analytics, from small writes to handling billions of rows. Built on cutting-edge research to power today’s tools and tomorrow’s challenges.
Tips for Shipping Data Products Fast
Shipping a new data-centric product is hard, and under tight time constraints it's even harder. Here are 4 tips that are proven to help you ship new products fast.
PostgreSQL 15: Stats Collector Gone? What’s New?
Yes, the stats collector is gone from PostgreSQL 15, but there's lots of new exciting features to talk about!
We are splitting our database into Main and CI
We are splitting our database into Main and CI to improve the scalability and reliability of GitLab.com.
Antirez' tiny JSON selector library
Salvatore Sanfilippo, aka antirez released a telegram bot library in C recently. While I'm not at all interested in a telegram bot library, I always like to read Salvatore's code, which is uniformly superb.