Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
Is watching the 1984 Ghostbusters movie killing people?
Is watching the 1984 Ghostbusters movie killing people? English adults under 60 who have watched the 1984 Ghostbusters movie are dying at twice the rate of people who have watched the 2021 Ghostbusters move the same age.And have been for six months. The chart may seem unbelievable or impossible but it is correct…
Find anything fast with Google's vector search technology
Recently, Google Cloud partner Groovenauts, Inc. published a live demo of MatchIt Fast . As the demo shows, you can find images and text similar to a selected sample from a collection of millions in a matter of milliseconds:
The girl with the ANSI tattoo
I enjoyed the David Fincher remake of The Girl With The Dragon Tattoo more than I thought I would. Rather than a shallow and cynical Holly...
Ways Data Projects Fail
Introduction Data science continues to generate excitement and yet real-world results can often disappoint business stakeholders. How can we mitigate risk and ensure results match expectations? Working as a technical data scientist at the interface between R&D and commercial operations has given me an insight into the…
Text Editor Data Structures
Text editors can be an interesting challenge to program. The types of problems that text editors need to solve can range from trivial to mind-bogglingly difficult. Recently, I have been on something of a spiritual journey to rework some internal data structures in an editor I have been building, specifically the most…
Friendlier SQL with DuckDB
DuckDB offers several extensions to the SQL syntax. For a full list of these features, see the Friendly SQL documentation page.
ClickHouse gets lazier and faster: Introducing lazy materialization
ClickHouse learned to procrastinate strategically. Discover how lazy materialization skips unnecessary column reads to accelerate queries.
Postgres.new: In-browser Postgres with an AI interface
Introducing postgres.new, the in-browser Postgres sandbox with AI assistance.
A Visual Intro to NumPy and Data Representation
Discussions: Hacker News (366 points, 21 comments), Reddit r/MachineLearning (256 points, 18 comments) Translations: Chinese 1, Chinese 2, Japanese, Korean The NumPy package is the workhorse of data analysis, machine learning, and scientific computing in the python ecosystem. It vastly simplifies manipulating and…
Evidence of Fraud in an Influential Study About Procrastination
A new paper in Psychological Science (.htm) reports a failure to replicate Study 2 of Ariely and Wertenbroch’s influential article entitled, “Procrastination, Deadlines, and Performance: Self-Contr…
How AWS S3 serves 1 petabyte per second on top of slow HDDs
Learn how Amazon built the backbone of the modern web that scales to 1 PB/s and 150M QPS on commodity hard drives
Databases in 2022: A Year in Review
Andy Pavlo - Carnegie Mellon University,
An Unlikely Database Migration
From JSON Files to etcd: A Tailscale Database Migration Story
Jepsen: MySQL 8.0.34
MySQL needs little introduction. Over the last 28 years it has become one of the most widely deployed SQL databases. MySQL is primarily used for online transaction processing (OLTP) workloads, but is also deployed as a part of OLAP and queuing systems.
How to make fancy road trip maps with R and OpenStreetMap
Use R to get geocoded location and routing data from OpenStreetMap and explore our family’s impending 5,000 mile road trip around the USA
DuckDB as the New jq
Recently, I’ve been interested in the DuckDB project (like a SQLite geared towards data applications). And one of the amazing features is that it has many data importers included without requiring extra dependencies. This means it can natively read and parse JSON as a database table, among many other formats.
Databases and why their complexity is now unnecessary
This post is not going to be about what’s wrong with individual databases. There are so many databases and so many individual API issues, operational problems, and arbitrary limitations that it wou…
What happens when US economic data becomes unreliable
Sound economic planning and policymaking requires trustworthy data. Private data can serve as a complement but not fully replace official U.S. statistics.
Consider SQLite
If you were creating a web app from scratch today, what database would you use? Probably the most frequent answer I see to this is Postgres, although there are a wide range of common answers: MySQL, MariaDB, Microsoft SQL Server, MongoDB, etc. Today I want you to consider: what if SQLite would do just fine?
Prefer strict tables in SQLite
I prefer strict tables in SQLite because they avoid some datatype problems, such as putting text in number columns.
Introduction to Datalog
A rule-based data query language that thinks differently
Pokémon GO: The Data Behind America’s Latest Obsession
Similarweb's blog is a go-to resource for digital professionals and marketing experts offering a wide range of business tips, industry insights, trends and more.
Jepsen: ParticleDB 1.1.4
Modern applications often spread state across a variety of systems: databases, caches, queues, data warehouses, search indices, and so on. Coordinating these systems is challenging: caches are often stale, the analytics platform might lag days behind the primary database, the search index might lose data, and…
Apache Arrow 1.0
The Apache Arrow team is pleased to announce the 1.0.0 release. This covers over 3 months of development work and includes 810 resolved issues from 100 distinct contributors. See the Install Page to learn how to get the libraries for your platform. Despite a "1.0.0" version, this is the 18th major release of Apache…
PostgreSQL 11 Partitioning Improvements
pgDash is an in-depth monitoring solution designed specifically for PostgreSQL deployments. pgDash shows you information and metrics about every aspect of your PostgreSQL database server, collected using the open-source tool pgmetrics.