361
Hard Drive Reliability Review for 2015
In 2015 we ran 56,224 hard drives in our datacenter. In this post we review the reliability of the Seagate, HGST, Toshiba, and Western Digital drives.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
362
What is a Vector Database? (2021)
Discover Vector Databases: How They Work, Examples, Use Cases, Pros & Cons, Selection and Implementation. They have combined capabilities of traditional databases and standalone vector indexes while specializing for vector embeddings.
363
364
Personal data storage is an idea whose time has come
Data Ownership as a conversation changes when data resides primarily with people-governed institutions rather than corporations.
365
RethinkDB 2.0 is now production ready
We’re proud to announce that after five years of development, RethinkDB is ready for production. Download RethinkDB 2.0 ( Yojimbo ) now!
366
DeepText: Facebook's text understanding engine
Visit the post for more.
367
ISO 8583: The language of credit cards
Discover the inner workings of ISO 8583, the global standard for credit card transaction messaging. Learn how it powers payment processing across networks and explore its structure, fields, and real-world applications.
368
369
DuckDB Doesn't Need Data to Be a Database
One of the many enjoyable things about databases is that they generally try to separate how data is represented internally (say on disk) from how it is used. To the point that it has become the norm to not even store the data on the same hardware that is running the queries.
370
Why SQL is beating NoSQL, and what this means for the future of data
After being left for dead, SQL is making a comeback and the NoSQL vs. SQL debate is stronger than ever. Why? And how will it impact the data community?
371
372
RIP, vector database
turbopuffer is pushing the frontier of search. To do that, we have to fundamentally redesign our storage architecture so the vector index is no longer primary.
373
Microsoft Releases 125M Building Footprints in the US as Open Data
Bing has made very significant investments in the area of deep learning, computer vision and artificial intelligence to support a number of different search scenarios. The Bing Maps team has…
374
How Meta trains large language models at scale
As we continue to focus our AI research and development on solving increasingly complex problems, one of the most significant and challenging shifts we’ve experienced is the sheer scale of co…
375
CRDTs: The Hard Parts [video]
A talk at Hydra distributed computing conference , online (originally planned to be in Moscow, Russia), 06 Jul 2020
376
7 Databases in 7 Weeks for 2025
7 databases to explore in 2025.
377
Is PostgreSQL good enough?
tldr; you can do jobs, queues, real time change feeds, time series, object store, document store, full text search with PostgreSQL. How to,...
378
Pre-Release of Polars 2.0
Preview of Python Polars 2.0, bringing the streaming engine to all lazy queries
379
Your data model is your destiny
Your product's core abstractions determine whether new features compound into a moat or just add to a feature list. Here's how to get it right.
380
Speeding up SQL queries by orders of magnitude using UNION
SQL's UNION operation isn't usually regarded as a way to optimize query performance, but in many cases it can be used to achieve massive improvements in speed.
381
Jepsen: Datomic Pro 1.0.7075
Datomic is a general-purpose database intended for systems of record. In many ways, Datomic is unusual. At any instant in time, the state of the database is represented by a set of [entity, attribute, value] ( EAV ) triples, known as datoms . Each datom declares that some entity (like a person) has a particular…
382
How Google Maps allocates survival across London's restaurants
I wanted a dinner recommendation and got a research agenda instead. Using 13000+ restaurants, I rebuild its ratings with machine learning and map how algorithmic visibility actually distributes power.
383
384
A Visual Introduction to Machine Learning (2015)
What is machine learning? See how it works with our animated data visualization.
385
MySQL man pages silently relicensed away from GPL
It has recently been brought to our attention that the MySQL man pages have been relicensed. The change was made rather silently going from MySQL 5.5.30 to MySQL 5.5.31. This affects all pages in the man/ directory of the source code. You can tell the changes have come during this short timeframe (5.5.30->5.5.31). The…
386
FireDucks: Pandas but Faster
Introduction My main background is a hedge fund professional, so I deal with finance data all the time and so far the Pandas library has been an indispensab...
387
SQLite now allows multiple recursive SELECT statements in a single recursive CTE
Is there any command to see the history of a file beyond renames, similar to git log --follow <file> ?
388
How Web Scraping Is Revealing Lobbying and Corruption in Peru
How Web Scraping is Revealing Lobbying and Corruption in Peru - Discover how web scraping is shedding light on lobbying and corruption issues in Peru.
389
We’re pretty happy with SQLite and not urgently interested in a fancier DBMS
Every once in a while, someone suggests that beets should use a “real database.” I think this means storing music metadata in PostgreSQL or MySQL as an alternative to our current SQLite database. The idea is that a more complicated DBMS should be faster, especially for huge music libraries.
390
Why we're ending support for MySQL
GitLab will be ending support for MySQL starting with our 12.1 release – here's why.