211
What SMART Stats Tell Us About Hard Drives
Have you ever wondered what your hard drive SMART errors actually mean? Find out what we look at to determine if a drive is about to fail.
Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 561 posts.
212
213
Damn Cool Algorithms: Cardinality Estimation
Posted by Nick Johnson | Filed under python , cardinality-estimation , damn-cool-algorithms
214
Citus 10 brings columnar compression to Postgres
Deep dive into Citus columnar storage for Postgres. Includes a quickstart, as well as performance measurements for data loading, compression ratios, and query response times. Also covers how columnar relates to Citus, integration with Postgres range partitioning, limitations, & ways to get started.
215
216
217
Using MySQL as a NoSQL - A story for exceeding 750,000 qps on a commodity server
UPDATE: Oracle officially released memcached daemon plugin that talks with InnoDB. I'm glad to see that NoSQL+MySQL has become an official ...
218
Jepsen: RethinkDB 2.2.3 reconfiguration
In the previous Jepsen analysis of RethinkDB , we tested single-document reads, writes, and conditional writes, under network partitions and process pauses. RethinkDB did not exhibit any nonlinearizable histories in those tests. However, testing with more aggressive failure modes, on both 2.1.5 and 2.2.3, has…
219
Extracting Structured Data from Recipes Using Conditional Random Fields (2015)
Erica Greene describes the tool that she built to extract structured data from recipes.
220
Index Investing Makes Markets and Economies More Efficient (2016)
U.S. equity index funds have grown dramatically in recent decades, from a negligible $500MM in assets in the early 1980s to a staggering $4T today. The consensus view in the investment community is that this growth is unsustainable. Indexing, after all, is a form of free-riding, and a market can only support so many…
221
Recommending music on Spotify with deep learning
An overview of what I've been doing as part of my internship at Spotify in NYC this summer: using convolutional neural networks for audio-based music recommendation.
222
Scaling Out PostgreSQL for CloudFlare Analytics Using CitusDB (YC S11)
When I joined CloudFlare about 18 months ago, we had just started to build out our new Data Platform. At that point, the log processing and analytics pipeline built in the early days of the company had reached its limits.
223
Gay marriage: the database engineering perspective
Update, 2017-09-25 Hi! This essay is undergoing a long-overdue rewrite. In the meantime, consider my 2015 follow-up essay, Obergefell v. Hodges: the database engineering perspective....
224
Simple declarative schema migration for SQLite
At my company we use a small SQLite database. We define the schema in a single file with SQL CREATE TABLE statements. If we add tables, columns, or indexes, our application will create them automatically the next time it starts up.
225
What can 6,000 electric vehicles tell us about EV battery health?
Analysis of electric vehicle battery health of 22K+ EVs reveals a 2.3% average battery degradation rate. High-power DC fast charging is the top risk factor.
226
The Evaporative Cooling Effect in Social Networks (2010)
http://blog.bumblebeelabs.com/social-software-sundays-2-the-evaporative-cooling-effect/
227
Restic Cryptography
tl;dr: this is not an audit and I take no responsibility for your backups, but I had a quick look at the crypto and I think I’m going to use restic for my personal backups.
228
Announcing SQL Server on Linux
It’s been an incredible year for the data business at Microsoft and an incredible year for data across the industry. This Thursday at our Data Driven event in New York, we will kick off a wave of launch activities for SQL Server 2016 with general availability later this year. This is the most significant release...
229
Datomic is Free
Nubank is making all editions of Datomic free of licensing fees, released under Apache 2.0 and available directly from Maven Central, no signup required.
230
RethinkDB versus PostgreSQL: my personal experience
News and updates about CoCalc
231
One-liner for running queries against CSV files with SQLite
I figured out how to run a SQL query directly against a CSV file using the sqlite3 command-line utility:
232
Soft deletion probably isn't worth it
The traditional soft deletion pattern using <code>deleted_at</code> columns leaks into code, curbs the usefulness of foreign keys, and makes data removal difficult. Luckily, there’s an alternative.
233
Pev: Postgres ‘Explain’ Visualizer (2016)
Postgres Explain Visualizer (Pev) is a tool I wrote to make EXPLAIN output easier to grok. It creates a graphical representation of the query plan.
234
235
PostgreSQL Scalability: Towards Millions TPS
PostgreSQL scalability on multicore and multisocket machines became a subject of optimization long time ago once such machines became widely used. This blog post shows brief history of vertical scalability improvements between versions 8.0 and 8.4. PostgreSQL 9.2 had very noticeable scalability improvement. Thanks to…
236
NewSQL databases fail to guarantee consistency and I blame Spanner
(Spanner vs. Calvin, Part 2) [TL;DR I wrote a post in 2017 that discussed Spanner vs. Calvin that focused on performance differences. Th...
237
Delivering Billions of Messages Exactly Once
The single requirement of all data pipelines is that they cannot lose data. Data can usually be delayed or re-ordered–but never dropped.
238
Lessons learned from sharding Postgres at Notion
With an effort to make Notion faster and more reliable for years to come — we migrated Notion’s PostgreSQL monolith into a horizontally-partitioned database fleet.
239
Creating a Modern OCR Pipeline Using Computer Vision and Deep Learning
Dash knows your context, your team, and your work, so your team can stay organized, easily find and share knowledge, and keep projects secure, all from one place.
240
Litestream: Revamped
Bringing in what we learned from LiteFS