31
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 332 posts.
32
Apache Arrow and the “Things I Hate About Pandas”
This post is the first of many to come on Apache Arrow, pandas, pandas2, and the general trajectory of my work in recent times and into the foreseeable future. This is a bit of a read and overall fairly technical, but if interested I encourage you to take the time to work through it.
33
Apache Kafka Goes 1.0
Major milestone release Apache Kafka 4.0 removes ZooKeeper entirely, provides early access to Queues for Kafka, and enables faster rebalances, in addition to many other new KIPs.
34
Python For Finance: Algorithmic Trading
Originally published at https://www.datacamp.com/community/tutorials/finance-python-trading
35
36
Postmortem of database outage of January 31
Postmortem on the database outage of January 31 2017 with the lessons we learned.
37
38
Effectively Using Matplotlib
Matplotlib is a valuable but misunderstood foundation of the python data science stack.
39
How Postgres Makes Transactions Atomic
A dive into the mechanics that allow Postgres to provide strong atomic guarantees despite the chaotic entropy of production.
40
Publishing with Apache Kafka at The New York Times
This post covers how Apache Kafka and its Streams API are used for storing and processing all the articles ever published by The New York Times
41
42
43
Analyzing Cryptocurrency Markets Using Python
A data-driven approach to cryptocurrency (Bitcoin, Ethereum, Litecoin, Ripple etc.) market analysis and visualization using Python.
44
45
Interesting data structures: the BK-tree
A BK-tree is a tree data structure specialized to index data in a metric space . A metric space is essentially a set of objects which we equip with a distance function $d(a, b)$ for every pair of elements $(a, b)$. This distance function must satisfy a set of axioms in order to ensure it’s well-behaved. The exact…
46
Working with time in Postgres
A massive amount of reporting queries, whether really intensive data analysis, or just basic insights into your business involving looking at data over a certain time period. Postgres has really rich support for dealing with time out of the box, something that’s often very underweighted when dealing with a database…
47
Unlearning descriptive statistics
If you've ever used an arithmetic mean, a Pearson correlation or a standard deviation to describe a dataset, I'm writing this for you. Better numbers exist to summarize location, association and spread: numbers that are easier to interpret and that don't act up with wonky data and outliers.
48
How Discord Indexes Billions of Messages Using Elasticsearch
Discover the latest news and app updates, stories, company insights, and plenty more about Discord, all in one place.
49
Modes, Medians and Means: A Unifying Perspective
Introduction / Warning Link to heading Any traditional introductory statistics course will teach students the definitions of modes, medians and means. But, because introductory courses can’t assume that students have much mathematical maturity, the close relationship between these three summary statistics can’t be…
50
Backblaze Hard Drive Stats for 2016
We take a deep dive on hard drive performance stats from 73,653 hard drives. What are the most reliable hard drives by size, manufacturer, and model?
51
The Marketing Behind MongoDB
Countless NoSQL databases competed to be the database of choice. MongoDB's marketing strategy helped it become the winner.
52
A/B test of banner ads vs. traffic
9 months of daily A/B-testing of Google AdSense banner ads on Gwern.net indicates banner ads decrease total traffic substantially, possibly due to spillover effects in reader engagement and resharing.
53
54
1.1B Taxi Rides on Kdb+/q and 4 Xeon Phi CPUs
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
55
Better Database Migrations in Postgres
As your database grows and scales there are some operations that you need to take more care of than you did when you were just starting. When working with your application in your dev environment you may not be fully aware of the cost of some operations until you run them against production. And at some point most of…
56
A Data-Driven Guide to Becoming a Consistent Billionaire
Did You Really Think All Billionaires Were the Same? Recently, I became a bit obsessed with the one percent of the one percent – Billionaires. I was intrigued when I stumbled on articles telling us…
57
AWS AppSync – Build data-driven apps with real-time and off-line capabilities
September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. In this day and age, it is almost impossible to do without our mobile devices and the applications that help make our lives easier. As our dependency on our mobile phone grows, the mobile application market has…
58
CockroachDB beta-20161013
CockroachDB is a distributed SQL database, loosely patterned after Google Spanner and designed for semi-synchronous networks. It speaks the PostgreSQL wire protocol , supports a reasonable dialect of SQL , and combines replication for durability with transparent scale-out sharding for large tables. Its most…
59
Backblaze's Hard Drive Stats for Q2 2017
In this update, we’ll review the Q2 2017 and lifetime hard drive failure rates for all our current drive models including enterprise and consumers drives.
60
Introduction to R Programming
This is a detailed step-by-step introduction to R programming. Starting with the two major reasons to learn R for Data Science, it will guide you through the installation process, and prepare you for the basics of R: arithmetics, variables assignment, data types, functions, and documentations.