91
84% of a single-threaded 1KB write in Redis is spent in the kernel
Alex Clemmer is a computer programmer. Other programmers love Alex, excitedly describing him as "employed here" and "the boss's son".
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 199 posts.
92
Why Percentiles Don’t Work the Way We Think
Customers ask us for p99 (99th percentile) of metrics pretty frequently. We plan to add such a feature to Database Performance Monitor (DPM)(more on that later). But a lot of the time, when customers make this request, they have something very specific, and different, ...
93
94
MariaDB 10.1 can do 1M queries per second
MariaDB 10.1 not only contains tons of new features, it has also been polished to deliver top performance. The biggest improvement has been achieved for scalability on massively multithreaded hardware. The following numbers show the throughput for a simplified sysbench OLTP benchmark on MariaDB-10.1.8 compared to…
95
Announcing Apache Spark 1.4
Apache Spark 1.4 introduces SparkR, new DataFrame features, ML pipelines, and enhanced visualization and monitoring tools for better production debugging.
96
97
RethinkDB Driver for Java now available
Today, we’re pleased to announce the release of our Java client driver for RethinkDB. Visit the installation instructions for details about how to use it in your Java project.
98
99
Moving all your data, 9TB edition
At GitLab B.V. we are working on an infrastructure upgrade to give more CPU power and storage space to GitLab.com. Learn more here!
100
Announcing Graylog v1.0 GA
Graylog is a leading centralized log management solution for capturing, storing, and enabling real-time analysis of terabytes of machine data.
101
Amazon Elasticsearch Service
September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. Elasticsearch is a real-time, distributed search and analytics engine that fits nicely into a cloud environment. It is document-oriented and does not require a schema to be defined up-front. It supports…
102
How CockroachDB Does Distributed, Atomic Transactions
One of the headline features of CockroachDB is its full support for ACID transactions across a distributed database. In this post, we’ll explain...
103
Let's Build a Modern Hadoop
Not just another Hadoop rant — I promise
104
Introducing HypoPG, hypothetical indexes for PostgreSQL
_Paris, June 24 2015_ DALIBO is proud to present the first release of HypoPG, an extension that adds hypothetical indexes …
105
Haunted by Data
This is the text version of a talk I gave on October 1, 2015, at the Strata+Hadoop World conference in New York City. The video version is here (20 mins).
106
What MongoDB got right
MongoDB is perhaps the most-widely-mocked piece of software out there right now. While some of the mockery is out-of-date or rooted in misunderstandings, much of it is well-deserved, and it’s difficult to disagree that much of MongoDB’s engineering is incredibly simplistic, inefficient, and immature compared to…
107
Sharding Pinterest: How we scaled our MySQL fleet
Building the platform where people around the world come to search, save and shop
108
DataLake
A Data Lake is a store that hold raw data as a source for data scientists to explore ways to gain information. It should not be accessed by end-users or used for system integration.
109
110
Backblaze Vaults: Zettabyte-Scale Cloud Storage Architecture
Backblaze Vaults are not only incredibly durable, scalable, and performant, but they dramatically improve availability and operability.
111
High-reproducibility and high-accuracy method for automated topic classification
Much of human knowledge sits in large databases of unstructured text. Leveraging this knowledge requires algorithms that extract and record metadata on unstructured text documents. Assigning topics to documents will enable intelligent searching, statistical characterization, and meaningful classification. Latent…
112
113
Analyzing 1.1B NYC Taxi and Uber Trips
The New York City Taxi & Limousine Commission has released a staggeringly detailed historical dataset covering over 1.1 billion individual taxi trips in the city from January 2009 through June 2015. …
114
115
116
117
How to Analyze Every Reddit Submission and Comment, in Seconds, for Free
With Reddit data in BigQuery, quantifying all the hundreds of millions of Reddit submissions and comments is trivial.
118
Introducing DataFrames in Spark for Large Scale Data Science
Introducing Apache Spark's DataFrame API for easier, efficient big data processing and data science applications.
119
Some analysis of the 1M most popular sites on the web
Over the last couple of weeks I’ve run some analysis on the one million most popular sites on the web.
120
RethinkDB 2.1 beta: automatic failover with Raft
The upcoming 2.1 release will introduce important improvements , including support for automatic failover. Although we’re still hard at work on the finishing touches that will make the new features ready for production use, the beta offers an opportunity to get an early look.