New
The latest blog posts to take off on Hacker News. 4,224 posts.
Apache Kafka 0.9 is released
Major milestone release Apache Kafka 4.0 removes ZooKeeper entirely, provides early access to Queues for Kafka, and enables faster rebalances, in addition to many other new KIPs.
Modern SQL: With – Organize Complex Queries
The WITH clause adds named subqueries to SQL queries. WITH is also known as Common Table Expression (CTE).
Happy Little Words – Analyzing the Bob Ross Twitch Chat
In late October the video game streaming site Twitch.tv launched "Twitch Creative" , essentially giving people permission to stream non-video game related creative content on the site. To celebrate the launch they streamed all 403 episodes of The Joy of Painting with Bob Ross in a giant marathon.
Analyzing 1.1B NYC Taxi and Uber Trips
The New York City Taxi & Limousine Commission has released a staggeringly detailed historical dataset covering over 1.1 billion individual taxi trips in the city from January 2009 through June 2015. …
Will ZFS and non-ECC RAM kill your data?
This comes up far too often, so rather than continuing to explain it over and over again, I’m going to try to do a really good job of it once and link to it here.
Julia Computing Granted $600k by Moore Foundation
As data-driven research becomes more mainstream, the need for efficient and powerful scientific computing tools increases. To help meet this need, the Gordon an…
Elasticsearch as a Time Series Data Store
Ever wondered how Elasticsearch handles time series metrics? Felix Barnsteiner from stagemonitor - an open source solution to application performance monitoring
What MongoDB got right
MongoDB is perhaps the most-widely-mocked piece of software out there right now. While some of the mockery is out-of-date or rooted in misunderstandings, much of it is well-deserved, and it’s difficult to disagree that much of MongoDB’s engineering is incredibly simplistic, inefficient, and immature compared to…
Parallel Sequential Scan is Committed to PostgreSQL 9.6
I previously suggested that we might be able to get parallel sequential scan committed to PostgreSQL 9.5. That did not happen. However, I...
Time series database Graphite seems to be falling into disfavor
SolarWinds database performance monitoring software helps optimize and manage databases, providing comprehensive monitoring, analysis, and tuning. Improve your database performance with visibility, control, and streamlined management across on-premises and cloud environments. Free trial available!
Irmin: Git-like distributed DB
Read the post on "Introducing Irmin: Git-like distributed, branchable storage" from our blog.
Bayesian ranking of items with up and downvotes or 5 star ratings
Evan Miller wrote a great article How Not To Sort By Average Rating . He shows that simple formulas like score = upvotes - downvotes or score = upvotes / (upvotes + downvotes) don’t work. He proposes to use the lower bound of the Wilson score confidence interval. The formula is complicated and somewhat of a hack…
Open-sourcing Pinterest MySQL management tools
Building the platform where people around the world come to search, save and shop
PostgreSQL on the Command Line
Working efficiently with psql
MariaDB 10.1 can do 1M queries per second
MariaDB 10.1 not only contains tons of new features, it has also been polished to deliver top performance. The biggest improvement has been achieved for scalability on massively multithreaded hardware. The following numbers show the throughput for a simplified sysbench OLTP benchmark on MariaDB-10.1.8 compared to…
Document Clustering with Python
ASIAN4D membahas apakah pola Toto4D benar-benar ada, bagaimana cara pemain membacanya, serta insight sederhana yang sering dipakai pemain Indonesia.
Data Infrastructure at IFTTT
Get more from the services you love on IFTTT. Explore the latest tips and tricks, browse by category, or search by name.
Comparison – R vs. Python: head to head data analysis
R vs Python — which is better for data analysis and data science? Compare the two languages side by side for an objective answer!
How to Analyze Every Reddit Submission and Comment, in Seconds, for Free
With Reddit data in BigQuery, quantifying all the hundreds of millions of Reddit submissions and comments is trivial.
Haunted by Data
This is the text version of a talk I gave on October 1, 2015, at the Strata+Hadoop World conference in New York City. The video version is here (20 mins).
Amazon Elasticsearch Service
September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. Elasticsearch is a real-time, distributed search and analytics engine that fits nicely into a cloud environment. It is document-oriented and does not require a schema to be defined up-front. It supports…