New
The latest blog posts to take off on Hacker News. 304 posts.
The Elastic Stack: Future of ELK Platform
Ship context-driven AI applications on Elastic's unified data platform, optimized for accurate and efficient retrieval at petabyte scale. Get started in minutes.
Living Without Atomic Clocks
If someone knows even a little about Spanner, the first question they have is: "How does CockroachDB provide external consistency without atomic clocks?"
Apache Arrow: A new open source in-memory columnar data format
Open source Big Data in-memory columnar layer accelerates analytical processing and interchange by more than 100x. Forest Hill, MD –17 Feb 2016– The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache…
R, the master troll of statistical languages (2012)
Warning: what follows is a somewhat technical discussion of my love-hate relationship with the R statistical language, in which I somehow manage to waste 2,400 words talking about a single line of …
Hard Drive Reliability Review for 2015
In 2015 we ran 56,224 hard drives in our datacenter. In this post we review the reliability of the Seagate, HGST, Toshiba, and Western Digital drives.
The dark side of big data
Everybody (1, 2, 3) is talking about big data and the chances that are not to be missed. So it would be fatal to miss this opportunity, for instance, by impo...
Developer Preview: RethinkDB Now Available for Windows
We’re pleased to announce today that RethinkDB is now available for Windows . You can download a Developer Preview of our Windows build, which runs natively on Microsoft’s operating system.
Web Scraping Finds Price Fluctuation
This is the last post ending a series of articles that have traced the prices of some of the top gifts, gadgets, and gizmos from Black Friday 2015 through to
Text Mining South Park
pop culture + data science
Jepsen: RethinkDB 2.2.3 reconfiguration
In the previous Jepsen analysis of RethinkDB , we tested single-document reads, writes, and conditional writes, under network partitions and process pauses. RethinkDB did not exhibit any nonlinearizable histories in those tests. However, testing with more aggressive failure modes, on both 2.1.5 and 2.2.3, has…
InfluxDB v0.10 GA with hundreds of thousands writes/sec, 98% better compression
The team at InfluxData is excited to announce the stable version of InfluxDB 0.10! Read about it here and see what are the new changes!
Dataflow/Beam and Spark: A Programming Model Comparison
Dataflow is a fully managed streaming analytics service that reduces latency, processing time, cost through autoscaling and real-time data processing.
OFFSET is bad for skipping previous rows
OFFSET doesn’t deliver stable results and makes the query slow. Key-set pagination does neither.
Using Graph Databases to Stop E-commerce Fraud in Real Time
Discover how to detect and deter e-commerce fraud – before fraudsters inflict significant damage – when you harness the power of graph database technology.
Top Books on Amazon Based on Links in Hacker News Comments
This visualization shows the top 30 books ranked by total number of links to Amazon in Hacker News comments from Oct 2006 to Oct 2015.
Voynich Manuscript: word vectors and t-SNE visualization of some patterns
Update 17/01: reddit discussion thread. Update 19/01: hacker news thread. The codex The Voynich Manuscript is a hand-written codex written in an unknown system and carbon-dated to the early 15th century (1404–1438). Although the manuscript has been studied by some famous cryptographers of the World War I and II…
Parsing 10TB of Metadata, 26M Domain Names and 1.4M SSL Certs for $10 on AWS
Last May I was working on hobby project similar to this: https://github.com/zakjan/cert-chain-resolver/. As I found the cert-chain-resolver project a couple of days later I did nothing with the results, but I got some…
Introduction to PostgreSQL physical storage
I initially wrote this post for myself, I wanted to understand enough about the underlying physical storage to be able to grasp other concepts which can affect your database. This post is probably more aimed to people with similar interests, I will try to keep it accurate but the aim is to make it simpler to…
A Tale of Twenty-Two Million Citi Bikes: Analyzing the NYC Bike Share System
Analysis and visualization of the New York City bike share system
A visual exploration of the spatial patterns in endings of German town names
A visual exploration of the spatial patterns in the endings of German town and village names.
Moving away from HDF5
Cyrille Rossant,
PostgreSQL 9.5: UPSERT, Row Level Security, and Big Data
**7 JANUARY 2016**: The PostgreSQL Global Development Group announces the release of PostgreSQL 9.5. This release adds UPSERT capability, Row …