New
The latest blog posts to take off on Hacker News. 199 posts.
YC Stats Winter 2015
Here is what YC looks like in Winter 2015 Number of startups in the W15 batch: 114 Number of companies funded by YC overall: 842 Total market cap of all YC companies: Over $30B Total money raised by YC companies: Over $3B Number of YC companies worth more than $1B: 4 Number of YC companies worth more than $100…
Why Are Geospatial Databases So Hard to Build?
In 2005, I decided to design my first geospatial database engine. PostGIS was unable to keep up with the modest volumes of sensor data I was working with and while I was new to geospatial data, I had skill designing database engines. It seemed simple enough to get the scale and performance I required. Nothing could…
Searching 20 GB/sec: Systems Engineering Before Algorithms (2014)
SentinelOne unifies AI-powered endpoint, cloud, identity, and data protection—enhanced by our Security Data Lake for seamless and efficient cybersecurity.
Announcing Spark 1.3
Apache Spark 1.3 introduces the DataFrame API, enhancing data processing with new features across streaming, ML, and SQL.
Lucene: The Good Parts
Before MongoDB, before Cassandra, before “NoSQL”, there was Lucene. Did you know that Doug Cutting wrote the first versions of …
A Word Is Worth a Thousand Vectors
Standard natural language processing (NLP) is a messy and difficult affair. It requires teaching a computer about English-specific word ambiguities as well a...
Backblaze Vaults: Zettabyte-Scale Cloud Storage Architecture
Backblaze Vaults are not only incredibly durable, scalable, and performant, but they dramatically improve availability and operability.
Moving all your data, 9TB edition
At GitLab B.V. we are working on an infrastructure upgrade to give more CPU power and storage space to GitLab.com. Learn more here!
Catena: A time series storage engine written in Go
First, I suggest reading Baron’s “Time-Series Database Requirements” blog post to get some more context for this post. I read that and, as I usually do, had my mind set on low-level thoughts. I wrote the following comment:
Farming Hard Drives: How Backblaze Weathered the Thailand Drive Crisis
The rain started in August and by mid-October 2011, violent floods in Thailand had damaged the factories that helped produce nearly half of the world’s
Turning the database inside-out with Apache Samza
Confluent is building the foundational platform for data in motion so any organization can innovate and win in a digital-first world.
Understanding Variance, Co-Variance, and Correlation
An explanation of Variance, Covariance and Correlation in rigorous yet clear terms providing a more general and intuitive look at these essential concepts.
IBash Notebook
Did you know that there's a Bash kernel for IPython Notebook? It even displays inline images. Could it ever be a convenient environment for doing data science? Would it be worthwhile to publish my book Data Science at the Command Line as a collection of notebooks?
How to Build Your Distributed Database
Citus gives you all the greatness of Postgres plus the superpowers of distributed tables. By distributing your data and queries, your application gets high performance—at any scale. The Citus database is available as open source and as a managed service on Azure.
Announcing Graylog v1.0 GA
Graylog is a leading centralized log management solution for capturing, storing, and enabling real-time analysis of terabytes of machine data.
What interests Reddit? A network analysis of 84M comments by 200K users
Reddit.com is a popular social media and news aggregation site. Here I analyze over 80 million comments by 200K redditors to discover what topics interest them.
Introducing DataFrames in Spark for Large Scale Data Science
Introducing Apache Spark's DataFrame API for easier, efficient big data processing and data science applications.
Life in a post-database world: Using crypto to avoid database writes
Possibly one of the biggest hurdles that stands in the way of fostering innovation and discovering newer and better techniques of doing old things is the ease with which developers and designers to…
Asynchronous Python and Databases
To quote the last part of this blog post, "I think it's [asyncio] really well done, it's fun to use, and I still am interested in having more of a SQLAlchemy story for it, because I'm sure folks will still want this no matter what anyone says.". To that end, SQLAlchemy 1.4 now includes complete support for asyncio …
Which topics get the upvote on Hacker News?
Hacker News is a popular social news website, mostly covering technology and startup topics. It relies on user submissions and moderation, where each submitted story can be upvoted and commented by users, which in term determines whether the story reaches the front page and how long it stays there.
Etcd 2.0 – First Major Stable Release
No single cloud fits all. Explore how we build a more flexible future with hybrid cloud.