New
The latest blog posts to take off on Hacker News. 265 posts.
What Kagglers Are Using for Text Classification
With the problem of Image Classification is more or less solved by Deep learning, Text Classification is the next new developing theme in deep learning. For those who don’t know, Text classification is a common task in natural language processing, which transforms a sequence of text of indefinite length into a…
Text Matching Using Cosine Similarity
Recently I was working on a project where I have to cluster all the words which have a similar name. For a novice it looks a pretty simple job of using some Fuzzy string matching tools and get this done. However in reality this was a challenge because of multiple reasons starting from pre-processing of the data to…
Why everything you have said about the determinants of health expenditure is wrong in one million charts: a response to Noah Smith.
Household income determines health spending, mostly via higher intensity, not prices. US behaviors are consistent with well-measured income in multiple dimensions.
Two-phase commit and beyond
In this post, we model and explore the two-phase commit protocol using TLA+. The two-phase commit protocol is practical and is used in man...
Using data to determine if Die Hard is a Christmas movie
Ok, enough bickering and fighting.
Sqlite – Most Deployed Database in the World
SQLite is likely used more than all other database engines combined. Billions and billions of copies of SQLite exist in the wild. SQLite is found in:
Congress votes to make open government data the default in the United States
On December 21, 2018, the United States House of Representatives voted to enact H.R. 4174, the Foundations for Evidence-Based Policymaking Act of 2017, in a historic win for open government in the …
Improving compression at scale with Zstandard
Two years ago, Facebook open-sourced Zstandard v1.0, a landmark data compression solution that offers best-in-kind performance. Since then, we’ve released a variety of enhancements and advanc…
AWS Outperforms GCP in the 2018 Cloud Report
Customers rely on us to help navigate the increasingly competitive cloud wars. This inspired the 2018 Cloud Report, a benchmark of AWS and GCP on performance, latency, CPU, network, I/O, and cost.
At 22 years old, Postgres might just be the most advanced database yet
From Pub-Sub messaging to Foreign Data Wrappers - five extraordinary features that made Postgres our backend of choice for Arcentry
How Google Code Search Worked: Regex Matching with a Trigram Index (2012)
In the summer of 2006, I was lucky enough to be an intern at Google. At the time, Google had an internal tool called gsearch that acted as if it ran grep over all the files in the Google source tree and printed the results. Of course, that implementation would be fairly slow, so what gsearch actually did was talk to a…
FoundationDB Document Layer
Today we’re open sourcing the FoundationDB Document Layer, a document-oriented database that extends the core functionality of the FoundationDB key-value store.
Pythran as a bridge between fast prototyping and code deployment
As a researcher/engineer (really, an algorithm developer) in the general area of audio and speech processing, I've always run into the same difficulty at all the companies I've worked at: How to quickly prototype and develop algorithms, and subsequently turn them into efficient code that can be deployed to customers.
How Postgres is more than a relational database: Extensions
Extensions allow Postgres to be customized and extended in powerful new ways. Here we find a tour of extensions and how they can make Postgres into much more than a relational database
Progress in performance and scalability with CockroachDB
CockroachDB 2.1 is 50x more scalable than Amazon Aurora at less than 2% of the price per tpmC. Read on to see performance benchmarks of CockroachDB 2.1, including the latest TPC-C results.
Amazon DynamoDB On Demand
January 31, 2025: Post updated to clarify the reduced on-demand pricing and workloads recommendations. Just a few years ago, creating a database that could support your business at any scale while providing consistent low latency was a daunting task. That changed for me in 2012 while reading Werner Vogels’ blog post…
Amazon DynamoDB Transactions
May 20, 2024: As of September 2022, DynamoDB now supports 100 items per transactions. March 13, 2020: Post updated to clarify how to use transactions with global tables and the increase in the maximum number of items per transaction from 10 to 25. Over the years, customers have used Amazon DynamoDB for lots of…
FoundationDB 6.0 released, featuring multi-region support
FoundationDB 6.0.15, our first major release since open sourcing FoundationDB in April, is now officially available!
Translating Between Statistics and Machine Learning
This SEI Blog post explores the differences between statistics and machine learning and how to translate statistical models into machine learning models.
OpenZFS vs. Btrfs and other file systems (2017)
Michael Dexter returns to update his blog post on the different file systems and details some key developments that are unfolding. He covers what's being added to these respective file systems: OpenZFS, Btrfs, and bcachefs. Michael Dexter has invested his volunteer time and career in Open Source hypervisors and file…
The State of the Octoverse: top programming languages of 2018
Take a closer look into why—and where—top programming languages are popular.
Python Data Visualization 2018: Why So Many Libraries?
Anaconda Scale Customer Event Join us live October 15th Save Your Seat Anaconda Blog
Estimating the chances of something that hasn’t happened yet
A handy rule of thumb for creating a confidence interval for the probability of an event you haven't seen happen yet.