New
The latest blog posts to take off on Hacker News. 265 posts.
Gravwell Community Edition: A Splunk Alternative Built with Go
Initial Gravwell testers did a lot of home monitoring with the software and wanted to get licenses for their friends and colleagues but Gravwell was built for larger enterprises and our pricing model isn't set up for home use. All of that changes with the Community Edition...
Lessons learned scraping 100B product pages
Price Intelligence experience scraping over 100 billion product pages. Learn the best practices and demands of extracting product data from e-commerce stores.
How to Analyze Billions of Records per Second on a Single Desktop PC
Introduction This article gives an overview of LocustDB [1], a new and extremely fast open-source analytics database built in Rust. Part 1 gives some background on analytical query systems and my g…
The Federalist Papers: Author Identification Through K-Means Clustering
Using K-means clustering on writing style to classify disputed Federalist Papers authorship.
The Horrors of Upgrading Etcd Beneath Kubernetes
We dig into the challenges of in-place etcd upgrades beneath autonomous Kubernetes clusters running in air-gapped environments.
EnclaveDB: A secure database using SGX
EnclaveDB: A secure database using SGX Priebe et al., IEEE Security & Privacy 2018 This is a really interesting paper (if you’re into this kind of thing I guess!) bringing together the security…
Important database news from the last few months
Google and Amazon acknowledge benefits of SQL, Elasticsearch introduces SQL interface, and MySQL finally becomes modern…after 20 years. These are exciting times in the world of databases.
Consistency Models
Jepsen analyzes the safety properties of distributed systems–most notably, identifying violations of consistency models. But what are consistency models? What phenomena do they allow? What kind of consistency does a given program really need?
Conservation of Intent: why A/B tests aren’t as effective as they look
When a +10% isn’t really a +10% OK, this is an infuriating startup experience: You ship an experiment that’s +10% in your conversion funnel. Then your revenue/installs/whatever goes up by +10% right?
You don't need ML/AI, you need SQL
On Software, life and everything in-between
Microsoft Releases 125M Building Footprints in the US as Open Data
Bing has made very significant investments in the area of deep learning, computer vision and artificial intelligence to support a number of different search scenarios. The Bing Maps team has…
How not to structure database-backed web apps: performance bugs in the wild
How not to structure your database-backed web applications: a study of performance bugs in the wild Yang et al., ICSE’18 This is a fascinating study of the problems people get into when using…
A one-size-fits-all database doesn't fit anyone
The days of the one-size-fits-all monolithic database are behind us, and developers are using a multitude of purpose-built databases.
Migrating Messenger storage to optimize performance
More than a billion people now use Facebook Messenger to instantly share text, photos, video, and more. As we have evolved the product and added new functionality, the underlying technologies that …
Cloud Filestore, high-performance file storage for GCP users
By Tad Hunt, Product Manager; Chris Talbott, Product Marketing As we celebrate the upcoming Los Angeles region for Google Cloud Platform ...
PostgreSQL Features You May Not Have Tried but Should
pgDash is an in-depth monitoring solution designed specifically for PostgreSQL deployments. pgDash shows you information and metrics about every aspect of your PostgreSQL database server, collected using the open-source tool pgmetrics.
A Performance Cheat Sheet for PostgreSQL
Performance tuning is not trivial, but you can go a long way with a few basic guidelines. In this blog, we will discuss how you analyze the workload of the database, and then review a list of important configuration parameters to improve the performance of PostgreSQL.
Harvard discrimination lawsuit: data show penalization of Asian-Americans
Harvard and Students For Fair Admissions (SFFA), which is suing Harvard over discrimination against Asian-American applicants, have relea...
Caching Beyond RAM: The Case for NVMe
memcached
Optimization tricks in Python: lists and tuples
An overview of optimization tricks for lists and tuples
Do We Need Distributed Stream Processing?
In the era of big data and AI, many data-intensive applications exhibit requirements that cannot be satisfied by traditional batch processing models. Streaming applications, such as click stream analytics , IoT data processing, network monitoring , or financial fraud detection , must support high processing rates…
Faster – A key-value store for large state management
At SIGMOD 2018, a team from Microsoft Research will be presenting a new embedded key-value store called FASTER, described in their paper “FASTER: A Concurrent Key-Value Store with In-Place Updates”. As its name suggests, FASTER makes a major leap forward in terms of supporting fast and frequent lookups and updates of…