2521
Using FOIA Data and Unix to halve major source of parking tickets
This'll be my first blog post on the internet, ever. Hopefully it's interesting and accurate. Please point out any mistakes if you see any!
New
The latest blog posts to take off on Hacker News. 4,224 posts.
2522
2523
2524
How I slashed a SQL query's runtime with two Unix commands
I was trying to run a simple join query on MariaDB (MySQL) and its performance was horrendous. Here’s how I cut down the query’s run time from over 380 hours to under 12 hours by executing part of it with two simple Unix commands.
2525
How Numba and Cython speed up Python code
A high-level overview of Numba and Cython architectures
2526
GitLab is working on a tool just for data teams
Meltano is an open source tool for the entire data science lifecycle, and we want your contributions and feature requests!
2527
A friendly guide to colours in data visualisation
A collection of tools that help you deal with color gradients & color palettes, to design better data visualizations.
2528
Goodreads offloads DynamoDB tables to S3 and queries them with Athena
In this post, we show you how to export data from a DynamoDB table, convert it into a more efficient format with AWS Glue, and query the data with Athena. This approach gives you a way to pull insights from your data stored in DynamoDB.
2529
Transparent SLIs: See Google Cloud the way your application experiences it
By Jay Judkowitz, Sr. Product Manager Like all good IT organizations, you religiously measure the performance and availability of your ser...
2530
Machine Learning in Google Bigquery
Posted by Umar Syed and Sergei Vassilvitskii, Research Scientists, Google AI, NYC Google BigQuery allows interactive analysis of large datasets, ma...
2531
Hard Drive Stats for Q2 2018
This review looks at the quarterly and lifetime statistics for 98,184 hard drives with a focus on consumer vs. enterprise drive reliability.
2532
Geosharded Recommendations with Hilbert Curve at Tinder
We’re on a mission to keep the magic of human connection alive. Learn more about life at Tinder and the many ways we're igniting our impact—for our employees and the millions of people seeking connection on our app.
2533
Reproducible machine learning with PyTorch and Quilt
In this article, we'll use Quilt to transfer versioned training data to a remote machine. We'll start with the Berkeley Segmentation Dataset, package the dataset, then train a PyTorch model for super-resolution imaging.
2534
Backblaze Durability Is Eleven 9s – And Why It Doesn’t Matter
We’ve calculated Backblaze’s storage durability at 99.999999999%. What does that impressively large number mean, and does it actually matter for your data?
2535
2536
2537
2538
Gravwell Community Edition: A Splunk Alternative Built with Go
Initial Gravwell testers did a lot of home monitoring with the software and wanted to get licenses for their friends and colleagues but Gravwell was built for larger enterprises and our pricing model isn't set up for home use. All of that changes with the Community Edition...
2539
Lessons learned scraping 100B product pages
Price Intelligence experience scraping over 100 billion product pages. Learn the best practices and demands of extracting product data from e-commerce stores.
2540
2541
How to Analyze Billions of Records per Second on a Single Desktop PC
Introduction This article gives an overview of LocustDB [1], a new and extremely fast open-source analytics database built in Rust. Part 1 gives some background on analytical query systems and my g…
2542
The Federalist Papers: Author Identification Through K-Means Clustering
Using K-means clustering on writing style to classify disputed Federalist Papers authorship.
2543
The Horrors of Upgrading Etcd Beneath Kubernetes
We dig into the challenges of in-place etcd upgrades beneath autonomous Kubernetes clusters running in air-gapped environments.
2544
2545
EnclaveDB: A secure database using SGX
EnclaveDB: A secure database using SGX Priebe et al., IEEE Security & Privacy 2018 This is a really interesting paper (if you’re into this kind of thing I guess!) bringing together the security…
2546
Important database news from the last few months
Google and Amazon acknowledge benefits of SQL, Elasticsearch introduces SQL interface, and MySQL finally becomes modern…after 20 years. These are exciting times in the world of databases.
2547
Consistency Models
Jepsen analyzes the safety properties of distributed systems–most notably, identifying violations of consistency models. But what are consistency models? What phenomena do they allow? What kind of consistency does a given program really need?
2548
Conservation of Intent: why A/B tests aren’t as effective as they look
When a +10% isn’t really a +10% OK, this is an infuriating startup experience: You ship an experiment that’s +10% in your conversion funnel. Then your revenue/installs/whatever goes up by +10% right?
2549
You don't need ML/AI, you need SQL
On Software, life and everything in-between
2550
Microsoft Releases 125M Building Footprints in the US as Open Data
Bing has made very significant investments in the area of deep learning, computer vision and artificial intelligence to support a number of different search scenarios. The Bing Maps team has…