New
The latest blog posts to take off on Hacker News. 4,224 posts.
Memory Management in Python
To speed-up memory operations and reduce fragmentation Python uses a special manager on top of the general-purpose allocator, called PyMalloc.
PartiQL: One query language for all your data
Data is being gathered and created at rates unprecedented in history. Much of this data is intended to drive business outcomes but, according to the Harvard Business Review, “…on average, less than half of an organization’s structured data is actively used in making decisions…” The root of the problem is that data is…
Postgres tips for the average and power user
A collection of power user tips for those working with Postgres
Book Review: Designing Data-Intensive Applications
What a great book Designing Data-Intensive Applications is! It covers databases and distributed systems in clear language, great detail and without any fluff. I particularly like that the author Ma…
Math versus Dirty Data
At Google, our organization designs, owns, and maintains a number of optimization models that automate the planning of Google’s datacenter growth and health. As is pretty standard in supply chain optimization and planning, these models are often integer linear programs. It’s a core competency of operations research…
Lyft releases self-driving research dataset
By Luc Vincent, EVP Autonomous Technology
ZFS on Linux still has annoying issues with ARC size
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
Ballista: Distributed Compute with Rust, Apache Arrow, and Kubernetes
Software engineer specializing in query engines and distributed systems
Fast Way to Load Data into PostgreSQL Using Python
From two minutes to less than half a second!
Amazon Aurora PostgreSQL Serverless
The database is usually the most critical part of a software architecture and managing databases, especially relational ones, has never been easy. For this reason, we created Amazon Aurora Serverless, an auto-scaling version of Amazon Aurora that automatically starts up, shuts down and scales up or down based on your…
Data Still Dominates
I’m a huge proponent of designing your code around the data, rather than the other way around, and I think it’s one of the reasons git has been fairly successful… I will, in fact, claim that the difference between a bad programmer and a good one is whether he considers his code or his data structures more important…
Interpretable Machine Learning
Machine learning is part of our products, processes, and research. But computers usually don’t explain their predictions , which can cause many problems, ranging from trust issues to undetected bugs. This book is about making machine learning models and their decisions interpretable.
Attunity Data Leak: Vendor for half the Fortune 100 exposed terabyte of backups
Backups ensure data continuity, but they're also a surface of risk. See how Fortune 100 vendor Attunity exposed nearly a terabyte of internal backups.
Why we're ending support for MySQL
GitLab will be ending support for MySQL starting with our 12.1 release – here's why.
A Visual Intro to NumPy and Data Representation
Discussions: Hacker News (366 points, 21 comments), Reddit r/MachineLearning (256 points, 18 comments) Translations: Chinese 1, Chinese 2, Japanese, Korean The NumPy package is the workhorse of data analysis, machine learning, and scientific computing in the python ecosystem. It vastly simplifies manipulating and…
Data-as-a-Service: Running DaaS Companies
A complete guide to building and running a Data-as-a-Service (DaaS) company. Learn DaaS economics, market dynamics, data acquisition models, transformation, delivery, and how to achieve market dominance.
Arima Model – Guide to Time Series Forecasting in Python
Using ARIMA model, you can forecast a time series using the series past values. In this post, we build an optimal ARIMA model from scratch and extend it to Seasonal ARIMA (SARIMA) and SARIMAX models. You will also see how to build autoarima models in python
Wikipedia pageviews this year for each line of ‘We Didn't Start the Fire’
The modern relevancy of every line of 'We Didn't Start the Fire'