1
Ditching Excel for Python in a legacy industry
I spent 3 years as an analyst in the reinsurance industry. During this time, I witnessed firsthand how Python is driving rapid technological change. (Goodbye, Excel!)
New
The latest blog posts to take off on Hacker News. 269 posts.
2
Google Maps' Moat Is Evaporating
The views expressed in this newsletter are solely my own, and do not represent the views of my employer.
3
Implementing join planning in our open source Golang SQL query engine
Blog for DoltHub, a website hosting databases made with Dolt, an open-source version-controlled SQL database with Git-like semantics.
4
Target didn’t figure out a teen girl was pregnant before her father did
And that one article that said they did was silly and bad
5
Jepsen: Scylla 4.2-rc3
Scylla is a distributed wide-column 1 database which originated as a C++ port of Cassandra, aiming for improved performance. It supports both Cassandra- and DynamoDB -compatible APIs, and is intended for high-throughput, low-latency workloads, including analytics, messaging, and other time-series data.
6
Netflix's Metaflow: Reproducible machine learning pipelines
A complete guide to building end-to-end machine learning pipelines, from training to deployment, with Metaflow and Cortex
7
Airflow 2.0
We're proud to announce that Apache Airflow 2.0.0 has been released.
8
Amazon Location Service
Update June 1, 2021 – Amazon Location Service is now generally available and includes routing and raster (satellite) maps. You can easily and securely add maps, geocoding, routing, tracking, and geofencing to your applications. Read more about the new features in our new blog post here or try it now in the console. We…
9
Why CockroachDB and PostgreSQL Are Compatible
CockroachDB is PostgreSQL compatible in order to be accessible to an ecosystem of drivers, existing code, and developer knowledge.
10
How we built scalable spatial indexing in CockroachDB
Support for spatial data and geospatial indexing is one of the most requested features in the history of CockroachDB.
11
Bulk loading into PostgreSQL: Options and comparison
You have a file, possibly a huge CSV, and you want to import its content into your database. There are lots of options to do this but how would you decide which one to use. More often than not the question is how much time would the bulk load would take. I found my self doing the same
12
Thread-Per-Core Buffer Management for a modern storage system
Redpanda powers an Agentic Data Plane and Data Streaming platform for real-time performance, AI innovation, and simplified operations.
13
Common Problems in Financial Services Reconciliation
Common problems in financial recon, for fintechs, particularly those building deposit products and managing their own ledger.
14
ZFS: Use mirror vdevs, not RAIDZ
Continuing this week’s “making an article so I don’t have to keep typing it” ZFS series… here’s why you should stop using RAIDZ, and start using mirror vdevs instead.
15
16
Kafka Is Not a Database
Get insights on Materialize's latest updates & trends in streaming databases & data products.
17
How to Think about Correlation?
I am an economist at the Federal Trade Commission with a very basic statistics question, one that I have put to several fairly high-powered econometricians, and to which no one has had a satisfying answer.
18
If All You Have Is a Database, Everything Looks Like a Nail
Databases are fabulous resources. Of course, we’ll abuse them in ways that cause challenges.
19
Scaling Datastores at Slack with Vitess
From the very beginning of Slack, MySQL was used as the storage engine for all our data. Slack operated MySQL servers in an active-active configuration. This is the story of how we changed our data storage architecture from the active-active clusters over to Vitess — a horizontal scaling system for MySQL. Vitess is…
20
VisiData in 60 Seconds
Download faa-wildlife-strikes.csv , a dataset of all aircraft-wildlife collisions reported to the Federal Aviation Administration between 2010 and mid-2016.
21
22
TimescaleDB vs. Amazon Timestream
Our TimescaleDB vs Amazon Timestream results surprised us, but after intensive testing, we found Timestream slow, expensive, and missing key capabilities.
23
Using Bloom filters to efficiently synchronise hash graphs
This blog post uses MathJax to render mathematics. You need JavaScript enabled for MathJax to work.
24
Materialize Raises a $32M Series B
Materialize secures Series B funding to enhance its Operational Data Warehouse with real-time streaming capabilities for immediate data action.
25
Amazon S3 Update – Strong Read-After-Write Consistency
When we launched S3 back in 2006, I discussed its virtually unlimited capacity (“…easily store any number of blocks…”), the fact that it was designed to provide 99.99% availability, and that it offered durable storage, with data transparently stored in multiple locations. Since that launch, our customers have used S3…
26
Feature Casualties of Large Databases
Databases shed important RDMS features as they get big. Examining why this tends to be the case, and some ideas for preventing it.
27
Babelfish: SQL Server-to-Postgres Translation Layer
“The greatest force in legacy databases is inertia,” a widely regarded industry analyst once told me. Not superior functionality. Not better performance. Not lower cost. None of the above. Just inertia. Developers might say they prefer to run PostgreSQL to proprietary alternatives (and they do), but enterprises have…
28
AWS Managed Workflows for Apache Airflow
As the volume and complexity of your data processing pipelines increase, you can simplify the overall process by decomposing it into a series of smaller tasks and coordinate the execution of these tasks as part of a workflow. To do so, many developers and data engineers use Apache Airflow, a platform created by the…
29
30
SQLite briefing for Linux kernel hackers (2019)
This is a briefing on SQLite intended for Linux kernel hackers, and especially those working on Linux filesystems.