New
The latest blog posts to take off on Hacker News. 4,224 posts.
Visual Introduction to Self Supervised Learning
A visual introduction to self-supervised learning methods for visual representations.
CouchDB 3.0
Dear community, Apache CouchDB® 3.0.0 has been released and is available for download. Apache CouchDB® lets you access your data where you need it. The Couch Replication Protocol is implemented in …
Loading NumPy arrays from disk: mmap() vs. Zarr/HDF5
Learn how to load larger-than-memory NumPy arrays from disk using either mmap() (using numpy.memmap), or the very similar Zarr and HDF5 file formats.
Prepared statements and their surprising performance implications
Or: How To Increase Your Elixir/Postgres Performance 20x With One Weird Trick
Holes in Bayesian Statistics
Every philosophy has holes, and it is the responsibility of proponents of a philosophy to point out these problems. Here are a few holes in Bayesian data analysis: (1) the usual rules of conditional probability fail in the quantum realm, (2) flat or weak priors lead to terrible inferences about things we care about…
Domain Logic and SQL (2003)
A long-form article entitled: "Domain Logic and SQL"
Materialize: A Streaming Data Warehouse
Materialize offers a streaming data warehouse for real-time analytics & interoperability with millisecond latency, revolutionizing data handling.
Three Types of Data
In my work I’ve developed a mental framework related to data modeling, which has helped greatly both when coming up with a model and when making decisions down the road about how to use that model. Here I will establish three different categories of data in software: Constants, State, and Cached Values. By “data” I…
DBLog: A Change-Data-Capture Framework
Andreas Andreakis, Ioannis Papapanagiotou
Hard Drive Stats for 2019
In 2019 we monitored the performance of 122,507 hard drives. In this article we look at the failure rates by make and model.
A popular self-driving car dataset is missing labels for hundreds of pedestrians
SUMMARY A hand-check of the 15,000 images in the widely used Udacity Dataset 2 found problems in 4,986 of them (33%), including thousands of unlabeled vehicles, hundreds of unlabeled pedestrians, dozens of unlabeled cyclists, and 217 completely unannotated images that contained real objects. Phantom annotations…
Diffing Coronaviruses
Comparing the genome sequences of the Wuhan coronavirus and a bat coronavirus using `diff` and NCBI BLAST reveals an 89% similarity.
Migrating to CockroachDB
CockroachDB is a newSQL database, behaving much like a traditional database while providing consistent HA and scalability out of the box.
Null Values in SQL Queries
*If you’re the owner of this website and have questions, reach out to Bluehost. We’re happy to help.
Streaming: a skill gap?
It's not just for big data
Jepsen: Etcd 3.4.3
The etcd key-value store is a distributed system intended for use as a coordination primitive. Like Zookeeper and Consul , etcd stores a small volume of infrequently-updated state ( by default, up to 8 GB ) in a key-value map, and offers strict-serializable reads, writes and micro-transactions across the entire…
The Rise of SQL-Based Data Modeling
The resurgence of SQL-based data modeling is a something we should all be interested in. Here's why it's important.
Command-line tools can be faster than a Hadoop cluster (2014)
Adam Drake is an advisor to scale-up tech companies. He writes about ML/AI/data, leadership, and building tech teams.
Pandas 1.0
These are the changes in pandas 1.0.0. See Release notes for a full changelog including other versions of pandas.
Why ZFS is not good at growing and reshaping pools, or shrinking them
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
SQLite Is Serverless
Most SQL database engines are implemented as a separate server process. Programs that want to access the database communicate with the server using some kind of interprocess communication (typically TCP/IP) to send requests to the server and to receive back results. SQLite does not work this way. With SQLite, the…
Discovering Millions of Datasets on the Web
Dataset Search launches publicly with an index of 25 million datasets, helping scientists, journalists, students, data geeks to find data.