The latest blog posts to take off on Hacker News. 1,888 posts.
Last year (2019), we released the simjson library. It is a C++ library available under a liberal license (Apache) that can parse JSON documents very fast. How fast? We reach and exceed 3 gigabytes per second in many instances. It can also parse millions of small JSON documents per second. The new version is much ……
The Japanese government seems incapable of getting their act together so that they can provide meaningful data to the public.
Visualizing the exponential growth of COVID-19 across the world.
Sponsoring this project will help achieve swift completion and ensure the maintenance of psycopg2, psycopg3 and other related projects.
Millions of tiny databases, Brooker et al., NSDI’20 This paper is a real joy to read. It takes you through the thinking processes and engineering practices behind the design of a key part of …
A visual introduction to self-supervised learning methods for visual representations.
Learn how to load larger-than-memory NumPy arrays from disk using either mmap() (using numpy.memmap), or the very similar Zarr and HDF5 file formats.
Or: How To Increase Your Elixir/Postgres Performance 20x With One Weird Trick
Every philosophy has holes, and it is the responsibility of proponents of a philosophy to point out these problems. Here are a few holes in Bayesian data analysis: (1) the usual rules of conditional probability fail in the quantum realm, (2) flat or weak priors lead to terrible inferences about things we care about…
A long-form article entitled: "Domain Logic and SQL"
In my work I’ve developed a mental framework related to data modeling, which has helped greatly both when coming up with a model and when making decisions down the road about how to use that model. Here I will establish three different categories of data in software: Constants, State, and Cached Values. By “data” I…
Comparing the genome sequences of the Wuhan coronavirus and a bat coronavirus using `diff` and NCBI BLAST reveals an 89% similarity.
CockroachDB is a newSQL database, behaving much like a traditional database while providing consistent HA and scalability out of the box.
*If you’re the owner of this website and have questions, reach out to Bluehost. We’re happy to help.
It's not just for big data
Adam Drake is an advisor to scale-up tech companies. He writes about ML/AI/data, leadership, and building tech teams.
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
Probably one of the nerdier things I do in my free time is fix and report transit errors on Google Maps. Accurate transit directions and schedules are extremely important if we want more people to take transit more often, especially in scenarios where good transit options exist! I do these bug reports and the…
[Twitter thread, Hacker News discussion, Reddit discussion]
Software engineer specializing in query engines and distributed systems
A while back, I was trying to speed up some code which finds unique items in a collection. For example, transforming "AABBADCAB" => "ABDC" . There are two ways to do this efficiently - one is based on sorting, the other based on hashing. So, which is faster? I couldn't find the answer, so I ran some experiments and…
I recently became intrigued by the concept of event sourcing as applied to back-end architecture, specifically a microservice-oriented approach. I have spent the last few years working predominantly on the front-end, and became enamored by the simplicity and elegance of this pattern as the backbone of front-end…
You may have heard about Bandersnatch , an interactive film released on Netflix as part of the Black Mirror series. I’ve heard about it when it was released, but didn’t get around to watch it until recently, and I was surprised at how deep and thorough the implementation is. The film consists of:
