2071
Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 4,225 posts.
2072
Data looks better naked
Rather than dressing data up, strip it down—remove to improve.
2073
Billions of Messages a Day – Yelp's Real-Time Data Pipeline
Billions of Messages a Day - Yelp's Real-time Data Pipeline Justin C., Software Engineer Jul 14, 2016 This post is part of a series covering Yelp's real-time streaming data infrastructure....
2074
Elasticsearch – the definitive guide
Powered by Elasticsearch. Ready to deploy your data? Start free.
2075
2076
Mode Studio – Python, R and SQL Editor
Today, we're releasing two of the biggest updates in Mode's history, designed not only to make Mode more powerful, but also to make that power accessible to everyone.
2077
PostgreSQL when it is not your job
( Note beforehand: I didn’t get everything. You really also have to look at his slides for the details. Thanks Christophe for posting the slides right afterwards !)
2078
Vectors are over, hashes are the future
Get an introduction into the thinking behind the rise of neural hashing technology — and learn why this may end up being an enormous shift in AI advancement.
2079
Reactive Relational Algebra
databases plus wibbly wobbly timey wimey stuff
2080
Jepsen: Scylla 4.2-rc3
Scylla is a distributed wide-column 1 database which originated as a C++ port of Cassandra, aiming for improved performance. It supports both Cassandra- and DynamoDB -compatible APIs, and is intended for high-throughput, low-latency workloads, including analytics, messaging, and other time-series data.
2081
Faster Index I/O with NVMe SSDs
The Marginalia Search index has been partially rewritten to perform much better, using new data structures designed to make better use of modern hardware. This post will cover the new design, and will also touch upon some of the unexpected and unintuitive performance characteristics of NVMe SSDs when it comes to read…
2082
Lucene: The Good Parts
Before MongoDB, before Cassandra, before “NoSQL”, there was Lucene. Did you know that Doug Cutting wrote the first versions of …
2083
How TimescaleDB compresses time-series data
TimescaleDB compression with hypercore - columnar storage with up to 98% ratio in PostgreSQL. segmentby/orderby configuration and a benchmark for IoT and time-series.
2084
2085
A Performance Cheat Sheet for PostgreSQL
Performance tuning is not trivial, but you can go a long way with a few basic guidelines. In this blog, we will discuss how you analyze the workload of the database, and then review a list of important configuration parameters to improve the performance of PostgreSQL.
2086
Inside Cloud Spanner and the CAP Theorem
Building systems that manage globally distributed data, provide data consistency and are also highly available is really hard. The beauty of the cloud is that someone else can build that for you.
2087
Three Six Mafia – Data about "6/6/6 dating" (2024)
Most guys my age have "the chat". The one with your college buddies that only exists to share memes, argue, bully, and occasionally announce that you got a promotion or had a kid. I am like most guys.
2088
2089
Google Cloud SQL now supports PostgreSQL 13
Fully managed Cloud SQL cloud database service now supports PostgreSQL 13.
2090
Using SIMD to aggregate billions of values per second
How SIMD instructions make aggregations faster in QuestDB, including benchmark results and a comparison with Postgres.
2091
2092
A distributed queue in a single JSON file on object storage
How to build a single global queue for distributed systems on object storage: Start with a single file on object storage, then add write batching, a stateless broker, and high-availability.
2093
2094
2095
We need new data books, so we published one
A site around enabling companies and knowledge workers to be informed and enabled with the data they need for their work.
2096
Jepsen: TiDB 2.1.7
In 2010, Google engineers Daniel Peng & Frank Dabek published Large-scale Incremental Processing Using Distributed Transactions and Notifications , which described Percolator: a Google-internal database for random access transactional workloads where low latencies are not required. Percolator uses a global…
2097
The super effectiveness of Pokémon embeddings using only raw JSON and images
Embeddings encourage engineers to go full YOLO because it’s actually rewarding to do so!
2098
Using Bloom filters to efficiently synchronise hash graphs
This blog post uses MathJax to render mathematics. You need JavaScript enabled for MathJax to work.
2099
Study: carpooling apps could reduce traffic 3x in NYC
Traffic is not just a nuisance for drivers: it’s also a public-health hazard and bad news for the economy. Transportation studies put the annual cost of congestion at $160 billion , which includes 7 billion hours of time lost to sitting in traffic and an extra 3 billion gallons of fuel burned. One way to improve…
2100
Amazon S3 Object Lambda
March 15, 2023 – You can now use S3 Object Lambda with Amazon CloudFront to tailor content for end users. August 13, 2024 – Added a note clarifying that, when following the walkthrough, you should not mark the Specify Lambda function version option that was added after this post was published. When you store data in…