2071
Data looks better naked
Rather than dressing data up, strip it down—remove to improve.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
2072
Billions of Messages a Day – Yelp's Real-Time Data Pipeline
Billions of Messages a Day - Yelp's Real-time Data Pipeline Justin C., Software Engineer Jul 14, 2016 This post is part of a series covering Yelp's real-time streaming data infrastructure....
2073
Elasticsearch – the definitive guide
Powered by Elasticsearch. Ready to deploy your data? Start free.
2074
2075
Mode Studio – Python, R and SQL Editor
Today, we're releasing two of the biggest updates in Mode's history, designed not only to make Mode more powerful, but also to make that power accessible to everyone.
2076
PostgreSQL when it is not your job
( Note beforehand: I didn’t get everything. You really also have to look at his slides for the details. Thanks Christophe for posting the slides right afterwards !)
2077
Vectors are over, hashes are the future
Get an introduction into the thinking behind the rise of neural hashing technology — and learn why this may end up being an enormous shift in AI advancement.
2078
Reactive Relational Algebra
databases plus wibbly wobbly timey wimey stuff
2079
Jepsen: Scylla 4.2-rc3
Scylla is a distributed wide-column 1 database which originated as a C++ port of Cassandra, aiming for improved performance. It supports both Cassandra- and DynamoDB -compatible APIs, and is intended for high-throughput, low-latency workloads, including analytics, messaging, and other time-series data.
2080
Faster Index I/O with NVMe SSDs
The Marginalia Search index has been partially rewritten to perform much better, using new data structures designed to make better use of modern hardware. This post will cover the new design, and will also touch upon some of the unexpected and unintuitive performance characteristics of NVMe SSDs when it comes to read…
2081
Lucene: The Good Parts
Before MongoDB, before Cassandra, before “NoSQL”, there was Lucene. Did you know that Doug Cutting wrote the first versions of …
2082
How TimescaleDB compresses time-series data
TimescaleDB compression with hypercore - columnar storage with up to 98% ratio in PostgreSQL. segmentby/orderby configuration and a benchmark for IoT and time-series.
2083
2084
A Performance Cheat Sheet for PostgreSQL
Performance tuning is not trivial, but you can go a long way with a few basic guidelines. In this blog, we will discuss how you analyze the workload of the database, and then review a list of important configuration parameters to improve the performance of PostgreSQL.
2085
Inside Cloud Spanner and the CAP Theorem
Building systems that manage globally distributed data, provide data consistency and are also highly available is really hard. The beauty of the cloud is that someone else can build that for you.
2086
Three Six Mafia – Data about "6/6/6 dating" (2024)
Most guys my age have "the chat". The one with your college buddies that only exists to share memes, argue, bully, and occasionally announce that you got a promotion or had a kid. I am like most guys.
2087
2088
Google Cloud SQL now supports PostgreSQL 13
Fully managed Cloud SQL cloud database service now supports PostgreSQL 13.
2089
Using SIMD to aggregate billions of values per second
How SIMD instructions make aggregations faster in QuestDB, including benchmark results and a comparison with Postgres.
2090
2091
A distributed queue in a single JSON file on object storage
How to build a single global queue for distributed systems on object storage: Start with a single file on object storage, then add write batching, a stateless broker, and high-availability.
2092
2093
2094
We need new data books, so we published one
A site around enabling companies and knowledge workers to be informed and enabled with the data they need for their work.
2095
Jepsen: TiDB 2.1.7
In 2010, Google engineers Daniel Peng & Frank Dabek published Large-scale Incremental Processing Using Distributed Transactions and Notifications , which described Percolator: a Google-internal database for random access transactional workloads where low latencies are not required. Percolator uses a global…
2096
The super effectiveness of Pokémon embeddings using only raw JSON and images
Embeddings encourage engineers to go full YOLO because it’s actually rewarding to do so!
2097
Using Bloom filters to efficiently synchronise hash graphs
This blog post uses MathJax to render mathematics. You need JavaScript enabled for MathJax to work.
2098
Study: carpooling apps could reduce traffic 3x in NYC
Traffic is not just a nuisance for drivers: it’s also a public-health hazard and bad news for the economy. Transportation studies put the annual cost of congestion at $160 billion , which includes 7 billion hours of time lost to sitting in traffic and an extra 3 billion gallons of fuel burned. One way to improve…
2099
Amazon S3 Object Lambda
March 15, 2023 – You can now use S3 Object Lambda with Amazon CloudFront to tailor content for end users. August 13, 2024 – Added a note clarifying that, when following the walkthrough, you should not mark the Specify Lambda function version option that was added after this post was published. When you store data in…
2100
Migration from Postgres to Datomic
Recently, I migrated my Clojure-driven pet project from PostgreSQL to Datomic. This is Queryfeed , a web application to fetch data from social networks. I’ve been running it for several years considering it as a playground for some experiments. Long ago, it was written in Python, then I ported it to Clojure.