2761
Lossless Log Aggregation – Reduce Log Volume by 99% Without Dropping Data
Reduce Log Volume by 99% Without Dropping Data
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
2762
2763
Ice cold archive storage
Get the latest cloud storage news here from Google Cloud, with a new archive storage class and Persistent Disk updates.
2764
Anthropic Economic Index report: economic primitives
New metrics of AI usage provide a rich portrait of interactions with Claude in November 2025, just prior to the release of Opus 4.5.
2765
A Distributed File System in Go Cut Average Metadata Memory Usage to 100 Bytes
Learn JuiceFS Enterprise Edition’s metadata engine design and optimization methods that reduced its metadata memory usage by 90%.
2766
Upsert in SQL
Inserting and updating data with a single query.
2767
A Python-first data lakehouse
Prototype in Marimo, deploy in Bauplan. Learn how to build production-grade pipelines from notebooks with a Python-native stack. No handoffs, no rewrites.
2768
PostgreSQL 10: Partitions of partitions
PostgreSQL version 10 brings a much anticipated feature: (Native) Table Partitioning .
2769
Data Manipulation in Clojure Compared to R and Python
I spend a lot of time developing and teaching people about Clojure's open source tools for working with data. Almost everybody who wants to use Clojure…
2770
In the land of LLMs, can we do better mock data generation?
"Lorem ipsum is latin, slightly jumbled, the remnants of a passage from Cicero's _de Finibus_ 1.10.32, which begins 'Neque porro quisquam est qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit...' [There is no one who loves pain itself, who seeks after it and wants to have it, simply because it is…
2771
2772
Managed Redis on Google Cloud Platform
Google Cloud provides managed database services for your favorite open source data stores as well as Google proprietary technologies. Today we’re announcing updates to both.
2773
Fixing Google Map Transit Feed Mistakes in Taiwan
Probably one of the nerdier things I do in my free time is fix and report transit errors on Google Maps. Accurate transit directions and schedules are extremely important if we want more people to take transit more often, especially in scenarios where good transit options exist! I do these bug reports and the…
2774
Where machine learning meets rule-based systems
Summary: This post addresses some high-level questions like: Longer term, how much of the verification of Intelligent Autonomous Systems can be done with just Machine Learning (ML)? Should most req…
2775
2776
PostgreSQL Count(*) Performance Improvements
count(*) is often quite slow in PostgreSQL. This article explores how to count rows faster using approximations and other tricks.
2777
2778
Analyzing Last.fm Listening History
Last.fm is a web site that tracks your music listening history across devices (computer, phone, iPod, etc) and services (Spotify, iTunes, Google Play, etc). I’ve been using Last.fm for nearly 10 years now, and my tracked listening history goes back even further when you consider all my pre-existing iTunes play counts…
2779
Recommending music on Spotify with deep learning
An overview of what I've been doing as part of my internship at Spotify in NYC this summer: using convolutional neural networks for audio-based music recommendation.
2780
How to become a data scientist
This is Part One in a three-part series examining how to become a data scientist. Supported by extensive research and expert opinions, it aims to provide a comprehensive guide to anyone looking to move into this field, irrespective of background and experience. The topic of Part One is: "What is Data Science?".
2781
OrioleDB beta7: Benchmarks
OrioleDB is a storage extension for PostgreSQL which uses PostgreSQL's pluggable storage system. Designed as a drop-in replacement for PostgreSQL's existing Heap storage, OrioleDB aims to overcome scalability bottlenecks and fully utilize modern hardware capabilities. By integrating seamlessly with PostgreSQL, it…
2782
Call me maybe: final thoughts
Previously in Jepsen , we discussed Riak . Now we’ll review and integrate our findings.
2783
Anonymized data is rarely anonymous
Justin Sherman for Wired points out the farce that is anonymized data: Data on hundreds of millions of Americans’ races, genders, ethnicities, religions, sexual orientations, political beliefs, int…
2784
DELETEs Are Difficult
Why are database DELETEs complex and inefficient? Uncover challenges from physical data removal to autovacuum, and find strategies for managing large deletions.
2785
The Use of assert() in SQLite
The assert(X) macro is part of standard C , in the <assert.h> header file. SQLite adds three other assert()-like macros named NEVER(X), ALWAYS(X), and testcase(X).
2786
Improving compression at scale with Zstandard
Two years ago, Facebook open-sourced Zstandard v1.0, a landmark data compression solution that offers best-in-kind performance. Since then, we’ve released a variety of enhancements and advanc…
2787
ZFS Gotchas
Things Nobody Told You About ZFS Yes, it's back. You may also notice it is now hosted on my Blogger page - just don't have time to deal w...
2788
2789
Introducing FreeNAS Corral
In the TrueNAS blog, discover the latest in scalable data storage solutions. Stay updated on the latest innovations in TrueNAS technology.
2790
Avoiding “OR” for Better Query Performance
OR in the WHERE condition of a PostgreSQL database query is usually a cause of bad query performance. How to rewrite queries without OR.