991
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
992
Memory Management in Python
To speed-up memory operations and reduce fragmentation Python uses a special manager on top of the general-purpose allocator, called PyMalloc.
993
How to Manage Connections Efficiently in Postgres, or Any Database
Hitting the limit for maximum allowed connections is a common operational problem in Postgres. Here we look at a few techniques for managing connections and making efficient use of those that are available.
994
995
How to Become a Data Engineer in 2021
The demand for data engineers is growing rapidly. According to hired.com, the demand has increased by 45% in 2019. The median salary for Data Engineers in SF Bay Area is around $160k. So the question…
996
Datomic Cloud
Announcing Datomic Cloud: a fully AWS-integrated database, up and running from the Marketplace in minutes, delivering the complete Datomic information model.
997
RethinkDB 2.1 is out: high availability
Today we’re proud to announce RethinkDB 2.1 ( Forbidden Planet ). Download it now !
998
File systems unfit as distributed storage back ends: lessons from Ceph evolution
File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., SOSP’19 Ten years of hard-won lessons packed into just 17 pages (13 if you don’t co…
999
Text classification with Python 3.14's ZSTD module
Python 3.14 added Zstandard to stdlib; its incremental API finally makes classify-by-compression practical.
1000
1001
1002
1003
1004
FaunaDB 2.5.4
In 2012, Thomson, Diamond, Weng, et al. published Calvin: Fast Distributed Transactions for Partitioned Database Systems : a transactional protocol optimized for geographic replication. Each Calvin cluster is comprised of multiple replicas , where a replica is a collection of nodes which store a complete copy of the…
1005
1006
Running 10M PostgreSQL Indexes in Production
How Heap runs 10 million postgreSQL indexes in production.
1007
1008
1009
1010
All-in-one embedding model for interleaved text, images, and screenshots
TL;DR — We are excited to announce voyage-multimodal-3, a new state-of-the-art for multimodal embeddings and a big step forward towards seamless RAG and semantic search for documents rich with both…
1011
Millions of Tiny Databases
Millions of tiny databases, Brooker et al., NSDI’20 This paper is a real joy to read. It takes you through the thinking processes and engineering practices behind the design of a key part of …
1012
1013
Postgres 9.2 will feature linear read scalability up to 64 cores
Remember when I blogged about linear read scalability out to 32 cores ? Well, the awesome Nate Boley provided me with access to his brand n...
1014
Materialize: A Streaming Data Warehouse
Materialize offers a streaming data warehouse for real-time analytics & interoperability with millisecond latency, revolutionizing data handling.
1015
1016
Say no to Venn diagrams when explaining SQL joins (2016)
In recent times, there have been a couple of tremendously popular blog posts explaining JOINs using Venn Diagrams. After all, relational algebra and SQL are set oriented theories and languages, so …
1017
Perf Is Not Enough
Are database benchmarks still relevant ? Let's understand why it's a poor way to choose a database. | Reading time: 17 min read
1018
What SMART Stats Tell Us About Hard Drives
Have you ever wondered what your hard drive SMART errors actually mean? Find out what we look at to determine if a drive is about to fail.
1019
Memcached vs. Redis – More Different Than You Would Expect
Insights from the Kablamo Engineering Team
1020