541
Lessons learned scraping 100B product pages
Price Intelligence experience scraping over 100 billion product pages. Learn the best practices and demands of extracting product data from e-commerce stores.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 2,337 posts.
542
543
Datomic Cloud
Announcing Datomic Cloud: a fully AWS-integrated database, up and running from the Marketplace in minutes, delivering the complete Datomic information model.
544
RethinkDB 2.1 is out: high availability
Today we’re proud to announce RethinkDB 2.1 ( Forbidden Planet ). Download it now !
545
546
547
FaunaDB 2.5.4
In 2012, Thomson, Diamond, Weng, et al. published Calvin: Fast Distributed Transactions for Partitioned Database Systems : a transactional protocol optimized for geographic replication. Each Calvin cluster is comprised of multiple replicas , where a replica is a collection of nodes which store a complete copy of the…
548
549
Running 10M PostgreSQL Indexes in Production
How Heap runs 10 million postgreSQL indexes in production.
550
551
552
All-in-one embedding model for interleaved text, images, and screenshots
TL;DR — We are excited to announce voyage-multimodal-3, a new state-of-the-art for multimodal embeddings and a big step forward towards seamless RAG and semantic search for documents rich with both…
553
Materialize: A Streaming Data Warehouse
Materialize offers a streaming data warehouse for real-time analytics & interoperability with millisecond latency, revolutionizing data handling.
554
555
Say no to Venn diagrams when explaining SQL joins (2016)
In recent times, there have been a couple of tremendously popular blog posts explaining JOINs using Venn Diagrams. After all, relational algebra and SQL are set oriented theories and languages, so …
556
Perf Is Not Enough
Are database benchmarks still relevant ? Let's understand why it's a poor way to choose a database. | Reading time: 17 min read
557
What SMART Stats Tell Us About Hard Drives
Have you ever wondered what your hard drive SMART errors actually mean? Find out what we look at to determine if a drive is about to fail.
558
Memcached vs. Redis – More Different Than You Would Expect
Insights from the Kablamo Engineering Team
559
560
561
Understanding Smallpond and 3FS
A concise breakdown of what smallpond and 3FS are, how to use them, and if they're suitable for your data processing needs.
562
563
We cut our Mongo DB costs by 90% by moving to Hetzner
We moved MongoDB Atlas off AWS and onto self-hosted Hetzner boxes — 90% cost cut, no performance loss. Here's the setup, the Ansible, and what broke.
564
565
566
567
Polars Cloud: The Distributed Cloud Architecture to Run Polars Anywhere
We introduce Polars Cloud, the distributed cloud architecture to scale and run Polars anywhere.
568
How We Built Fly Postgres
The database. The app. The legend.
569
570
SQLite in Production: Optimizing WAL Mode, Concurrency, and VFS Layers
Transitioning SQLite from a local development tool to a production-grade database requires a deep understanding of its internal mechanics. This article explores how to tune WAL mode, manage busy handlers, and leverage custom Virtual File System (VFS) layers to achieve ultra-low latency.