Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
Redshift Spectrum – Exabyte-Scale In-Place Queries of S3 Data
Now that we can launch cloud-based compute and storage resources with a couple of clicks, the challenge is to use these resources to go from raw data to actionable results as quickly and efficiently as possible. Amazon Redshift allows AWS customers to build petabyte-scale data warehouses that unify data from a variety…
Unstructured Datatypes in Postgres – Hstore vs. JSON vs. JSONB
All about when to use unstructured data types in Postgres, such as Hstore, JSON, and JSONB. The tl;dr is that the right data type depends on your use case. Here we dig deep into the benefits, and why JSONB became so popular since it first got real and proper support in Postgres 9.4. The B in JSONB stands for better.
Apache Spark 1.0.0
Spark 1.0.0 is a major release marking the start of the 1.X line. This release brings both a variety of new features and strong API compatibility guarantees throughout the 1.X line. Spark 1.0 adds a new major component, Spark SQL , for loading and manipulating structured data in Spark. It includes major extensions to…
Applying Textbook Data Structures for Real Life Wins
How we leveraged a textbook data structure in our core platform and achieved a 15x speed up for a key data processing step.
Pg_parquet: An extension to connect Postgres and parquet
Crunchy Data is excited to release a new extension so you can write Postgres data to Parquet and or pull data from Parquet to Postgres. Craig has the details and sample code.
Using machine learning to index text from billions of images
Dash knows your context, your team, and your work, so your team can stay organized, easily find and share knowledge, and keep projects secure, all from one place.
Trying chDB, an embeddable ClickHouse engine
A lightweight in-process SQL OLAP engine, powered by ClickHouse.
On Disk IO, Part 3: LSM Trees
If you like the series, check out my book on Database Internals!
Mistakes Beginners Make When Working with Databases
When you start out as a developer there’s an overwhelming amount of things to grasp. First there’s the language itself, then all the quirks of the specific framework you’re using,and after that (or maybe before) we’ll throw front-end development into the mix, and somewhere along the line you have to decide to store…
Bcachefs, an Introduction/Exploration
Introduction & background information NOTE: This content is from an internal talk I gave, thus the reason it may read like a presentation So what is …
Index Investing Makes Markets and Economies More Efficient (2016)
U.S. equity index funds have grown dramatically in recent decades, from a negligible $500MM in assets in the early 1980s to a staggering $4T today. The consensus view in the investment community is that this growth is unsustainable. Indexing, after all, is a form of free-riding, and a market can only support so many…
How can we know if paid search advertising works?
Addressing causal problems on major eBay and Facebook
Uses and abuses of cloud data warehouses
Data Warehouses are great for many things but often misused for operational workloads.
How JPEG XL compares to other image codecs
The JPEG XL is a powerful codec – find out how it compares to other codecs, including JPEG XL vs HEIC and JPEG XL vs JPEG.
What's the big deal about embedded key-value databases?
What's the big deal about key-value databases like FoundationDB and RocksDB?
Improve developer habits by showing time cost of DB queries
This is the first in a series of posts where I share a quick, easy to implement tip that I’ve found useful in my development career
Postgresql 9.2 will have boat-loads of performance enhancements
This blog is about my work on the Postgres open source database, and is published on Planet PostgreSQL. PgLife allows monitoring of all Postgres community activity.
Gemini API File Search is now multimodal
Updates to the Gemini API File Search tool makes building efficient, multimodal file retrieval systems easier for developers.
Speeding up PostgreSQL dump/restore snapshots
How targeted improvements helped us speed up bulk data loads and complex schemas.
Introducing pgzx: create PostgreSQL extensions using Zig
We are excited to introduce pgzx, a framework for creating Postgres extensions using the Zig programming language.