Topics /
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
“JPEG” or the image encoding specification by the “Joint Photographic Experts Group” (JPEG) is a truly universal format at this stage. You really cannot go very far on the internet without seeing a JPEG file. The amount of content encoded in JPEGs must be surely biblical by now. If there is one thing that is going to…
Last year, Interline began a "startup in residence" at the Metropolitan Transportation Commission. Now we're pleased to publicly release our first creation: the San Francisco Bay Area's Regional GTFS Feed.
ZFS has been making headlines lately, so it seems like the right time to talk about the longstanding relationship between FreeBSD and ZFS. ...
Data labeling is often the biggest bottleneck in machine learning. Active learning lets you train machine learning models with much less labeled data. The best AI-driven companies, like Tesla, use active learning.
The only enterprise AI data platform that cuts complexity, reduces costs, and gets you to production faster.
Shital Shah's personal website and blog. Research Engineer at Microsoft Research with interests in deep learning and reinforcement learning. Created AirSim, TensorWatch, archai, most recently worked on training Phi series of LLM models.
Kaggle is hosting Wikimedia Enterprise's beta release of structured data in both French and English. Kaggle is home to a vast trove of open and accessible data, with mor…
Learn how PlanetScale lets you revert changes to your database after a migration with no downtime and zero data loss.
This blog post outlines how CockroachDB executes queries and shares Cockroach Labs' vision for future work on distributed processing.
Hi. I’m a former developer who’s moved into database administration, and here’s what I wish somebody would have told me when I got started. 7. SQL functions rarely perform well. Good developers like to reuse code by putting it into functions, and then calling those functions from multiple places. That’s a great…
Understanding & mitigating randomly slow writes in PostgreSQL
Once more: we are not modeling reality, but the way information about reality is processed, by people. — Bill Kent I've got this working theory that you can...
How we solved request logging at scale by moving from MariaDB to ClickHouse, Kafka, and Vector after our deprecated database engine couldn't keep up with billions of monthly requests.
tl;dr: You can perform non-blocking multi-object atomic reads and writes across arbitrary data partitions via some simple multi-versioning and by storing metadata regarding related items.
If you're interested in building a semantic search engine in Rust, this article will show you how! We'll cover building a basic engine using sentence transformers and a kd-tree.
No single cloud fits all. Explore how we build a more flexible future with hybrid cloud.
Apache Spark is generating quite some buzz right now. Databricks, the company founded to support Spark raised $14M from Andreessen Horowitz, Cloudera has decided to fully support Spark, and others chime in that it's the next big thing. So I thought it's high time I took a look to get an understanding what the whole…
At Citus we make it simple to shard PostgreSQL. So we’ve thought a lot about different data models for sharding. This post covers 5 different data models for sharding, from sharding by tenant (multi-tenant data models), sharding by geography, sharding by entity id, sharding a graph, and time-based partitioning.
Hello. I've just uploaded ZSON extension on GitHub: https://github.com/afiskon/zson ZSON learns on your common JSONB documents and creates a dictionary …
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
Brewer’s CAP theorem, and Gilbert and Lynch’s formalization of it , is the first introduction to hard trade-offs for many distributed systems engineers. Going by the vast amounts of ink and bile spent on the topic, it is not unreasonable for new folks to conclude that it’s an important, foundational, idea.
A small, cool fact about SQLite is that its columns are flexibly typed. You can store any value in any column! Try it out: sqlite> create table t1 (v1 int, v2 varchar(10)); sqlite> insert into t1 values ("abc", "this string is longer than 10 characters!"); sqlite> select * from t1; abc|this string is longer than 10…
SBE Article logo Discussion on HackerNews and Lobsters. MongoDB has recently released a new query engine coming in version 7.0. I was one of the people work...
William Kent, "A Simple Guide to Five Normal Forms in Relational Database Theory", Communications of the ACM 26(2), Feb. 1983, 120-125. Also IBM Technical Report TR03.159, Aug. 1981. Also presented at SHARE 62, March 1984, Anaheim, California. Also in A.R. Hurson, L.L. Miller and S.H. Pakzad, Parallel Architectures…
SQL by default isn’t typically friendly to dive into, and especially so if you’re reading someone else’s already created queries. For some reason most people throw out principles we follow in other languages such as commenting and composability just for SQL. I was recently reminded of a key feature in Postgres that…
Note: This post and our new engineering blog can be found at lumi.dev
