Topics /
The most popular blog posts about databases & data on Hacker News. 371 posts.
Following up on the work from our previous blog post, we are releasing today an arXiv paper titled “Giraffe: Adventures in Expanding Context Lengths in LLMs”. Giraffe is a new family of models that are...
We are thrilled to introduce Argilla Feedback, completely open-source and designed to enhance the performance, safety and reliability of Large Language Models.
In the recent past, a typical client/server environment consisted of multiple clients connected to a central database server. A central database architecture is a system where all data is stored in a single centralized location. When client A from Si...
Chris is cooking up some examples for us on how to use AI inside Postgres. We have a simple demo of using pgvector and Open AI to grab relationships and query for other similar items.
Checking my assumptions about syncable data structures
While making a proposal to update Noto fonts for OpenStreetMap tiles, which fixes an issue with Kurdish labels using ڵا , I noticed a street with mismatched parentheses and was anticipating a deep dive into the tile renderer. But the actual problem was somewhere else:
Recently, we had a discussion about whether we should use native enums in PostgreSQL, or rely on regular string columns with CHECK constraints. In the end, we decided that we wanted to go with the latter.
Run sqlite3 dbs in multiple regions with rsync
In this post, I am going to talk about the N + 1 queries problem. While trying to solve this problem myself recently, I noticed most of the blog posts only talk about the very simple version of the problem and the proposed solutions would break down when the use cases get complex. I will try to get into more depth and…
A short recap of how SQLite now has a WASI build
Vector search isn't just for AI embeddings. Use HNSW for geo-spatial queries, stock covariance, chess positions, text tokens, and multi-modal recommendations with custom metrics.
Using PostgreSQL as a full-text search engine is tempting because it requires less infrastructure. But is its set of search-related features enough to compete with the Lucene based alternatives?
This paper is from SOSP'13. The Polyjuice paper, which we studied last week, built on the Silo codebase and commit protocol, which led me ...
AutoGPT decided to drop the support for vector databases: Pinecone, Milvus, Redis, Weaviate - all gone. What has happened to the original idea of efficiently storing agent's memories?
Glean is the Enterprise AI platform connected to your enterprise's data. Find, create, and automate anything. Explore what Glean can do for you!
How moving from Vnode-based replication to tablets helps dynamically distribute data across the cluster, ultimately increasing ScyllaDB’s elasticity.
As I've written about before , a PostgreSQL superuser always has the ability to take over the operating system account in which PostgreSQL i...
Those who fail to study databases are doomed to write them
The DuckDB team is happy to announce the latest DuckDB version (0.7.0) has been released. This release of DuckDB is named “Labradorius” after the Labrador Duck (Camptorhynchus labradorius) that was native to North America. To install the new version, please visit the installation guide. The full release notes can be…
A thorough comparison of the Apache Hudi™, Delta Lake, and Apache Iceberg™ data lakehouse projects across features, community, and performance benchmarks. This includes a focus on common use cases such as change data capture (CDC) and data ingestion.
Faster is always better, especially when executing SQL queries. We recently introduced SQL-over-HTTP to our driver, which previously only supported WebSockets. Why did we do that? And which approach is faster? Our journey developing the WebSockets serverless driver We first developed the Neon driver to help developers…
We are excited to announce a new set of functions to generate svgs from Postgres and PostGIS! This gives you really easy maps, images, or charts directly from your database. Once you start reading through these samples, you'll want to start playing with images from your database.
PostgreSQL 16 was released last week. This is the story of a feature.
A little-discussed method enables inserting rows with bound data into SQLite faster than any existing technique. This novel method is then discovered to have a drawback that makes it generally unusable. The rest of this article explores how to get the best insert performance out of SQLite generally; what's in your…
I remember those days, oh so long ago, it seems like another lifetime. I haven’t used Pandas in many a year, decades, or whatever. We’ve all been there, done that. Pandas I mean. I would dare say it’s a rite of passage for most data folk. For those using Python, it’s probably one of the […]
One of the things that frustrates me with having a local music library is the tedium of tagging. While there are tools (like beets or MusicBrainz Picard) to make it easier, I feel there are fundamental issues with the design… Continue reading →
Building a database in the 2020s
Trickest workflow parses 15TB of GitHub Archive logs and extracts public details for every user and repository back to 2015.
Introducing Apache Pinot 1.0 Release
