601
Vector databases are the wrong abstraction
Today’s vector databases disconnect embeddings from their source data. We should treat embeddings more like database indexes—here’s how.
New
The latest blog posts to take off on Hacker News. 4,224 posts.
602
Prisma Postgres – Runs on bare metal and unikernels
At Prisma, we believe that deploying a database should be as simple as adding a new page in Notion. Today, we are excited to share the first milestone towards this vision: Prisma Postgres® gives developers an always-on database with pay-as-you-go pricing, thanks to our unique architecture design.
603
Using reinforcement learning and $4.80 of GPU time to find the best HN post
The OpenPipe platform has migrated to Weights & Biases and CoreWeave. Browse migration details and the OpenPipe technical archive.
604
Using SQLite as storage for web server static content
Why OpenRun uses a SQLite database instead of the local file system for static files.
605
Fruits (2020)
Fruits - Graph All The Things, a math blog by Martin Loncaric
606
607
How JPEG XL compares to other image codecs
The JPEG XL is a powerful codec – find out how it compares to other codecs, including JPEG XL vs HEIC and JPEG XL vs JPEG.
608
The PlanetScale vectors public beta
You can now use the vector data type for vector search and storage in your PlanetScale MySQL database.
609
A new JSON data type for ClickHouse
We’re excited to introduce our new and significantly enhanced JSON data type, purpose-built to deliver high-performance handling of JSON data. Our core engineer, Pavel Kruglov, dives into how we built this feature on top of ClickHouse's columnar storage.
610
Streaming joins are hard
Why are streaming joins so tricky? Discover the hidden complexities of real-time data, and learn how to tame the infinite stream!
611
New discovery reveals how diatoms capture CO2 so effectively
Tiny diatoms in the ocean are masters at capturing carbon dioxide (CO2) from the environment. They fix up to 20 percent of the Earth’s CO2. A research team at the University of Basel has now discovered a protein shell in these algae that is necessary for efficient CO2 fixation. This groundbreaking discovery can…
612
MVCC – the part of PostgreSQL we hate the most (2023)
As much as Andy loves PostgreSQL, there is one part that is terrible and causes many headaches for people. Learn what it is and why it sucks.
613
Sampling with SQL
Sampling is one of the most powerful tools you can wield to extract meaning from large datasets. It lets you reduce a massive pile of data into a small yet representative dataset that’s fast and easy to use.
614
Why does everyone run ancient Postgres versions?
Many companies are running old Postgres versions and missing out on many improvements. The reasons: Postgres works and upgrades suck.
615
Pg_parquet: An extension to connect Postgres and parquet
Crunchy Data is excited to release a new extension so you can write Postgres data to Parquet and or pull data from Parquet to Postgres. Craig has the details and sample code.
616
Upgrading Uber's MySQL Fleet
Learn all about our journey of successfully upgrading our MySQL fleet at Uber from v5.7 to v8.0, enhancing performance and reliability.
617
Zero-latency SQLite storage in every Durable Object
Kenton Varda introduces the next iteration of Cloudflare's Durable Object platform, which recently upgraded from a key/value store to a full relational system based on SQLite. For useful background on …
618
PostgreSQL Streaming Replication (WAL); What It Is and How to Configure One
What is Streaming replication in PostgreSQL?Streaming replication in PostgreSQL is an efficient method for maintaining a near real-time replica of a primary database on one or more standby servers.The primary server continuously sends data to replica
619
Nixiesearch: Running Lucene over S3, and why we're building a new search engine
A new search engine in 2024? Yes, but stateless — index on S3, serverless — no cluster state, with all Lucene features — filters, autocomplete, facets. And also with local embedding & RAG inference.
620
Putting a full power search engine in Ecto
My diatribe about adding support for ParadeDB to Ecto
621
Fast B-Trees
( This is part of a series on the design of zest . See the list of posts here .)
622
Optimizing Postgres table layout for maximum efficiency
Introduction When modeling a Postgres database, you probably don’t give much thought to the order of columns in your tables. After all, it seems like the kind of thing that wouldn’t affect storage or performance. But what if I told you that simply reordering your columns could reduce the size of your tables and…
623
624
Solving methane mysteries with satellite imagery
By combining two types of remote sensing data, we can see hidden leaks from ships
625
626
Phrase matching in Marginalia Search
Marginalia Search now properly supports phrase matching. This not only permits a more robust implementation of quoted search queries, but also helps promote results where the search terms occur in the document exactly in the same order as they do in the query. This is a write-up about implementing this change. This is…
627
How we built ngrok's data platform
At ngrok, we manage a ~100TiB, 500+ table data lake, managed by a very small team. Here's a look at how we built it and what unique challenges we solved.
628
In the land of LLMs, can we do better mock data generation?
"Lorem ipsum is latin, slightly jumbled, the remnants of a passage from Cicero's _de Finibus_ 1.10.32, which begins 'Neque porro quisquam est qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit...' [There is no one who loves pain itself, who seeks after it and wants to have it, simply because it is…
629
How Discord stores trillions of messages (2023)
Engineer Bo Ingram shares insight into how Discord shoulders its traffic and provides a platform for our users to communicate.
630
