New
The latest blog posts to take off on Hacker News. 185 posts.
ISO 8583: The language of credit cards
Discover the inner workings of ISO 8583, the global standard for credit card transaction messaging. Learn how it powers payment processing across networks and explore its structure, fields, and real-world applications.
Electric (Postgres sync engine) beta release
The Electric sync engine is now in BETA. If you haven't checked out Electric recently, it's a great time to take another look.
Running Durable Workflows in Postgres Using DBOS
Technical deep dive into the new DBOS integration for Supabase
Limbo: A complete rewrite of SQLite in Rust
we forked SQLite with the libSQL project. What would it be like if we just rewrote it?
OrioleDB beta7: Benchmarks
OrioleDB is a storage extension for PostgreSQL which uses PostgreSQL's pluggable storage system. Designed as a drop-in replacement for PostgreSQL's existing Heap storage, OrioleDB aims to overcome scalability bottlenecks and fully utilize modern hardware capabilities. By integrating seamlessly with PostgreSQL, it…
What happens if we remove 50 percent of Llama?
Discover Sparse Llama: A 50% pruned, GPU-optimized Llama 3.1 model with 2:4 sparsity, enabling faster, cost-effective inference without sacrificing accuracy.
Amazon S3 Adds Put-If-Match (Compare-and-Swap)
Discover more about what's new at AWS with Amazon S3 adds new functionality for conditional writes
32k context length text embedding models
TL;DR – We are excited to announce voyage-3 and voyage-3-lite embedding models, advancing the frontier of retrieval quality, latency, and cost. voyage-3 outperforms OpenAI v3 large by 7.55% on aver…
SQLite’s Use of Tcl (2017)
Tap, Click, Launch
Amazon S3 now supports the ability to append data to an object
Discover more about what's new at AWS with Amazon S3 Express One Zone now supports the ability to append data to an object
Building Databases over a Weekend
In this post we take you on a walkthrough on how you can use DataFusion to build your own developer experience for databases.
All-in-one embedding model for interleaved text, images, and screenshots
TL;DR — We are excited to announce voyage-multimodal-3, a new state-of-the-art for multimodal embeddings and a big step forward towards seamless RAG and semantic search for documents rich with both…
Optimizers: The Low-Key MVP
The query optimizer is an important part of any analytical database system as it provides considerable performance improvements compared to hand-optimized queries, even as the state of your data changes.
Non-elementary group-by aggregations in Polars vs pandas
A closer look at non-elementary group-by aggregations
Netflix's Distributed Counter Abstraction
By: Rajiv Shringi, Oleksii Tkachuk, Kartik Sathyanarayanan
Jepsen: Bufstream 0.1
2024-11-13 : An earlier version of this report asserted that consumers with auto-commit enabled could lose data by automatically committing offsets returned by the most recent poll. This claim was based in part on Confluent’s documentation , which states:
Do you need Redis? PostgreSQL does queuing, locking, and pub/sub (2021)
It's a common architecture to have PostgreSQL and Redis serve as the backbone of your app, but PostgreSQL may be capable of everything you use Redis for.
Vector databases are the wrong abstraction
Today’s vector databases disconnect embeddings from their source data. We should treat embeddings more like database indexes—here’s how.
Prisma Postgres – Runs on bare metal and unikernels
At Prisma, we believe that deploying a database should be as simple as adding a new page in Notion. Today, we are excited to share the first milestone towards this vision: Prisma Postgres® gives developers an always-on database with pay-as-you-go pricing, thanks to our unique architecture design.
Using reinforcement learning and $4.80 of GPU time to find the best HN post
The OpenPipe platform has migrated to Weights & Biases and CoreWeave. Browse migration details and the OpenPipe technical archive.
Using SQLite as storage for web server static content
Why OpenRun uses a SQLite database instead of the local file system for static files.
How JPEG XL compares to other image codecs
The JPEG XL is a powerful codec – find out how it compares to other codecs, including JPEG XL vs HEIC and JPEG XL vs JPEG.
The PlanetScale vectors public beta
You can now use the vector data type for vector search and storage in your PlanetScale MySQL database.
A new JSON data type for ClickHouse
We’re excited to introduce our new and significantly enhanced JSON data type, purpose-built to deliver high-performance handling of JSON data. Our core engineer, Pavel Kruglov, dives into how we built this feature on top of ClickHouse's columnar storage.
Streaming joins are hard
Why are streaming joins so tricky? Discover the hidden complexities of real-time data, and learn how to tame the infinite stream!
New discovery reveals how diatoms capture CO2 so effectively
Tiny diatoms in the ocean are masters at capturing carbon dioxide (CO2) from the environment. They fix up to 20 percent of the Earth’s CO2. A research team at the University of Basel has now discovered a protein shell in these algae that is necessary for efficient CO2 fixation. This groundbreaking discovery can…