841
LlamaCloud and LlamaParse
LlamaIndex introduces LlamaParse and LlamaParse for production-grade RAG. Unlock complex PDF data to improve LLM response quality. Discover how today.
New
The latest blog posts to take off on Hacker News. 4,224 posts.
842
Wddbfs – Mount a SQLite database as a filesystem
Often when I’m prototyping a project, I hesitate to use a sqlite database despite their many adavantages . It seems much easier to just dump a bunch of files in a directory and to rely on the universal support for the filesystem API to read/delete/update records. Part of this is avoiding the overhead of figuring out a…
843
Python datetime pitfalls, and what libraries are (not) doing about it
It’s no secret that the Python datetime library has its quirks. Not only are there probably more than you think; third-party libraries don’t address most of them! I created a new library to explore what a better datetime library could look like.
844
845
Ledger: Stripe's system for tracking and validating money movement
Technical details on how Stripe built Ledger, a state-of-the-art money movement tracking system, including how teams at Stripe interact with the data quality metrics that underlie our payment processing network.
846
We sped up time series by 20-30x
This is a follow up post that dives into how we managed to achieve such huge performance gains for time series (among other things), and why it was so hard in the first place.
847
A bird's eye view of Polars
Read how Polars executes your query from planning, optimizing to execution.
848
849
Analyzing Spotify Stream History
I recently learned Spotify provides downloads for users’ streaming history. For me, this is over 10 years worth of data, so at the very least it seemed like a good nostalgia trip. This post covers some of my analysis of my personal export, and hopefully is a good starting place if you’re interested in exploring your…
850
Is the "modern data stack" still a useful idea?
My vote: no.
851
Thinking about high-quality human data
[Special thank you to Ian Kivlichan for many useful pointers (E.g. the 100+ year old Nature paper “Vox populi”) and nice feedback. 🙏 ] High-quality data is the fuel for modern data deep learning model training. Most of the task-specific labeled data comes from human annotation, such as classification task or RLHF…
852
Postgres as queue
The team I've been working in for the last year or so have had great success using Postgres-as-queue. We've managed to avoid the following:
853
What's new in the Postgres 16 query planner
Postgres 16 introduces quite a few improvements to the query planner and makes many SQL queries run faster than they did on previous versions of PostgreSQL. This post is a deep dive into 10 of the improvements, including code blocks and comparisons of query plan output between Postgres 15 & Postgres 16.
854
A search engine in 80 lines of Python
In this post I explain how I built a search engine from scratch using python. The resulting search engine is used to search in the posts of the blogs I follow.
855
Implementing system-versioned tables in Postgres
There's no official support for system-versioned tables in Postgres yet, and the temporal extensions aren't supported on Azure/AWS/GCP. Let's implement it ourselves with 3 triggers and an index.
856
857
Transforming Postgres into a Fast OLAP Database
Introducing the search capabilities of ParadeDB.
858
UUID Benchmark War
This month’s PGSQL Phriday #015 topic is about UUIDs, hosted by Lætitia Avrot. Lætitia has called for a debate. No, no, no. I say let’s have an all-out war. A benchmark war. I have deci…
859
Why Postgres RDS didn't work for us
Background
860
A decoder-only foundation model for time-series forecasting
Posted by Rajat Sen and Yichen Zhou, Google Research Time-series forecasting is ubiquitous in various domains, such as retail, finance, manufacturi...
861
We built our customer data warehouse all on Postgres
Engineering deep-dives, product updates, and company news from Tembo — the platform for running coding agents across your stack.
862
RavenDB 6.0.2 (A Jepsen Report)
RavenDB is a distributed document database which repeatedly advertises its support for ACID transactions. 1 It’s intended for OLTP workloads, and offers a variety of ETL paths for exporting data to other systems. Its transactional API revolves around a session handle, which “represents a single business transaction on…
863
An Introduction to the WARC File (2021)
Want to know more about a tool in our web archiving toolbox? Your suggestions or questions for future posts about Archive-It technology are very welcome here .
864
What I talk about when I talk about query optimizer (part 1): IR design
Achieving Data Freedom Through Open Source and Rust
865
Multi-database support in DuckDB
DuckDB can attach MySQL, Postgres, and SQLite databases in addition to databases stored in its own format. This allows data to be read into DuckDB and moved between these systems in a convenient manner.
866
An open source DuckDB text to SQL LLM
Our first Text2SQL model release! | Reading time: 5 min read
867
CRDTs Turned Inside Out
🔰If CRDTs are new to you, here are some introductory links. - An interactive intro to CRDTs [https://jakelazaroff.com/words/an-interactive-intro-to-crdts/] - An introduction to state-based CRDTs [https://www.bartoszsypytkowski.com/the-state-of-a-state-based-crdts/] - CRDTs for non-academics…
868
Are we at peak vector database?
Seriously - why do we need all these vector databases? Do we need dozens of them?
869
Loro's rich text CRDT
This article presents the rich text CRDT algorithm implemented in Loro, complying with Peritext's criteria for seamless rich text collaboration. Furthermore, it can be built on top of any List CRDT algorithms and turn them into rich text CRDTs.
870
Qdrant, the Vector Search Database, raised $28M in a Series A round
Qdrant is an Open-Source Vector Search Engine written in Rust. It provides fast and scalable vector similarity search service with convenient API.