361
Building and scaling Notion's data lake
How Notion build and grew our data lake to keep up with rapid growth
New
The latest blog posts to take off on Hacker News. 2,337 posts.
362
The economics of a Postgres free tier
Let's look at the numbers behind Xata's free tier. How much does a database cost us and why are we offering them for free.
363
Binance built a 100PB log service with Quickwit
Binance Scales its Log Service to 100PB and Saves Millions with Quickwit
364
Turbopuffer: Fast search on object storage
Inaugural blog post about the development of turbopuffer, a search engine that uses object storage and SSD caching for cost-effective, low latency search. This post describes into the motivation behind its creation, its unique architecture, and how it significantly reduces costs for large-scale vector searches…
365
DuckDB Community Extensions
DuckDB extensions can now be published as DuckDB Community Extensions. The repository makes it easier for users to install extensions using the INSTALL extension_name FROM community syntax. Extension developers avoid the burdens of compilation and distribution.
366
GraphRAG is now on GitHub
GraphRAG, a graph-based approach to retrieval-augmented generation (RAG) that significantly improves question-answering over private or previously unseen datasets, is now available on GitHub. Learn more:
367
What Happens When You Put a Database in the Browser?
Explore DuckDB Wasm for fast, in-browser analytical SQL. Learn how to instantiate the JS API, query Parquet files, and export data to CSV with zero latency. | Reading time: 8 min read
368
369
NumPy-style broadcasting in Futhark
A high-performance and high-level purely functional data-parallel array programming language that can execute on the GPU and CPU.
370
NumPy 2.0
NumPy 2.0.0 is the first major release since 2006. It is the result of 11 months of development since the last feature release and is the work of 212 contributors spread over 1078 pull requests. It contains a large number of exciting new features as well as changes to both the Python and C APIs.
371
Postgres 17: Streaming I/O for sequential scans and ANALYZE
We discuss streaming and vectored I/O in Postgres 17. This is an important step towards implementing asynchronous I/O in Postgres. In Postgres 17 we do not yet have asynchronous I/O, but we do see a performance benefit from what is essentially a refactoring work around the internal APIs.
372
How Meta trains large language models at scale
As we continue to focus our AI research and development on solving increasingly complex problems, one of the most significant and challenging shifts we’ve experienced is the sheer scale of co…
373
My thoughts on Python in Excel
An in-depth review of Microsoft's new Python in Excel functionality
374
375
Pgvector Is Now Faster Than Pinecone at 75% Less Cost
Meet pgvectorscale, an open-source PostgreSQL extension that supercharges pgvector’s vector search performance for large-scale vector workloads.
376
How to get the most out of Postgres memory settings
Engineering deep-dives, product updates, and company news from Tembo — the platform for running coding agents across your stack.
377
DuckDB Isn't Just Fast
A whistlestop tour of the cool bits of DuckDB
378
Breaking up is hard to do: Chunking in RAG applications
A look at some of the current thinking around chunking data for retrieval-augmented generation (RAG) systems.
379
LedgerStore Supports Trillions of Indexes at Uber
Uber connects the physical and digital worlds to help make movement happen at the tap of a button. Billions of trips, deliveries, and tens of billions of financial transactions across earners, spenders, and merchants are made at Uber every quarter. LedgerStore is an immutable storage solution at Uber that provides…
380
The problem with lying is keeping track of all the lies
Or why clear consistency guarantees are how to stay sane when programming distributed systems.
381
DuckDB 1.0.0
The DuckDB team is very happy to announce that today we’re releasing DuckDB version 1.0.0, codename “Snow Duck” (anas nivis).
382
Seeing Like a Data Structure
Our data-centric way of seeing the world isn't serving us well. Barath Raghavan and Bruce Schneier argue that we need new socio-technical systems that leave room for the inherent messiness of reality.
383
How to Distribute Postgres Geographically
Documenting a pattern for making multi-tenant applications global by distributing the data, using only standard PostgreSQL functionality.
384
Heroku Postgres is now based on AWS Aurora
We’re thrilled to launch our new Heroku Postgres Essential database plans. These plans have pgvector support, no row count limits, and come with a 32 GB...
385
Better RAG Results with Reciprocal Rank Fusion and Hybrid Search
Optimize your support with Assembled's Hybrid Search. Learn how we enhance RAG results using Reciprocal Rank Fusion for accurate, relevant answers.
386
Vector indexing all of Wikipedia on a laptop
Indexing the entirety of English Wikipedia on a laptop has become a practical reality thanks to recent advances in the JVector library that will be part of the imminent 3.0 release.
387
I want flexible queries, not RAG
There is a lot of excitement around retrieval augmented generation or “RAG.” Roughly the idea is: some of the deficiencies in current generative AI or large language models (LLMs) can b…
388
Regular expression functions in Excel
Check out three new functions that use Regular Expressions to help parse text more easily: REGEXTEST, REGEXEXTRACT, and REGEXREPLACE!
389
Using Postgres for Everything
What Postgres for Everything means to a dev deploying all sorts of databases. Spoiler: it’s about collapsing your stack and keeping it simple.
390
pg_timeseries: Open-source time-series extension for PostgreSQL
Engineering deep-dives, product updates, and company news from Tembo — the platform for running coding agents across your stack.