481
Satellogic's Open Satellite Feed
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
New
The latest blog posts to take off on Hacker News. 4,224 posts.
482
DeepSeek's smallpond: Bringing Distributed Computing to DuckDB
DeepSeek is pushing DuckDB beyond its single-node roots with smallpond, a new, simple approach to distributed compute. But does it solve the scalability challenge—or introduce new trade-offs?
483
SQLite-on-the-server is misunderstood: Better at hyper-scale than micro-scale
Learn why SQLite-on-the-server fits hyper-scale systems when each tenant gets an isolated database with local reads, durable storage, and simple…
484
The power of interning: making a time series database smaller
This week-end project started by browsing the open-data repository of Paris’ public transport network, which contains various APIs to query real-time departures, current disruptions, etc.The data reuse section caught my eye, as it features external projects that use this open data.In particular, the RATP status…
485
BM25 in PostgreSQL
VectorChord-BM25 enhances PostgreSQL search with BM25 ranking, 3x faster than ElasticSearch. Supports BERT, Tocken, and Unicode tokenizers
486
Losing a 5-year-long Illinois FOIA lawsuit for database schemas
Thomas Ptacek, a friend and expert witness in this lawsuit summed it up best in the court's hallway while walking within three feet of opposing counsel: "This is fucking stupid" .
487
Understanding Smallpond and 3FS
A concise breakdown of what smallpond and 3FS are, how to use them, and if they're suitable for your data processing needs.
488
Putting Andrew Ng's OCR models to the test
Testing Andrew Ng's document extraction service reveals over 50% hallucinated values in financial tables. | Pulse AI
489
Postgres as a Graph Database: (Ab)Using PgRouting
Learn how to use pgRouting as a lightweight graph database solution in Postgres.
490
A data analysis of speeches at the Oscars
I analysed almost 2,000 Oscar speeches to discover if the claim that Harvey Weinstein was thanked more often than God is true. Plus, we'll find out which Hollywood icon is bigger than both of them.
491
EdgeDB is now Gel and Postgres is the future
EdgeDB is now Gel. New identity, renewed focus on delivering the best PostgreSQL data platform in the world.
492
Hard problems that reduce to document ranking
There are two claims I’d like to make: LLMs can be used effectively1 for listwise document ranking. Some complex problems can (surprisingly) be solved by transforming them into document ranking problems. I’ve primarily explored both of these claims in the context of using patch diffing to locate N-day…
493
494
The best way to use text embeddings portably is with Parquet and Polars
Never store embeddings in a CSV!
495
MongoDB acquires Voyage AI
MongoDB to integrate Voyage AI's industry-leading embedding and reranking models, delivering highly accurate and relevant information retrieval to power sophisticated AI use cases NEW YORK , Feb. 24, 2025 /PRNewswire/ -- MongoDB, Inc. (NASDAQ: MDB), the leading database for modern applications,
496
Keeping our free tier sustainable by preventing abuse
A free tier allows people to try a SaaS without paying first, but it opens up the service to bad actors. Here's how we balance preventing bad actors while still supporting legitimate users.
497
Build your own SQLite in Rust, Part 5: Evaluating queries
In the previous posts, we've explored the SQLite file format and built a simple SQL parser. It's time to put these pieces together and implement a query…
498
Kafka at the low end: how bad can it get?
There is oft-quoted advice that Kafka does poorly as a job queue. I’ve experienced this myself, and I wanted to formalize it a bit.
499
500
Representing Graphs in PostgreSQL
Some tricks and techniques for working with graph or tree like data in Postgresql
501
Searchcode.com’s SQLite database is probably 6 terabytes bigger than yours
searchcode.com’s SQLite database is probably one of the largest in the world, at least for a public facing website. It’s actual size is 6.4 TB. Which is probably 6 terabytes bigger than yours. …
502
The secret ingredients of word2vec (2016)
Word2vec is a pervasive tool for learning word embeddings. Its success, however, is mostly due to particular architecture choices. Transferring these choices to traditional distributional methods makes them competitive with popular word embedding methods.
503
Siren Call of SQLite on the Server
At Terrateam, we are big fans of Fly.io. The service is hosted there and it’s served us well. Just deploy your TOML file, get your infrastructure, do something else with the rest of your day. One of the interesting sides of Fly is that they invest heavily in server-side SQLite. They’ve written a number of blog posts…
504
MySQL at Uber
At Uber, our MySQL® fleet is the backbone of our data infrastructure, supporting a vast array of operations critical to our platform. Uber operates an extensive MySQL fleet, consisting of over 2,300 independent clusters. Building a control plane to manage this fleet at such a massive scale, while ensuring zero…
505
Visualizing data is an art
The case for less rigor and more nuance.
506
League of Legends data scraping the hard and tedious way for fun
Personal website for some random tidbits I work on
507
Apache Iceberg now supports geospatial data types natively
Apache Iceberg and Parquet now support native geospatial types, connecting Wherobots, PostGIS, Sedona, Databricks, and Snowflake to one table format.
508
Backblaze Drive Stats for 2024
The 2024 Year End Drive Stats Report is here. See the the latest annualized failure rates and data insights for the Backblaze drive fleet.
509
How about trailing commas in SQL?
Anecdotally, this might be the most requested feature in SQL: Allow some trailing commas.
510
The Anthropic Economic Index
Announcement of the new Anthropic Economic Index and description of the new data on AI use in occupations