New
The latest blog posts to take off on Hacker News. 2,337 posts.
Databases are the endgame for data-oriented design
For the first SpacetimeDB blog post, I’d like to clear up some confusion that I’ve seen arise in discussions about SpacetimeDB and address some general misperceptions about databases. My sense is tha…
JSONB has landed
JSONB is a rewrite of the SQLite JSON functions that, depending on usage patterns, could be several times faster than the original JSON functions. This enhancement has now landed on trunk .
The challenges of supporting foreign key constraints
Today, PlanetScale launched support for foreign key constraints. This article covers some of the behind-the-scenes technical challenges we had to overcome to support them.
Pipeworld: Spreadsheet Dataflow Computing (2021)
Now for something completely different. In the spiritual vein of One Night in Rio: Vacation photos from Plan9 and AWK for multimedia, here is a tool that is the link that ties almost all the projec…
Accidental database programming
Join me as we take a look at common application data patterns, and how they relate to the inner-workings of databases. In this post, we discuss data caching, indexing, optimistic mutations, and recursive cache invalidation. We will see how life might be easier if we could just use a frontend optimized database like…
S3 Express Is All You Need
The future of modern data infrastructure is object storage.
An automatic indexing system for Postgres
The pganalyze Indexing Engine simulates hundreds of possible combinations to recommend missing Postgres indexes using its 'What if?' analysis.
Backblaze Drive Stats for Q3 2023
Explore Backblaze's Q3 2023 hard drive stats, revealing insights on 259,533 HDDs, failure rates, and data center performance for enhanced reliability.
Loro: Reimagine state management with CRDTs
Loro, our high-performance CRDTs library, is now open source. In this article, we share our vision for the local-first software development paradigm, why we're excited about it, and the current status of Loro.
Open, rigorous and reproducible research: A practitioner’s handbook (2021)
Even though many scientists are expected to abide by the principles of open, rigorous and reproducible research, few scientists actually receive formal training in this. Indeed, there is no collection written by working scientists for working scientists about the principles of transparent, rigorous and reproducible…
Debunking the Myth of "Anonymous" Data
Today, almost everything about our lives is digitally recorded and stored somewhere. Each credit card purchase, personal medical diagnosis, and preference about music and books is recorded and then used to predict what we like and dislike, and—ultimately—who we are. This often happens without our...
SciPy builds for Python 3.12 on Windows are a minor miracle
Moving SciPy to Meson meant finding a different Fortran compiler on Windows, which was particularly tricky to pull off for conda-forge. This blog tells the story about how things looked pretty grim for the Python 3.12 release, and how things ended up working out just in the nick of time.
Vitess 18
Vitess 18 is now generally available, with a number of new enhancements designed to improve usability, performance, and MySQL compatibility.
Building a Streaming Platform in Go for Postgres
At PeerDB, our mission is to create a Postgres-first data-movement platform that makes it fast and simple to stream data from Postgres to Data Warehouses…
Updates to the H2O.ai db-benchmark
The H2O.ai db-benchmark has been updated with new results. In addition, the AWS EC2 instance used for benchmarking has been changed to a c6id.metal for improved repeatability and fairness across libraries. DuckDB is the fastest library for both join and group by queries at almost every data size.
Rules of schema growth (2017)
The free database designed for immutable values and a time-aware information model.
RedPajama v2 Open Dataset with 30T Tokens for Training LLMs
RedPajama-Data-v2 is a 30 trillion token open dataset from 84 CommonCrawl dumps across five languages, with over 40 precomputed quality annotations.
Approximate Nearest Neighbor Oh Yeah (Annoy)
Discover the capabilities of Annoy, an innovative algorithm revolutionizing approximate nearest neighbor searches for enhanced efficiency and precision.
Why you should probably be using SQLite
Where you store your application data has enormous impacts on your entire application. There are implications on the entire stack based on what you decide to...
Making PostgreSQL tick: New features in pg_cron
Since pg_cron 1.5, you can easily schedule jobs that run every 1-59 seconds. And pg_cron 1.6 added support for Postgres 16. This blog post walks you through the benefits of second granularity jobs with the pg_cron open source extension to Postgres.
Nile: Serverless Postgres for modern SaaS
I am thrilled to announce Nile, a serverless Postgres database designed for modern SaaS applications.
Excel will allow certain auto data conversions to be turned off
Based on your feedback, we've improved the Automatic Data Conversion settings, and made them also available in Excel for Mac.
OpenTelemetry at Scale: Using Kafka to handle bursty traffic
Learn how to use Apache Kafka as a buffer between OpenTelemetry Collectors for a scalable multi-collector pipeline, with YAML configuration examples.
We Built a Streaming SQL Engine
A streaming SQL engine keeps queries’ results up to date without ever having to recalculate them, even as the underlying data changes. To explain this, imagine a simple query, such as SELECT count(*) FROM humans
Don't use DISTINCT as a "join-fixer"
Using DISTINCT to fix duplicate rows from a SQL join is a common antipattern. It generates all the duplicates first, then sorts them away - hurting performance. Learn how to rewrite these queries using EXISTS for cleaner, faster SQL Server results.
Versioning data in Postgres? Testing a Git like approach
KQBD Vip - trực tiếp kết quả bóng đá hôm nay cập nhật trực tuyến theo Nano giây, kết quả đêm qua & rạng sáng nay từ 2.000+ giải đấu toàn thế giới.
Google Cloud Spanner is now half the cost of Amazon DynamoDB
Alongside lower costs, Cloud Spanner provides single-digit ms latencies and strong consistency across multiple availability zones in the same region.