61
RedPajama v2 Open Dataset with 30T Tokens for Training LLMs
RedPajama-Data-v2 is a 30 trillion token open dataset from 84 CommonCrawl dumps across five languages, with over 40 precomputed quality annotations.
New
The latest blog posts to take off on Hacker News. 371 posts.
62
Approximate Nearest Neighbor Oh Yeah (Annoy)
Discover the capabilities of Annoy, an innovative algorithm revolutionizing approximate nearest neighbor searches for enhanced efficiency and precision.
63
Why you should probably be using SQLite
Where you store your application data has enormous impacts on your entire application. There are implications on the entire stack based on what you decide to...
64
Making PostgreSQL tick: New features in pg_cron
Since pg_cron 1.5, you can easily schedule jobs that run every 1-59 seconds. And pg_cron 1.6 added support for Postgres 16. This blog post walks you through the benefits of second granularity jobs with the pg_cron open source extension to Postgres.
65
The Case of a Curious SQL Query
Languages that suffer success often have to do so by selling out and adding features that go against some of the original purposes of their design. SQL is a...
66
Nile: Serverless Postgres for modern SaaS
I am thrilled to announce Nile, a serverless Postgres database designed for modern SaaS applications.
67
Embeddings: What they are and why they matter
Embeddings are a really neat trick that often come wrapped in a pile of intimidating jargon. If you can make it through that jargon, they unlock powerful and exciting techniques …
68
Excel will allow certain auto data conversions to be turned off
Based on your feedback, we've improved the Automatic Data Conversion settings, and made them also available in Excel for Mac.
69
OpenTelemetry at Scale: Using Kafka to handle bursty traffic
Learn how to use Apache Kafka as a buffer between OpenTelemetry Collectors for a scalable multi-collector pipeline, with YAML configuration examples.
70
Transactions Are Not Locks (2022)
One thing I wish I had understood better earlier on in my experience with PostgreSQL is how transactions and locks can be used together to provide serializable logic.
71
We Built a Streaming SQL Engine
A streaming SQL engine keeps queries’ results up to date without ever having to recalculate them, even as the underlying data changes. To explain this, imagine a simple query, such as SELECT count(*) FROM humans
72
Don't use DISTINCT as a "join-fixer"
Using DISTINCT to fix duplicate rows from a SQL join is a common antipattern. It generates all the duplicates first, then sorts them away - hurting performance. Learn how to rewrite these queries using EXISTS for cleaner, faster SQL Server results.
73
Versioning data in Postgres? Testing a Git like approach
KQBD Vip - trực tiếp kết quả bóng đá hôm nay cập nhật trực tuyến theo Nano giây, kết quả đêm qua & rạng sáng nay từ 2.000+ giải đấu toàn thế giới.
74
Causal inference as a blind spot of data scientists
Throughout much of the 20th century, frequentist statistics dominated the field of statistics and scientific research. Frequentist statistics primarily focus on the analysis of data in terms of probabilities and observed frequencies. Causal inference, on the other hand, involves making inferences about…
75
Google Cloud Spanner is now half the cost of Amazon DynamoDB
Alongside lower costs, Cloud Spanner provides single-digit ms latencies and strong consistency across multiple availability zones in the same region.
76
SQL reserved words – An empirical list
These words cause problems as table or column name
77
Scaling SQLite to 4M QPS on a Single Server (EC2 vs Bare Metal)
Discover how Expensify achieved remarkable scaling: 4M QPS on one server! Dive into optimizing SQLite for impressive performance gains.
78
79
Why AutoGPT engineers ditched vector databases
AutoGPT decided to drop the support for vector databases: Pinecone, Milvus, Redis, Weaviate - all gone. What has happened to the original idea of efficiently storing agent's memories?
80
81
Modeling CRDTs in Alloy – the importance of idempotence
Checking my assumptions about syncable data structures
82
UK Address Oddities (2018)
A few of my previous blog posts have been about quirks in the UK postal address system. As a result of these posts being moderately popular, people have contacted me to tell me about other such quirks. This pleases me greatly – I like quirks.
83
84
Exploratory data analysis for humanities data
The course was very much an experiment, an attempt to combine literary study with computing. The 17 surviving students were largely sophomores. About two thirds of them were hard-core humanities majors; the rest were potential or actual CS majors or other STEM concentrators. The class met once a week for three hours…
85
Rerun 0.9 – a framework for visualizing streams of multimodal data
We're releasing Rerun 0.9.0 with a completely revamped API that gives more control over the underlying data model, a hierarchical and time aware Entity Component System (ECS).
86
Database Performance at Scale – A free book
Discover new ways to optimize database performance and avoid common mistakes that impact latency and throughput.
87
88
Pgroll: zero-downtime, reversible schema migrations for Postgres
We are excited to ship the first version of pgroll, a command line tool that offers safe and reversible schema migrations for PostgreSQL
89
Every database will become a vector database sooner or later
Why every database will become a vector database, sooner or later
90
Goodbye integers, hello UUIDv7
The journey Buildkite took from sequential integer primary keys, through randomly generated UUIDs, to adopting time-ordered UUIDv7 — and the database index tradeoffs along the way.