181
Django and Postgres for the Busy Rails Developer
About 10 years ago I wrote a post PostgreSQL for the Busy MySQL Developer, as part of switching from MySQL to Postgres for my personal and professional projects wherever I could.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 350 posts.
182
Exact binary vector search for RAG in 100 lines of Julia
Thanks for HN users mik1998 and borodi who brought up the popcnt instruction and the count_ones function in Julia which carries this out, I've updated the timings and it's even faster now.
183
Build your own SQLite, Part 1: Listing tables
As developers, we use databases all the time. But how do they work? In this series, we'll try to answer that question by building our own SQLite-compatible…
184
Database mocks are not worth it
Testing against a real database uncovers hidden pitfalls that can appear as the application matures
185
Call of Duty: Warzone Caldera Data Set for Academic Use
Access Call of Duty: Warzone Caldera OpenUSD Data Set
186
Sampling with SQL
Sampling is one of the most powerful tools you can wield to extract meaning from large datasets. It lets you reduce a massive pile of data into a small yet representative dataset that’s fast and easy to use.
187
188
An Introduction to the WARC File (2021)
Want to know more about a tool in our web archiving toolbox? Your suggestions or questions for future posts about Archive-It technology are very welcome here .
189
A decoder-only foundation model for time-series forecasting
Posted by Rajat Sen and Yichen Zhou, Google Research Time-series forecasting is ubiquitous in various domains, such as retail, finance, manufacturi...
190
Systematically Improving Your RAG
Discover systematic strategies to enhance your Retrieval-Augmented Generation (RAG) systems for better performance and user experience.
191
192
Data Science at the Command Line, 2nd Edition (2021)
This thoroughly revised guide demonstrates how the flexibility of the command line can help you become a more efficient and productive data scientist. You’ll learn how to combine small yet powerful command-line tools to quickly obtain, scrub, explore, and model your data. To get you started, author Jeroen Janssens…
193
Reactive Relational Algebra
databases plus wibbly wobbly timey wimey stuff
194
The super effectiveness of Pokémon embeddings using only raw JSON and images
Embeddings encourage engineers to go full YOLO because it’s actually rewarding to do so!
195
196
Should you ditch Spark for DuckDB or Polars?
There’s been a lot of excitement lately about single-machine compute engines like DuckDB and Polars. With the recent release of pure Python Notebooks in Microsoft Fabric, the excitement about these lightweight native engines has risen to a new high. Out with Spark and in with the new and cool animal-themed engines— is…
197
198
Let's talk about joins
An review of horizontal and vertical joins with examples from education research.
199
131M American Buildings
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
200
PostgreSQL Streaming Replication (WAL); What It Is and How to Configure One
What is Streaming replication in PostgreSQL?Streaming replication in PostgreSQL is an efficient method for maintaining a near real-time replica of a primary database on one or more standby servers.The primary server continuously sends data to replica
201
202
AI for Data Journalism: demonstrating what we can do with this stuff
I gave a talk last month at the Story Discovery at Scale data journalism conference hosted at Stanford by Big Local News. My brief was to go deep into the …
203
Datomic and Content Addressable Techniques
Datomic and Content Addressable Techniques: An Ultimate Data Wonderland
204
We sped up time series by 20-30x
This is a follow up post that dives into how we managed to achieve such huge performance gains for time series (among other things), and why it was so hard in the first place.
205
How we built ngrok's data platform
At ngrok, we manage a ~100TiB, 500+ table data lake, managed by a very small team. Here's a look at how we built it and what unique challenges we solved.
206
What Shapes Do Matrix Multiplications Like?
Divining order from the chaos
207
ElephantSQL Is Shutting Down
The ElephantSQL team announces that ElephantSQL will discontinue its services.
208
Building data infrastructure that will last
As a consultant, I have been called in to review and, in many cases, replace dozens of half-finished, abandoned, and sometimes forgotten data infrastructure projects.
209
Implementing system-versioned tables in Postgres
There's no official support for system-versioned tables in Postgres yet, and the temporal extensions aren't supported on Azure/AWS/GCP. Let's implement it ourselves with 3 triggers and an index.
210
The Rise of Open Source Time Series Databases
Time series databases are essential tools in any software engineer’s toolbelt. Their development has been shaped by user needs and countless open source contributors, leading to the healthy ecosystem of options we see today. In this article, you’ll see how time series databases came about, and why so many are open…