301
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
302
B-Trees: More Than I Thought I'd Want to Know (2021)
B-Trees are not boring, after all
303
Hard problems that reduce to document ranking
There are two claims I’d like to make: LLMs can be used effectively1 for listwise document ranking. Some complex problems can (surprisingly) be solved by transforming them into document ranking problems. I’ve primarily explored both of these claims in the context of using patch diffing to locate N-day…
304
Top data mining algorithms in plain English
Today, I'm going to explain in plain English the top 10 most influential data mining algorithms as voted on by 3 separate panels in this survey paper. Once you know what they are, how they work, what they do and where you ... Read More
305
Analysis of Apple Watch running data
Analysis of Apple running measurements and statistics
306
How to Analyze Billions of Records per Second on a Single Desktop PC
Introduction This article gives an overview of LocustDB [1], a new and extremely fast open-source analytics database built in Rust. Part 1 gives some background on analytical query systems and my g…
307
Things I wish I knew about MongoDB a year ago
I’ve used MongoDB for over a year at scale at both Heyzap and Bugsnag and I’ve found it to be a very capable database. As with all databases, there are some gotchas, and here is a summary of the things I wish someone had told me earlier.
308
1.1B Taxi Rides on Kdb+/q and 4 Xeon Phi CPUs
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
309
Better Database Migrations in Postgres
As your database grows and scales there are some operations that you need to take more care of than you did when you were just starting. When working with your application in your dev environment you may not be fully aware of the cost of some operations until you run them against production. And at some point most of…
310
MeiliSearch: A Minimalist Full-Text Search Engine
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
311
Waiting for PostgreSQL 14 – SEARCH and CYCLE clauses
Which means, that to test it, we need some data for recursive queries. This time I took directory listing of my /etc, and loaded it to db:
312
User-defined Order in SQL
Some applications, such as todo lists, need to maintain a user-defined order of items. The challenge is that the order is arbitrary and can change when the user rearranges items:
313
314
Does Reddit have an astroturfing problem? What the data suggests
In 51,129 comments from six knife subreddits, the 5% most brand-heavy accounts wrote 11.3% of the brand mentions in buying threads, against 7.9% expected by chance. For one brand it is 31% against 8%. The full Reddit histories of those accounts are 4.5 years old and spread over 66 subreddits, the same as a comparison…
315
Ditching Excel for Python in a legacy industry
I spent 3 years as an analyst in the reinsurance industry. During this time, I witnessed firsthand how Python is driving rapid technological change. (Goodbye, Excel!)
316
317
Glom – Restructured Data for Python
Thoughts on FOSS and fintech, layered by Mahmoud Hashemi
318
319
Understanding Parquet, Iceberg and Data Lakehouses
In the past few years, I've heard a lot about Avro, Parquet, ORC, Arrow and Feather, but I also keep hearing about Iceberg and Delta Lake. As a "database person", I’ve been struggling to understand all of these different things, and how they relate to Data Lakes and
320
A Data-Driven Guide to Becoming a Consistent Billionaire
Did You Really Think All Billionaires Were the Same? Recently, I became a bit obsessed with the one percent of the one percent – Billionaires. I was intrigued when I stumbled on articles telling us…
321
TIL–Python has a built-in persistent key-value store (2018)
Simplex Sigillum Veri
322
323
Why DuckDB is my first choice for data processing
Why DuckDB has become my go-to tool for data processing, offering simplicity, speed, and powerful features.
324
The pedantic checklist for changing your data model in a web application
Let's say you have a web app with some database. In your database you have an Invoice model, where you store things you are charging your customers.
325
Hstore development for 9.4 release
I returned back home from PGCon.EU-2013 conference, Dublin, Ireland, where we gave two talks - Next Generation of GIN and Binary storage for nested data structures and application to hstore data type . These projects as well as visiting the conference (I, Teodor Sigaev and Alexander Korotkov) were…
326
My ridiculously robust photo management system (Immich edition)
How I added Immich to my already robust photo management system to make it ridiculously robust.
327
Bayesian Statistics: The three cultures
A traditional subjective Bayesian will assume a data generating distribution (aka a likelihood when viewed as a function of the parameters). Then, conditional on this assumption, they encode their prior beliefs as a prior distribution over parameters. After this, they turn the crank on posterior inference and don’t…
328
I analyzed chord progressions in 680k songs
And the results surprised me
329
ORMs Are Backwards
Not bad just backwards
330
Introduction to R Programming
This is a detailed step-by-step introduction to R programming. Starting with the two major reasons to learn R for Data Science, it will guide you through the installation process, and prepare you for the basics of R: arithmetics, variables assignment, data types, functions, and documentations.