1381
Columnar Storage Is Normalization
Something I didn't understand for a while is that the process of turning row-oriented data into column-oriented data isn't a totally bespoke, foreign concept...
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
1382
1383
PostgreSQL and SQL:2023
In a previous article, I introduced what is new in SQL:2023. Now I want to show the status of SQL:2023 support in PostgreSQL. See the previous article for details on these features.
1384
Fun with NFL Stats, Bokeh, and Pandas
An exploration of NFL play-by-play statistics with Bokeh and Pandas.
1385
Stream VByte: breaking new speed records for integer compression
In many information systems, we work with arrays of integers. For example, maybe you need to keep track of which records in a database contain a given value. This sort of mapping can be expressed as an array of integers. These arrays can end up taking up a large fraction of your memory or disk … Continue reading…
1386
Time Spent Waiting for an Answer in StackOverflow (by language)
I use about.me to show people what matters most to me.
1387
Transactions Are Not Locks (2022)
One thing I wish I had understood better earlier on in my experience with PostgreSQL is how transactions and locks can be used together to provide serializable logic.
1388
Happy Little Words – Analyzing the Bob Ross Twitch Chat
In late October the video game streaming site Twitch.tv launched "Twitch Creative" , essentially giving people permission to stream non-video game related creative content on the site. To celebrate the launch they streamed all 403 episodes of The Joy of Painting with Bob Ross in a giant marathon.
1389
Clog: Making a homegrown ClickHouse log for $20 a month
There was recently a discussion on Hacker News around application logging on a budget. At work I've been trying to keep things lean, not to the point of absurdity, but also not using a $100 or $1000/month setup, when a $10 one will suffice for now . We settled on a homegrown Clickhouse + PHP solution that has…
1390
Scaling Relational SQL Databases (2020)
A list of things that we can do when we need to scale a SQL database.
1391
Intro to Pandas data structures
Part one of a three part introduction to the pandas library. Geared towards SQL users, but is useful for anyone wanting to get started with pandas.
1392
Introduction to LSM Trees: May the Logs Be with You
LSM Trees overview This post is a part of a newsletter that I run: “Scamming The Coding Interview“, which is geared towards helping people ACE their coding interviews. We send a coding qu…
1393
1394
1395
Some thoughts on machine learning with small data
I feel techniques for making machine learning work with small data are not talked about enough. This makes sense because many ML applications are only possible by collecting a huge amount of data. …
1396
Using data to determine if Die Hard is a Christmas movie
Ok, enough bickering and fighting.
1397
1398
1399
1400
Jepsen: Crate 0.54.9 version divergence
In the last Jepsen analysis, we saw that RethinkDB 2.2.3 could encounter spectacular failure modes due to cluster reconfiguration during a partition. In this analysis, we’ll talk about Crate, and find out just how many versions a row’s version identifies.
1401
Optimizing Datalog for the GPU
Datalog primer and a neat data structure
1402
Designing far memory data structures: think outside the box
Designing far memory data structures: think outside the box Aguilera et al., HotOS’19 Last time out we looked at some of the trade-offs between RInKs and LInKs, and the advantages of local in…
1403
Thrill – Big Data Processing with C++
Yesterday, I discovered an experimental Big Data processing framework written in C++ called Thrill. As most of you surely know, the well-known frameworks of this kind are mostly based on JVM, like …
1404
Why start a new database conference?
Somehow I am organizing a conference called Have you tried rubbing a database on it?
1405
1406
C# strings silently kill your SQL Server indexes in Dapper
If you're using Dapper with anonymous objects to query varchar columns, you're probably sending nvarchar(4000) parameters — causing CONVERT_IMPLICIT on every row and defeating your indexes. Here's the fix.
1407
Choose SQL
Let’s get straight to the point; choose an SQL database for your web application. I think I can’t make my self clearer.
1408
Migrating a 40TB SQL Server Database
Initially, I wasn’t sure whether to write about this migration project, but when I randomly asked if people would be interested, the response was overwhelming. This was a long, kind of boring, very repetitive, and at times incredibly frustrating project, but I learned a lot, and maybe someone else will learn from this…
1409
Revisiting the principles of data-oriented programming
Principles of Data-Oriented Programming. Benefits and costs of Data-Oriented Programming. DOP vs OOP. DOP vs FP.
1410
Filecoin, StorJ and the problem with decentralized storage (2019)
Blockchains for everything Decentralized storage services such as Filecoin and StorJ seek to disrupt the data-storage industry, using blockchain tokens to create a competitive marketplace that can …