New
The latest blog posts to take off on Hacker News. 1,888 posts.
Running Awk in parallel to process 256M records
TL;DR Awk crunches massive data; a High Performance Computing (HPC) script calls hundreds of Awk concurrently. Fast and scalable in-memory solution on a fat machine.
Introduction to Apache Airflow
Airflow is a platform to programmatically author, schedule, and monitor workflows. In this blog we will underestand the basics of airflow
Immutable Databases
Like blockchain but without blockchain.
Using SQL to find my best photo of a pelican according to Apple Photos
According to the Apple Photos internal SQLite database, this is the most aesthetically pleasing photograph I have ever taken of a pelican: Here’s the SQL query that found me my …
What every software engineer should know about Apache Kafka
To help fellow engineers wrap their head around Apache Kafka and event streaming, I wrote a 4-part series on the Confluent blog on Kafka’s core fundamentals....
Improved vacuum in PostgreSQL 13
Vacuum is one of the sub-systems in PostgreSQL which gets improved with each release. I have checked past five releases and each has qu...
Advanced SQL and database books and resources
For people who've worked through Mastery with SQL , a common question I get is "What's next?" If you completed the course and all 150+ exercises, at this point you'll have a very strong grasp of SQL and should be comfortable writing all sorts of complex queries. However, there's more to working with databases…
Understanding Raft Consensus
Recently I was digging deeper into Raft , an important algorithm in the field of distributed systems. Raft is a consensus algorithm , meaning that it is designed to facilitate a set of computers agreeing on a state of the world (more on exactly how the state of the world is represented later), even when communications…
A visual explanation for regularization of linear models
A deep dive into exactly how regularization works, using visualizations rather than (just) mathematics. This article also dispels some myths and answer some important questions about Lasso and Ridge regression.
How to get stock fundamentals data with Python
Learn how to download fundamentals data with Python using the yahoo_fin package, including P/E and P/S ratios, return on equity, and more.
Oracle vs. PostgreSQL: First Glance
We are facing some interesting times at work as we are going to start changing our technology stack in the near future. Most of our Oracle ...
A synthetic control causal analysis of Musk's tweet on Tesla stock price
a terse analysis of tesla stock prices and how one of elon’s tweets moves them
Comprehensive Tutorial on Time Series Modelling and Forecasting
In the previous post we have seen how to visualize a time series data. In this post we will discuss how to do a time series modelling using ARMA and ARIMA models. Here AR stands for Auto-Regressive and MA stands for Moving Average
Guide to Making 3D Maps with Satellite Imagery in R
E ver since I released rayshader to the public, there’s been one question that comes up time and time again: “How do I use rayshader to overlay satellite imagery onto a 3D surface?” And I can see why: 3D maps with real satellite images are super cool, and there are few detailed tutorials out there on how it’s done in…
SELECT wat FROM sql
Thanks to Nikhil Benesch, Justin Jaffray and several decades of "wouldn't it be nice if..." for contributions.
Analyzing Analytics (Featuring: The FBI)
Recently while conducting some research, I found myself down the path of Google Analytics ID's as well as other analytics services. I was investigating ways to not only identify varying analytics code in sites, but to correlate them with ot…
Combining event sourcing and stateful systems
Bridging the gap between stateful and event sourced sub-systems
Writing a SQL database from scratch in Go
Writing a SQL database from scratch in Go: 1. SELECT, INSERT, CREATE and a REPL
I Want Decentralized Version Control for Structured Data
How do I synchronize application data between devices and people? That's the question I was unable to answer when thinking about ideas for new applications I could develop. I wanted the synchronization to be
Introduction to Hacking PostgreSQL (2007)
Gavin Sherry and I have presented several versions of a tutorial introduction on how to modify the PostgreSQL source code. The original version was given at the PostgreSQL Anniversary Summit in June of 2006. Gavin has since given a revised version of the talk (at LCA 2007), as have I (at PgCon 2007).
Data Science: Reality Doesn't Meet Expectations
OLXTOTO adalah situs menyediakan link alternatif untuk login tanpa hambatan yang di rancang agar pemain bermain lebih stabil dan optimal apabila domain utama mengalamin kendala. Nike Hat Size 6 1/2 6 5/8 6 3/4 6 7/8 7 7 1/8 7 1/4 7 3/8 7 1/2 7 5/8 7 3/4 Head Size (CM) 52 53 54 55 56 57 58 59 60 61 62 Alpha Size - - XS…
A humble guide to database schema design
Having a good database schema design is crucial for building applications that will need to scale in traffic and complexity. If you happen to do a bad design choice you will see that it takes a lot of effort to stop the pattern from propagating to your backends’ services and controllers, and finally to your frontend.
Illustrated FixMatch for semi-supervised learning
Learn how to leverage unlabeled data using FixMatch for semi-supervised learning