241
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
242
Analyzing Cryptocurrency Markets Using Python
A data-driven approach to cryptocurrency (Bitcoin, Ethereum, Litecoin, Ripple etc.) market analysis and visualization using Python.
243
What ORMs Have Taught Me: Just Learn SQL (2014)
I’ve come to the conclusion that, for me, ORMs are more detriment than benefit. In short, they can be used to nicely augment working with SQL in a program, but they should not replace it.
244
245
246
What is Differential Privacy?
Yesterday at the WWDC keynote, Apple announced a series of new security and privacy features, including one feature that’s drawn a bit of attention — and confusion. Specifically, Apple …
247
What GPT-OSS leaks about OpenAI's training data
OpenAI recently released their open-weights model. Here we'll discuss how that inevitably leaks some information about their model training stack, and, on the way, show that GPT-5 was trained on phrases from adult websites....
248
Tracking SQLite Database Changes in Git
Note : This post stirred up some interesting discussions on HackerNews and Lobste.rs .
249
250
Turning SQLite into a Distributed Database
mvSQLite is the open-source , SQLite-compatible distributed database. We decoupled SQLite's storage layer onto FoundationDB to offer massive yet "bottomless" scalability, point-in-time reads, and the strictest level of consistency.
251
Python is not a great language for data science
It may be a good language for data science, but it’s not a great one.
252
Introduction to Apache Airflow
Airflow is a platform to programmatically author, schedule, and monitor workflows. In this blog we will underestand the basics of airflow
253
Command-line tools for data science
Blog article by Jeroen Janssens. Sep 19, 2013. 21 min read. Data science is OSEMN (pronounced as awesome). That is, it involves Obtaining, Scrubbing, Exploring, Modelling, and iNterpreting data. As a data scientist, I spend quite a bit of time on the command-line, especially when there’s data to be obtained, scrubbed…
254
Interesting data structures: the BK-tree
A BK-tree is a tree data structure specialized to index data in a metric space . A metric space is essentially a set of objects which we equip with a distance function $d(a, b)$ for every pair of elements $(a, b)$. This distance function must satisfy a set of axioms in order to ensure it’s well-behaved. The exact…
255
256
Useful Unix commands for exploring data
While dealing with big genetic data sets I often got stuck with limitation of programming languages in terms of reading big files. Also so...
257
Working with time in Postgres
A massive amount of reporting queries, whether really intensive data analysis, or just basic insights into your business involving looking at data over a certain time period. Postgres has really rich support for dealing with time out of the box, something that’s often very underweighted when dealing with a database…
258
Unlearning descriptive statistics
If you've ever used an arithmetic mean, a Pearson correlation or a standard deviation to describe a dataset, I'm writing this for you. Better numbers exist to summarize location, association and spread: numbers that are easier to interpret and that don't act up with wonky data and outliers.
259
260
How to visualize decision trees
Decision trees are the fundamental building block of gradient boosting machines and Random Forests(tm), probably the two most popular machine learning models for structured data. Visualizing decision trees is a tremendous aid when learning how these models work and when interpreting models. Unfortunately, current…
261
Actually Queryable Executables
I was pleasantly surprised and happy to see that my article ‘Your executable is a SQLite database’ resonated with people. It is a format I have been thinking about for a while, and the idea seems to have struck a chord with others.
262
Making Postgres 300x faster for analytics: batching, operator fusion, and SIMD
Last week we released version 0.2 of pgrust. This release was all about performance. It’s 10x faster than the previous version of pgrust. On OLTP benchmarks, pgrust is 30% faster than Postgres, and on Clickbench, Clickhouse’s benchmark for analytical databases, pgrust is 300x faster than Postgres. It’s even ahead of…
263
Finding bugs in SQLite, the easy way
SQLite is probably the most popular embedded database in use today; it is also known for being exceptionally well-tested and robust. In co...
264
How PostgreSQL stores rows
poking inside postgres pages
265
266
MySQL is bazillion times faster than MemSQL
I don’t like stupid benchmarks, as they waste my time. I don’t like stupid marketing, as it wastes my time too. Sometimes I succumb to those things, and now in return I want to waste yo…
267
268
A Canadian payroll dependency chart
Unfortunately, like most aspects of the tax system, this steadily increases in complexity, and this year with the Canada Pension Plan including not just "base" premiums and "additional" premiums but also "second additional premiums", I needed to rewrite my spreadsheet from scratch; and also very unfortunately, the…
269
The "missing" graph datatype already exists. It was invented in the '70s
This post is a response to/inspired by The Hunt for the Missing Data Type ( HN ) by Hillel Wayne. I suggest reading his article first.
270
Forecasts need to have error bars
Richard Rosenfeld in the most recent Criminologist published a piece about forecasting national level crime rates. People complain about the FBI releasing crime stats a year late, academics are wor…