New
The latest blog posts to take off on Hacker News. 4,224 posts.
Mode Studio – Python, R and SQL Editor
Today, we're releasing two of the biggest updates in Mode's history, designed not only to make Mode more powerful, but also to make that power accessible to everyone.
You Can’t Do Data Science in a GUI
The Domino Data Lab blog is home to all things data science and machine learning, with information and resources tailored to data science professionals.
My Favorite PostgreSQL Queries and Why They Matter
In today's data-driven world, data is valuable. Extracting insight, answering questions, and meaningful metrics from data by way of querying and data manipulation is an integral component of SQL in general. This blog presents a combination of 8 interesting, differing PostgreSQL queries or types of queries to explore…
Kafka, GDPR and Event Sourcing
Proof of concept for compliance with GDPR on an Event Sourcing architecture built with Apache Kafka.
EdgeDB: A New Beginning
In a few weeks we will release the first public technology preview of EdgeDB—a new open-source object-relational database. This post is a brief introduction and is the first in the series.
Problems with CSVs (2016)
Much of my professional work for the last 10+ years has revolved around handling, importing and exporting CSV files. CSV files are frustratingly misunderstood, abused, and most of all underspecified. While RFC4180 exists, it is far from definitive and goes largely ignored.
Why SQLite Does Not Use Git
SQLite does not use the Git version control system. SQLite uses Fossil instead, which is a version control system that was specifically designed and written to support SQLite.
Berkeley offers its data science course online for free
Data science is increasingly popular at Berkeley because the world is increasingly data-driven
Protecting GDPR Personal Data with Pseudonymization
If you’ve had the chance to read our GDPR white paper or our previous GDPR primer blog post, you’ve, no doubt, seen the word "pseudonymization" used extensively to describe one technical measure that ...
CockroachDB 2.0 released
Since our 1.0 release, we have been hard at work making CockroachDB 2.0 the database that enables a company’s data layer to evolve with their business -- whether they are in a single datacenter or expanding around the world.
CockroachDB 2.0 Performance Makes Significant Strides
Learn which performance metrics matter, why to demand benchmark TPC-C results under serializable isolation, and how CockroachDB 2.0’s performance compares to 1.1.
Managing database schema changes without downtime
How we manage schema changes at Discourse minimizing downtime
Data on 1.2M Facebook users from 2005 (2011) [use archive.org url in thread]
Recently, a Facebook dataset was released consisting of the complete set of users from the Facebook networks at 100 American institutions, and all of the in-network “friendship” links between those…
Exploring Word2Vec
In my previous blog post, I explored some of the early ways of word embeddings and their shortcomings. The purpose of this post is to explo...
User-defined Order in SQL
Some applications, such as todo lists, need to maintain a user-defined order of items. The challenge is that the order is arbitrary and can change when the user rearranges items:
Reduce GPS data error on Android with Kalman filter and accelerometer
IT blog about developing and managing enterprise-level software solutions for blockchain, fintech, transportation & logistics, security, edtech, and advertising industries.
A picture got my PostgreSQL database to start mining Monero
A Deep Dive into Database Attacks [Part III]: Why Scarlett Johansson’s Picture Got My Postgres Database to Start Mining Monero
Atomic Commit in SQLite (2007)
An important feature of transactional databases like SQLite is "atomic commit". Atomic commit means that either all database changes within a single transaction occur or none of them occur. With atomic commit, it is as if many different writes to different sections of the database file occur instantaneously and…
The 600+ Companies PayPal Shares Your Data With
One of the effects of GDPR—the new EU General Data Protection Regulation—is that we’re all going to be learning a lot more about who collects our data and what they do with it. Consider PayPal, that just released a list of over 600 companies they share customer data with. Here’s a good visualization of that data. Is…
Memory efficiency of parallel IO operations in Python
Python allows for several different approaches to parallel processing. The main issue with parallelism is knowing its limitations. We either want to parallelise IO operations or …
Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
There’s fast and there’s fast. This post is about Anna*, a key/value database design from our team at Berkeley that’s got phenomenal speed and buttery smooth scaling, with an unpr…
HTTP Analytics for 6M requests per second using ClickHouse
One of our large scale data infrastructure challenges here at Cloudflare is around providing HTTP traffic analytics to our customers. HTTP Analytics is available to all our customers via two options:
Why DNSFilter replaced InfluxDB with TimescaleDB
Stay informed with the latest updates, trends, and insights on DNS and content filtering. Get useful tips and best practices in network security.
Jepsen: Aerospike 3.99.0.3
Aerospike , formerly Citrusleaf, is a distributed, sharded document store designed for high-throughput, low-latency applications. Each record is a map of keys to values, which may be either primitive types (integers, strings, bytes, etc.) or nested collections like lists and maps. Secondary indices are also available…
Create Statistics in PostgreSQL 10
Postgres stores a lot of statistics about your data in order to effectively retrieve results when you query your database. Here we deep dive into some of the statistics PostgreSQL stores and how you can leverage a new feature in Postgres 10 to improve performance when different columns are related.