91
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 265 posts.
92
Goodreads offloads DynamoDB tables to S3 and queries them with Athena
In this post, we show you how to export data from a DynamoDB table, convert it into a more efficient format with AWS Glue, and query the data with Athena. This approach gives you a way to pull insights from your data stored in DynamoDB.
93
Postgres 11 Beta 1 released
The PostgreSQL Global Development Group announces that the first beta release of PostgreSQL 11 is now available for download. This …
94
What Kagglers Are Using for Text Classification
With the problem of Image Classification is more or less solved by Deep learning, Text Classification is the next new developing theme in deep learning. For those who don’t know, Text classification is a common task in natural language processing, which transforms a sequence of text of indefinite length into a…
95
Recursive Common Table Expressions in Postgres
Common Table Expressions in PostgreSQL are a powerful SQL construct. You can think of CTEs as a view that is materialized only while the query is running. Recursive CTEs allow themselves to be called until some condition is met. This post from the Citus Data team explores how recursive CTEs work in Postgres.
96
SQL as an API language
Datasette (previously) is my open source tool for exploring and publishing structured data. There are a lot of ideas embedded in Datasette. I realized that I haven’t put many of …
97
The False Allure of Hashing for Anonymization
Why using cryptographic hashes doesn't make data anonymous.
98
99
Machine Learning in Google Bigquery
Posted by Umar Syed and Sergei Vassilvitskii, Research Scientists, Google AI, NYC Google BigQuery allows interactive analysis of large datasets, ma...
100
How We Built a Cost-Based SQL Optimizer
CockroachDB 2.1 includes a brand-new, built-from-scratch, cost-based SQL optimizer. This post explains what a cost-based SQL optimizer is, and tells the story of how we decided we really, really needed one.
101
102
103
The Internals of Postgres – Concurrency Control
Concurrency Control is a mechanism that maintains atomicity and isolation, which are two properties of the ACID, when multiple transactions run concurrently in a database.
104
A Gentle Visual Intro to Data Analysis in Python Using Pandas
Discussions: Hacker News (195 points, 51 comments), Reddit r/Python (140 points, 18 comments) If you’re planning to learn data analysis, machine learning, or data science tools in python, you’re most likely going to be using the wonderful pandas library. Pandas is an open source library for data manipulation and…
105
Harvard discrimination lawsuit: data show penalization of Asian-Americans
Harvard and Students For Fair Admissions (SFFA), which is suing Harvard over discrimination against Asian-American applicants, have relea...
106
107
The 600+ Companies PayPal Shares Your Data With
One of the effects of GDPR—the new EU General Data Protection Regulation—is that we’re all going to be learning a lot more about who collects our data and what they do with it. Consider PayPal, that just released a list of over 600 companies they share customer data with. Here’s a good visualization of that data. Is…
108
FoundationDB 6.0 released, featuring multi-region support
FoundationDB 6.0.15, our first major release since open sourcing FoundationDB in April, is now officially available!
109
Kafka, GDPR and Event Sourcing
Proof of concept for compliance with GDPR on an Event Sourcing architecture built with Apache Kafka.
110
ML Beyond Curve Fitting: An Intro to Causal Inference and Do-Calculus
Since writing this post back in 2018, I have extended this to a 4-part series on causal inference: * ➡️️ Part 1: Intro to causal inference and do-calculus [https://www.inference.vc/untitled] * Part 2: Illustrating Interventions with a Toy Example…
111
Jepsen: Dgraph 1.0.2
2019-04-10: The long fork test used in this analysis contained a bug which caused it to (in many cases) fail to identify long fork anomalies—though we did find instances of long fork using other tests. We have re-checked Dgraph 1.0.13 with a corrected checker, and its long fork tests still pass.
112
Full-Text Search in Django with PostgreSQL
Article based on my talk about Full-text search in Django with PostgreSQL.
113
Python Pandas: Tricks and Features
Lesser-known but idiomatic pandas features for those already comfortable with Pandas' basic functionality and concepts.
114
The Horrors of Upgrading Etcd Beneath Kubernetes
We dig into the challenges of in-place etcd upgrades beneath autonomous Kubernetes clusters running in air-gapped environments.
115
TimescaleDB vs. InfluxDB: built differently for time-series data
Get an in-depth look at how two leading time-series databases stack up. We compare data models, query language, reliability, performance, and more.
116
The Federalist Papers: Author Identification Through K-Means Clustering
Using K-means clustering on writing style to classify disputed Federalist Papers authorship.
117
Transparent SLIs: See Google Cloud the way your application experiences it
By Jay Judkowitz, Sr. Product Manager Like all good IT organizations, you religiously measure the performance and availability of your ser...
118
Backblaze Drive Stats: 2018 Q3 Hard Drive Failure Rates
Backblaze has 99,636 spinning hard drives. This review looks at the quarterly and lifetime statistics for the data drive models in operation in our data centers.
119
Amazon DynamoDB Transactions
May 20, 2024: As of September 2022, DynamoDB now supports 100 items per transactions. March 13, 2020: Post updated to clarify how to use transactions with global tables and the increase in the maximum number of items per transaction from 10 to 25. Over the years, customers have used Amazon DynamoDB for lots of…
120