Topics /

Databases & Data

The most popular blog posts about databases & data on Hacker News. 4,224 posts.

Any year
3362

MitM-ing Postgres

I recently had to set up a new postgres instance at work. While we’re already using Heroku Postgres for production loads, we had some requirements for this one that couldn’t be solved without being database admin, and thus had to go self-hosted. That...

3363

Optimizers: The Low-Key MVP

The query optimizer is an important part of any analytical database system as it provides considerable performance improvements compared to hand-optimized queries, even as the state of your data changes.

3369

Amazon Aurora with PostgreSQL Compatibility

Late last year I told you about our plans to add PostgreSQL compatibility to Amazon Aurora. We launched the private beta shortly after that announcement, and followed it up earlier this year with an open preview. We’ve received lots of great feedback during the beta and the preview and have done our best to make […]

3370

Data Wrangling at Slack

For a company like Slack that strives to be as data-driven as possible, understanding how our users use our product is essential. The Data Engineering team at Slack works to provide an ecosystem to help people in the company quickly and easily answer questions about usage, so they can make better and data informed…

3372

AWS Managed Workflows for Apache Airflow

As the volume and complexity of your data processing pipelines increase, you can simplify the overall process by decomposing it into a series of smaller tasks and coordinate the execution of these tasks as part of a workflow. To do so, many developers and data engineers use Apache Airflow, a platform created by the…

3378

A Statistical Portrait of a Y Combinator Batch

ไลฟ์สไตล์ ธุรกิจ กีฬา ไอที บันเทิง แม่และเด็ก ความรู้รอบตัว รถยนต์ สัตว์เลี้ยง อสังหาริมทรัพย์ กิน-เที่ยว การเงินและการลงทุน สุขภาพ การศึกษา บ้านและสวน

3379

K-Nearest Neighbors

One Machine Learning algorithm that relies on the concepts of proximity and similarity is K-Nearest Neighbor (KNN). KNN is a supervised learning algorithm capable of performing both classification and regression tasks.

3382

Project Jupyter Celebrates 20 Years, Fernando Pérez Reflects on How It Started

Twenty years ago, UC Berkeley Associate Statistics Professor Fernando Pérez started one of the foundational tools for analyzing large amounts of data in a transparent and collaborative way. We spoke with Pérez about why he started this project, what challenges he’s faced and what to expect from him and Project Jupyter…

3386

Map Simplification with Visvalingam's Algorithm

An interesting challenge in cartography is getting data of the appropriate resolution. As Lewis Fry Richardson observed , the more precisely you measure the length of a coastline, the longer it appears; geographic shapes have infinite complexity. Digital displays, in contrast, are limited by pixels. Choosing too high…