2101
A SQL Heuristic: ORs Are Expensive
But this is slow! With 1,000,000 applications and 1000 users uniformly distributed on both columns, it takes over 100ms. 1
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
2102
Improved fraud prevention with Radar 2.0
Radar 2.0 improves machine learning performance and reduces fraud by up to an additional 25%.
2103
Event Sourcing (2017)
I recently became intrigued by the concept of event sourcing as applied to back-end architecture, specifically a microservice-oriented approach. I have spent the last few years working predominantly on the front-end, and became enamored by the simplicity and elegance of this pattern as the backbone of front-end…
2104
RethinkDB 1.12: simplified map/reduce, ARM port, new caching infrastructure
Today, we’re happy to announce RethinkDB 1.12 ( The Wizard of Oz ). Download it now!
2105
Lower Cost S3 Storage Option and Glacier Price Reduction
Like all AWS services, the Amazon S3 team is always listening to customers in order to better understand their needs. After studying a lot of feedback and doing some analysis on access patterns over time, the team saw an opportunity to provide a new storage option that would be well-suited to data that is accessed […]
2106
2107
Best practices for migrating an Oracle database to Amazon PostgreSQL
An Oracle to PostgreSQL migration in the AWS Cloud can be a complex multistage process with different technologies and skills involved, starting from the assessment stage to the cutover stage. This blog series covers the environment and configuration setups for your source Oracle database, the AWS Database Migration…
2108
Apache Arrow: A new open source in-memory columnar data format
Open source Big Data in-memory columnar layer accelerates analytical processing and interchange by more than 100x. Forest Hill, MD –17 Feb 2016– The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache…
2109
Are CRDTs suitable for shared editing?
The sole purpose of this blog is to host a single article..
2110
Tao: Facebook’s distributed data store for the social graph
The papers over the next few weeks will be from (or related to) research from VLDB 2021 - on the horizon is one of my favorite systems conferences SOSP . As always, feel free to reach out on Twitter with feedback or suggestions about papers to read! These paper reviews can be delivered weekly to your inbox , or you…
2111
Using logistic regression to predict parking difficulty
Posted by James Cook, Yechen Li, Software Engineers and Ravi Kumar, Research Scientist"When Solomon said there was a time and a place for everythin...
2112
Open-Source Babelfish for Postgres
Babelfish for PostgreSQL is an Apache-2.0 and PostgreSQL open source project that adds a Microsoft SQL Server-compatible end-point to PostgreSQL to enable your PostgreSQL database to understand the SQL Server wire protocol and commonly used SQL Server commands.
2113
How to Read MySQL EXPLAINs
Learn how to read the output in MySQL EXPLAIN plans so you can utilize them to improve query performance.
2114
2115
Ursa Labs: an innovation lab for open source data science
Funding open source software development is a complicated subject. I’m excited to announce that I’ve founded Ursa Labs ( https://ursalabs.org ), an independent development lab with the mission of innovation in data science tooling.
2116
2117
Footguns with Postgres “at time zone 'UTC'”
And why you may need to repeat AT TIME ZONE 'UTC' twice. SUMMARY * AT TIME ZONE 'UTC' converts the data type from timestamptz to timestamp (example). * Now you are inadvertently using the timestamp without time zone (aka timestamp) data type, which is markedly discouraged. * There are tons of footguns with timestamp…
2118
Should you ditch Spark for DuckDB or Polars?
There’s been a lot of excitement lately about single-machine compute engines like DuckDB and Polars. With the recent release of pure Python Notebooks in Microsoft Fabric, the excitement about these lightweight native engines has risen to a new high. Out with Spark and in with the new and cool animal-themed engines— is…
2119
2120
2121
Having, a less understood SQL clause
Understanding how the group by and having clauses work can help us write more efficient SQL. I want to demonstrate this with an example…
2122
Let's talk about joins
An review of horizontal and vertical joins with examples from education research.
2123
LevelDB: A Fast Persistent Key-Value Store
The latest news from Google on open source releases, major projects, events, and outreach programs for early career developers.
2124
2125
The State of Vacuum in Postgres
In a recent blog post , I talked about why every system that implements MVCC needs some scheme for removing old row versions, and how VACUUM...
2126
Microsoft, UW demonstrate first fully automated DNA data storage
Researchers encode the word “hello” in fabricated DNA, convert it back to digital using fully automated DNA storage system.
2127
Hard Drive Stats for Q3 2017
We take a look at the performance of our 86,529 hard drives and break down the failure rates by manufacturer and model size.
2128
Using MySQL as a NoSQL - A story for exceeding 750,000 qps on a commodity server
UPDATE: Oracle officially released memcached daemon plugin that talks with InnoDB. I'm glad to see that NoSQL+MySQL has become an official ...
2129
Switching Jobs
When people move to different jobs, here’s where they go.
2130
131M American Buildings
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...