Reddit’s database has two tables (2012)
Steve Huffman talks about Reddit’s approach to data storage in a High Scalability post from 2010. I was surprised to learn that they only have two tables in their database.
The latest blog posts to take off on Hacker News. 4,224 posts.
Steve Huffman talks about Reddit’s approach to data storage in a High Scalability post from 2010. I was surprised to learn that they only have two tables in their database.
the forgotten data structure (not really)
Understanding how the group by and having clauses work can help us write more efficient SQL. I want to demonstrate this with an example…
In 2022, data engineers manage forests, not trees
About the many types of hash functions, their use-cases, dos and don'ts, with suggestions for currently accepted algorithms.
Database systems typically give users the ability to trade off correctness for performance. We have spent the previous two posts in this s...
Today we're excited to announce the release of EdgeDB 2.0, the latest version of our graph-relational database.
Some gut-based judgements on the effectiveness of data.
Mixed appraisals of one of the Internet’s great friends (or foes), Wikipedia, are reflected in the slightly dystopian article “List of Wikipedia Scandals”, which sits below a Wikipedia web address. Scrutiny aside, billions of users routinely flock to the online, anonymously editable encyclopedia knowledge bank for…
Let's open a hex editor and see what this thing is made of
We are very excited to announce that RStudio has a new name, Posit.
At Nile, we’re making it easier for companies to build world-class control planes for their infra SaaS products
A blog by and for database architects.
Explore the fundamentals of the DICOM file format! This quick introduction covers the basics of DICOM's structure, its essential uses, and tips for easily navigating its complex and abstract components.
I wanted to share the attached paper on choice prediction that I recently co-authored with Itamar Simonson in case it’s of interest.
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
The traditional soft deletion pattern using <code>deleted_at</code> columns leaks into code, curbs the usefulness of foreign keys, and makes data removal difficult. Luckily, there’s an alternative.
Amazon ICML paper proposes information-theoretic measurement of quantitative causal contribution.
Indie Hackers is a wonderful community for founders, a vast ocean of shared knowledge and a place to showcase your product journey. A lot of people are sharing their products there along with the revenue, often verified by Stripe. We analyzed the available data to check how much revenue are those products making and…
Different approaches for tracking visitor counts with PostgreSQL.
It’s funny. I’m the statistician, but I’m more skeptical about statistics, compared to these renowned scientists.
Continuous aggregates are one of Timescale's most popular features, but you can’t fully understand them without some context on Postgres views and materialized.
This week at USENIX ATC’22, a group of my colleagues 1 from the AWS DynamoDB team are going to be presenting their paper Amazon DynamoDB: A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service . This paper is a rare look at a real-world distributed system that runs at massive scale.
Last year, Google released their “GoEmotions” dataset: a human-labeled dataset of 58K Reddit comments categorized according to 27 emotions. The problem? A whopping 30% of the dataset is mislabeled! Check out some of the egregious errors, and learn how to build better datasets.30% of Google's Emotions Dataset is…
Column order can determine how quickly your data is processed in PostgreSQL. Find out how to troubleshoot performance problems in wide tables
With Postgres, you don't need to immediately look farther than your own database management system for a full-text search solution. If you haven't yet given Postgres' built-in full-text search a try, read on for a simple intro.