631
Overview of Consistency Levels in Database Systems
Database systems typically give users the ability to trade off correctness for performance. We have spent the previous two posts in this s...
New
The latest blog posts to take off on Hacker News. 1,888 posts.
632
Do data-driven companies win?
Some gut-based judgements on the effectiveness of data.
633
Dicom File Format Basics
Explore the fundamentals of the DICOM file format! This quick introduction covers the basics of DICOM's structure, its essential uses, and tips for easily navigating its complex and abstract components.
634
ML is not that good at predicting consumers' choices
I wanted to share the attached paper on choice prediction that I recently co-authored with Itamar Simonson in case it’s of interest.
635
Pretty maps in Python
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
636
Soft deletion probably isn't worth it
The traditional soft deletion pattern using <code>deleted_at</code> columns leaks into code, curbs the usefulness of foreign keys, and makes data removal difficult. Luckily, there’s an alternative.
637
638
I disagree with Turing and Kahneman regarding statistical evidence (2014)
It’s funny. I’m the statistician, but I’m more skeptical about statistics, compared to these renowned scientists.
639
The DynamoDB Paper
This week at USENIX ATC’22, a group of my colleagues 1 from the AWS DynamoDB team are going to be presenting their paper Amazon DynamoDB: A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service . This paper is a rare look at a real-world distributed system that runs at massive scale.
640
Why Can't Database Tables Index Themselves? (2006)
Here’s a thought question for today: why can’t database tables index themselves? Obviously, indexes are a central concept to databases and database performance. But horror tales still abound of naïve developers who “forget” to index their tables, and encounter massive performance and scalability problems down the road…
641
Things to know about databases
How Relational Databases Work. This post talks about how indexes and transactions work on the inside of relational databases.
642
643
Revisiting the principles of data-oriented programming
Principles of Data-Oriented Programming. Benefits and costs of Data-Oriented Programming. DOP vs OOP. DOP vs FP.
644
One-liner for running queries against CSV files with SQLite
I figured out how to run a SQL query directly against a CSV file using the sqlite3 command-line utility:
645
How to Find and Stop Running Queries on PostgreSQL
Your PostgreSQL server is seizing up, with some naughty queries consuming too many resources or blocking others. Don’t panic! You can stop those problem queries and stabilize your system.
646
Map Data: False Assumptions
Famously, engineers tend to make wrong assumptions about a lot of things: Names and time are two well-known examples. Maps are a rich source of edge cases. Especially when you start dealing with gl…
647
No, QuestDB is not Faster than ClickHouse
telegra.ph/no-questdb-is-not-faster-than-clickhouse-06-152022144 points63 commentscited by 3Databases & Data details
QuestDB created a minor stir in the small but active world of analytics database benchmarking with this blog article: https://questdb.io/blog/2022/05/26/query-benchmark-questdb-versus-clickhouse-timescale. This is the money quote: “QuestDB is an order of magnitude faster than both TimescaleDB and ClickHouse in this…
648
Hacker News “Who is Hiring?” top-level comments over time
tl;dr: I believe HN Who is Hiring? posts are down; scroll to the bottom for the chart, code lives here. Hacker News. The Orange Site. Since April 2011, it’s had a thread every month, which dares potential employers to answer one question: who is hiring? I take a quick skim through this thread every month. ... Hacker…
649
In Defense of OpenStreetMap's Data Model
Who's the customer, anyway?
650
Some thoughts on machine learning with small data
I feel techniques for making machine learning work with small data are not talked about enough. This makes sense because many ML applications are only possible by collecting a huge amount of data. …
651
652
Architecture Notes: Datasette
Simon is the creator of Datasette and co-creator of Django web framework. Formerly he was a JSK journalism fellow at Stanford, and prior to that an Engineering Director at Eventbrite.
653
How I Built Zig-SQLite
Article explaining how to leverage Zig's compile time metaprogramming to build a SQLite wrapper that can type check SQL queries
654
The end of big data
Databricks, Snowflake, and the end of an overhyped era.
655
Useful Python decorators for data scientists
I show toy implementations of Python decorator patterns that may be useful for Data Scientists.
656
Unfinished Business with Postgres
7 years ago I left Heroku. Heroku has had a lot of discussion over the past weeks about its demise, whether it was a success or failure, and the current state. Much of this was prompted by the recent, and on-going security incident, but as others have pointed out the product has been frozen in time for some years now…
657
658
JSON and Virtual Columns in SQLite
Faster JSON handling in a relational database.
659
Monarch: Google’s Planet-Scale In-Memory Time Series Database
These paper reviews can be delivered weekly to your inbox , or you can subscribe to the Atom feed . As always, feel free to reach out on Twitter with feedback or suggestions!
660
When buying the dip doesn’t work: An analysis of the dot-com crash
When a sale isn’t quite what it seems to be