211
How We Turn Authorization Logic into SQL
How we developed Oso to let you query your database using your authorization policy.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 314 posts.
212
Exploring Databases Visually
Things you can do with a terminal emulator that renders images: generate contextual entity-relationship diagrams and navigate your data model from the inside!
213
The Database Inside Your Codebase
Navigating codebases of any meaningful size is difficult. Most of a programmer's time is spent jumping through the codebase, reading or skimming to build a ment...
214
US Presidential Election $25k Database Bounty Review
Blog for DoltHub, a website hosting databases made with Dolt, an open-source version-controlled SQL database with Git-like semantics.
215
Modern Text Features in R
ragg has taken a major leap forward in text-rendering capabilities with the latest releases of systemfonts, textshaping, and ragg itself. This post will go into detail with what is now possible and how it compares to the build in devices.
216
Apache Arrow 4.0
The Apache Arrow team is pleased to announce the 4.0.0 release. This covers 3 months of development work and includes 711 resolved issues from 114 distinct contributors. See the Install Page to learn how to get the libraries for your platform. The release notes below are not exhaustive and only expose selected…
217
A Data Pipeline Is a Materialized View
Say you run an online book store and want to build a data pipeline that figures out who the top-selling authors are. Logically, the input to the pipeline is a log of every individual book purchase on the store for all time, along with details about each book like who authored it. And the output is a list of the…
218
Fuzzy Name Matching in Postgres
The page "Falsehoods Programmers Believe About Names" covers some of the ways names are hard to deal with in programming. This post will ignore most of those complexities, and deal with the problem of matching up loose user input to a database of names.
219
Git as a NoSql Database (2016)
Git’s man-pages state that it’s a stupid content tracker. It’s probably the most used version control system in the world. Which is very strange, since it doesn’t describe itself as being a source control system. And in fact, you can use git to track any
220
The Reactive Monolith – How to Move from CRUD to Event Sourcing
Photo by Alex Wong on UnsplashWe all heard that story before: The big monolith which brings so much business value and faithfully serves our customers is starting to slow us down. The product vision is evolving towards reactive features, which means reacting in real time to multiple domain events in the right context…
221
222
OpenSearch 1.0
Today is a really good day for the OpenSearch project. Since its start, the goal has been to quickly produce a version of OpenSearch that’s ready to use in production...
223
We scaled the GitHub API with a sharded, replicated rate limiter in Redis
Adventures in leveling up our API rate limiting infrastructure
224
FastText is the best text classification library for a quick baseline
Text classification is a very frequent use case for machine learning (ML) and natural language processing (NLP). It’s used for things like spam detection in emails, sentiment analysis for social media posts, or intent detection in chat bots. In this series I am going to compare several libraries that can be used to…
225
Why are there so many Canadians in India?
Any time India comes up in the context of Firefox and Data I know it’s going to be an interesting day. They’re our largest Beta population: They’re our second-largest English user…
226
Write an SQL query builder in 150 lines of Python
This is the fourth article in a series about writing my own SQL query builder. Today, we'll rewrite it from scratch, explore API design, learn when to be lazy, and look at worse and better ways of doing things – all in 150 lines of Python!
227
Lessons Learned from Two Years as a Data Scientist
I finally escaped from (grad) school in 2019, spent two months interning as an assistant trader at FTX, and have since spent the last two years working as a data scientist, with the bulk of that time at Microsoft and the last two months at Anthropic. Not gonna lie — my time as a data scientist has been pretty awesome…
228
Anonymized data is rarely anonymous
Justin Sherman for Wired points out the farce that is anonymized data: Data on hundreds of millions of Americans’ races, genders, ethnicities, religions, sexual orientations, political beliefs, int…
229
Plotnine: Grammar of Graphics for Python (2019)
Blog article by Jeroen Janssens. Jul 7, 2024. 93 min read. Hey there, you’re reading an updated version of a post I published way back in 2019. Because of the 2024 Plotnine contest and the recent release of Polars 1.0, I decided to freshen things up. Changes include: Upgrade to Plotnine version 0.13.6 (from…
230
231
232
233
One of these JPEGs is not like the other
“JPEG” or the image encoding specification by the “Joint Photographic Experts Group” (JPEG) is a truly universal format at this stage. You really cannot go very far on the internet without seeing a JPEG file. The amount of content encoded in JPEGs must be surely biblical by now. If there is one thing that is going to…
234
A better way to build ML: Why you should be using Active Learning
Data labeling is often the biggest bottleneck in machine learning. Active learning lets you train machine learning models with much less labeled data. The best AI-driven companies, like Tesla, use active learning.
235
Debugging random slow writes in PostgreSQL
Understanding & mitigating randomly slow writes in PostgreSQL
236
SQLite Is Dynamically Typed (2020)
A small, cool fact about SQLite is that its columns are flexibly typed. You can store any value in any column! Try it out: sqlite> create table t1 (v1 int, v2 varchar(10)); sqlite> insert into t1 values ("abc", "this string is longer than 10 characters!"); sqlite> select * from t1; abc|this string is longer than 10…
237
238
Postgres sequences can skip 32 unexpectedly
The other day, we started getting strange reports from some customers of incident.io. Their incident identifiers — unique numbers to identify each incident — appeared to have jumped unexpectedly.
239
What's New in ClickHouse 21.12
What’s New in ClickHouse 21.12
240
A journey to io_uring, AIO and modern storage devices
We performed experiments to find out how different Linux system calls perform for available devices.