781
Scaling Relational SQL Databases (2020)
A list of things that we can do when we need to scale a SQL database.
New
The latest blog posts to take off on Hacker News. 1,888 posts.
782
Rqlite 6.0: the evolution of a distributed database design
rqlite is a lightweight, open-source, distributed relational database written in Go, which uses SQLite as its storage engine. v6.0.0 is out now and makes clustering more robust. It also lays the foundation for more important features. What's new in 6.0? 6.0 multiplexes multiple logical connections between rqlite nodes…
783
No general method to detect fraud
The parts of a convincing deception
784
Text Classification by Data Compression
Edit – I posted this on Hackernews and got some valuable feedback. Many brought up the fact that you should be able to reuse the internal state of the compressor instead of recompressing the training …
785
The pedantic checklist for changing your data model in a web application
Let's say you have a web app with some database. In your database you have an Invoice model, where you store things you are charging your customers.
786
Web Applications from the Future: A Database in the Browser
If progress follows it's usual strategy, then whatever is difficult and valuable to do today will become easy and normal tomorrow. I imagine we'll discover new abstractions, which will make writing Google Docs as easy as the average web app is today.
787
788
PostGIS at 20, the Beginning
Twenty years ago today, the first email on the postgis users mailing list (at that time hosted on yahoogroups.com) was sent, announcing the first numbered release of PostGIS. The early history of PostGIS was tightly bound to a consulting company I had started a few years prior, Refractions Research. My first contracts…
789
Potemkin Data Science (2020)
Huge swathes of people, in Europe and North America in particular, spend their entire working lives performing tasks they secretly believe…
790
791
792
Replacing Elasticsearch with Rust and SQLite (2017)
Caveat: Elasticsearch is a multi-purpose, distributed, battle-tested, schema-free, log and document storage engine. We’ll be replacing it with a single-purpose, relational schema, me-tested, and custom nginx access log storage engine. Knowing that, let’s begin. Find this project on Github After building my home…
793
Debugging random slow writes in PostgreSQL
Understanding & mitigating randomly slow writes in PostgreSQL
794
Good data scientist, bad data scientist
What separates a good Data Scientist from a bad one?
795
An opinionated map of incremental and streaming systems
Disclaimer: I used to work for Materialize which is one of the systems being compared in this post.
796
Practical SQL for Data Analysis
What you can do without Pandas
797
Why are there so many Canadians in India?
Any time India comes up in the context of Firefox and Data I know it’s going to be an interesting day. They’re our largest Beta population: They’re our second-largest English user…
798
Hosting SQLite databases on GitHub Pages or any static file hoster
I was writing a tiny website to display statistics of how much sponsored content a Youtube creator has over time when I noticed that I often write a small tool as a website that queries some data from a database and then displays it in a graph, a table, or similar. But if you want to use a
799
Query Engines: Push vs. Pull
People talk a lot about “pull” vs. “push” based query engines, and it’s pretty obvious what that means colloquially, but some of the details can be a bit hard to figure out.
800
Excess Deaths in 2020
Update Updated on April 29th, 2021. The CDC continues to update its counts of deaths by cause for 2020 as data comes in from the jurisdictions that report to it. The data are by now fairly complete, though there are still significant gaps in several states due to delayed reporting. North Carolina, in particular, has…
801
Diving Deep on S3 Consistency
A deep dive on why we changed Amazon S3's consistency model
802
Filecoin, StorJ and the problem with decentralized storage (2019)
Blockchains for everything Decentralized storage services such as Filecoin and StorJ seek to disrupt the data-storage industry, using blockchain tokens to create a competitive marketplace that can …
803
What’s the origin of the phrase “big data doesn’t fit in excel”?
Welcome to Yak Shaving School! As part of my MSc I'm reading a book about Data Analytics. So I've been chasing down quotes to find their origin. One paper had this popular quote in it (emphasis added): As with many rapidly emerging concepts, Big Data has been variously defined and operationalized, ranging from trite…
804
SQLite the only database you will ever need in most cases
The name SQLite is a nice name, but the "lite" part is misleading, it sounds like it is only useful for tiny things - which is very wrong. SQLite should be named AwesomeSQL, because that is what it is. SQLite is probably the only database you will ever need in most cases.
805
Things I hate about PostgreSQL (2020)
Over the last few years, the software development community’s love affair with the popular open-source relational database has reached a…
806
Git as a NoSql Database (2016)
Git’s man-pages state that it’s a stupid content tracker. It’s probably the most used version control system in the world. Which is very strange, since it doesn’t describe itself as being a source control system. And in fact, you can use git to track any
807
Exploring Databases Visually
Things you can do with a terminal emulator that renders images: generate contextual entity-relationship diagrams and navigate your data model from the inside!
808
Building a full-text search engine in 150 lines of Python code
Full-text search is everywhere. From finding a book on Scribd, a movie on Netflix, toilet paper on Amazon, or anything else on the web through Google (like [how to do your job as a software engineer](https://localghost.dev/2019/09/everything-i-googled-in-a-week-as-a-professional-software-engineer/)), you've searched…
809
SQLite is not a toy database
Here is why SQLite is a perfect tool for you - whether you are a developer, data analyst, or geek.
810
How to create a 1M record table with a single query
With recursive CTE and randomized data.