1411
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
1412
What people want (according to Google Suggest)
Mergesort and Quicksort are two well-known sorting algorithms, familiar to both researchers and practitioners. Both are typically presented as examples of divide and conquer . Other than this fact, they are usually not seen to be very closely related. Let’s look at Mergesort and Quicksort in a somewhat unusual way…
1413
Google Homepage Size Over Time
This afternoon, I looked at the source of the main Google page with my browser. It spans my whole monitor and takes 15 pushes of the scroll-wheel to see it all. Whither minimalism? Off to the Wayba…
1414
Diving Deep on S3 Consistency
A deep dive on why we changed Amazon S3's consistency model
1415
Push-based outbox pattern with Postgres logical replication
There are only a few patterns that I’m comfortable saying: “You should use it always if you want to build mature system”. One of them is the Outbox Pattern. Why? Because…
1416
Where is every IP Address?
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
1417
Pandas Exercises for Data Analysis (Interactive)
101 interactive pandas exercises with solutions. Edit and run every code block directly in your browser — no installation needed.
1418
Joining CSV and JSON data with an in-memory SQLite database
The new sqlite-utils memory command can import CSV and JSON data directly into an in-memory SQLite database, combine and query it using SQL and output the results as CSV, JSON …
1419
Let's Talk SkipList
the forgotten data structure (not really)
1420
1421
Elasticsearch Based Image Search Using RGB Signatures
In my previous post , I described some experiments I was doing to reduce images to a Bag of Visual Words (BOVW) . My goal is to build a Con...
1422
In defence of SQL
SQL is ugly but powerful, ORM is genuinely dumb, and "NoSQL" should really be called OMADS: Obviously More Appropriate Data Stores. Start every project with an RDBMS, add specialized stores where they fit, and stop apologizing for using SQL. Forty years on, nothing beats it for ad-hoc questions about your data.
1423
1424
What’s the origin of the phrase “big data doesn’t fit in excel”?
Welcome to Yak Shaving School! As part of my MSc I'm reading a book about Data Analytics. So I've been chasing down quotes to find their origin. One paper had this popular quote in it (emphasis added): As with many rapidly emerging concepts, Big Data has been variously defined and operationalized, ranging from trite…
1425
1426
Using machine learning to choose compression algorithms
30% less disk required compared to using the single best strategy
1427
1428
1429
Analytics at GitHub
In the interest of getting back into writing, I want to break the seal with a simple “what have I been up to and thinking about lately” style post.…
1430
How to Find and Stop Running Queries on PostgreSQL
Your PostgreSQL server is seizing up, with some naughty queries consuming too many resources or blocking others. Don’t panic! You can stop those problem queries and stabilize your system.
1431
Modelling game economy with Neo4j
Learn to build production-ready serverless applications on AWS
1432
Free Data Science Books
I've been impressed in recent months by the number and quality of free datascience/machine learning books available online. I don't mean fre...
1433
A Guide to Bayesian Statistics
A guide for getting started with Bayesian Statistics! Start your way with Bayes' Theorem and end up building your own Bayesian Hypothesis test!
1434
Document Clustering with Python
ASIAN4D membahas apakah pola Toto4D benar-benar ada, bagaimana cara pemain membacanya, serta insight sederhana yang sering dipakai pemain Indonesia.
1435
Notebooks Are McDonalds of Code
You can come to McDonalds and order a salad, but you won't. Same with notebooks, you can write NASA-production-grade software in a notebook, but most likely you won't. Notebooks make you lazy, and encourage bad practices.
1436
Maintaining sufficient free space with ZFS
TLDR: ZFS free-space reporting is a lagging indicator. Background I use Proxmox VM server backed by a ZFS array of hard drives for various personal infrastructure. I also have security cameras that upload motion-triggered videos to my server (via FTP!). Problem Description I would like to use 90% of my available space…
1437
Thoughts on PostgreSQL in 2024
A look ahead at some ongoing projects in PostgreSQL in 2024 and beyond
1438
Migrating Large Heroku Postgres Instances to AWS Aurora Without Downtime
In this article I discuss a general process I used recently to migrate a large multi-terabyte Heroku Postgres Database from the Heroku Platform to Amazon Aurora Postgres on a live Heroku based application architecture with near zero downtime and builtin failover during the process.
1439
1440
Implementing faceted search with Django and PostgreSQL
I’ve added a faceted search engine to this blog, powered by PostgreSQL. It supports regular text search (proper search, not just SQL“like” queries), filter by tag, filter by date, filter …