Reed-Solomon error recovery in RAID-6
A post describing a simple example how you can create your own manual error recovery solution based on what is used in RAID-6, in Python.
Topics /
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
A post describing a simple example how you can create your own manual error recovery solution based on what is used in RAID-6, in Python.
ZIA is a place for me to “think out loud,” about my current and future research. As the author, my goals are to share my ideas, highlight new research, and possibly develop new tools along the way.
I have done a few previous blog posts on who has contributed to PostgreSQL , but I did not do one last year. A couple people mentioned to me...
You probably do not know that the 3 most interesting things I found will blow your mind.
Common problems in financial recon, for fintechs, particularly those building deposit products and managing their own ledger.
Looking to run Postgres on ZFS? I've gathered some of the information and sage advice out there to give you a head start on figuring out how to do it safely and efficiently.
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
I have to admit, my research blog posts are getting longer and longer. From one side I find it genuinely encouraging, because if one gets so much information just by scratching the topic, imagine what’s hidden beneath the surface! One university professor once said “what could be interesting in databases?”, and it…
Object-Relational Mappers get a lot of hate from people who misjudge the complexities of the task.
Last weekend I tweeted two links to two tweets by a poor guy who apparently got his MongoDB database into an unrecoverable state during shutdown whilst upgrading to a newer version. That tweet quickly made the rounds, and the next morning I saw myself staring at replies stating that it was all his fault, because he…
[This is part two in a series — you should read part 1 first for context and then you might go on to part 3.] The Dublin Core — metadata made dumb Just when librarians were in despair o…
Dissecting the Octopus
This analysis was featured on: The Hustle newsletter (lead story), TechCrunch, Hacker News, The Growth Newsletter (issue #021), Social Blade, Data Science...
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
Software engineer, etc etc
There has been quite a bit of furor and excitement on the Internet this week regarding some very public criticisms (and defenses) of MongoDB and its creators, 10gen . Unfortunately, a ghost from my recent past also resurfaced as a result. Let me begin by apologizing to 10gen and its engineers for what I said at JSConf…
About the many types of hash functions, their use-cases, dos and don'ts, with suggestions for currently accepted algorithms.
Writing a storage engine for Postgres: an in-memory Table Access Method
Zookeeper is an Apache project for providing coordination services to distributed systems. ZooKeeper aims to provide a simple kernel (a fil...
Previously in Jepsen , we discussed Redis . In this post, we’ll see MongoDB drop a phenomenal amount of data. See also: followup analyses of 2.6.7 and 3.4.0-rc3 .
Packages that need to read cdb files should incorporate the necessary portions of the cdb library rather than relying on an external cdb library.