661
Backblaze Durability Is Eleven 9s – And Why It Doesn’t Matter
We’ve calculated Backblaze’s storage durability at 99.999999999%. What does that impressively large number mean, and does it actually matter for your data?
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
662
663
LLaMA2 Chat 70B outperformed ChatGPT
AlpacaEval an LLM-based automatic evaluation that is fast, cheap, and reliable. It is based on the AlpacaFarm evaluation set, which tests the ability of models to follow general user instructions. These responses are then compared to reference responses (Davinci003 for AlpacaEval, GPT-4 Preview for AlpacaEval 2.0) by…
664
Full text search over Postgres: Elasticsearch vs. alternatives
A comprehensive comparison between Elasticsearch and PostgreSQL for search workloads.
665
666
B-Trees: More Than I Thought I'd Want to Know (2021)
B-Trees are not boring, after all
667
Hard problems that reduce to document ranking
There are two claims I’d like to make: LLMs can be used effectively1 for listwise document ranking. Some complex problems can (surprisingly) be solved by transforming them into document ranking problems. I’ve primarily explored both of these claims in the context of using patch diffing to locate N-day…
668
Top data mining algorithms in plain English
Today, I'm going to explain in plain English the top 10 most influential data mining algorithms as voted on by 3 separate panels in this survey paper. Once you know what they are, how they work, what they do and where you ... Read More
669
Analysis of Apple Watch running data
Analysis of Apple running measurements and statistics
670
How to Analyze Billions of Records per Second on a Single Desktop PC
Introduction This article gives an overview of LocustDB [1], a new and extremely fast open-source analytics database built in Rust. Part 1 gives some background on analytical query systems and my g…
671
Scaling Django to 8 Billion Page Views
At more than 8 billion page views per month and 45k requests per second, we’ve learned a couple things about delivering comments at scale.
672
Things I wish I knew about MongoDB a year ago
I’ve used MongoDB for over a year at scale at both Heyzap and Bugsnag and I’ve found it to be a very capable database. As with all databases, there are some gotchas, and here is a summary of the things I wish someone had told me earlier.
673
1.1B Taxi Rides on Kdb+/q and 4 Xeon Phi CPUs
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
674
Better Database Migrations in Postgres
As your database grows and scales there are some operations that you need to take more care of than you did when you were just starting. When working with your application in your dev environment you may not be fully aware of the cost of some operations until you run them against production. And at some point most of…
675
LiteCLI – A user-friendly command-line client for SQLite database
LiteCLI is written in python using the wonderful prompt-toolkit library. It is cross-platform compatible and it is tested on Linux, MacOS and Windows.
676
677
MeiliSearch: A Minimalist Full-Text Search Engine
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
678
Waiting for PostgreSQL 14 – SEARCH and CYCLE clauses
Which means, that to test it, we need some data for recursive queries. This time I took directory listing of my /etc, and loaded it to db:
679
Postgres Incremental Backup
We walk through the incremental backup feature committed to the Postgres 17 development branch by Robert Haas. We show an example on our local machine.
680
Why SQLite does not use Git (2018)
The document you seek is not available. Please consider one of the links below or use the Search feature on the right-hand side of the menu bar above.
681
User-defined Order in SQL
Some applications, such as todo lists, need to maintain a user-defined order of items. The challenge is that the order is arbitrary and can change when the user rearranges items:
682
Kafka Removing Zookeeper Dependency
Say goodbye to Kafka ZooKeeper dependency! KIP-500 introduces a new way of storing data in Kafka itself, rather than in external systems such as ZooKeeper.
683
At 22 years old, Postgres might just be the most advanced database yet
From Pub-Sub messaging to Foreign Data Wrappers - five extraordinary features that made Postgres our backend of choice for Arcentry
684
685
Aurora - New MySQL-Compatible Database Engine
We launched the Amazon Relational Database Service (Amazon RDS) service way back in 2009 to help you to set up, operate, and scale a MySQL database in the cloud. Since that time, we have added a multitude of options to RDS including extensive console support, three additional database engines ( Oracle, SQL Server, and…
686
687
Announcing YouTube-8M: A Large and Diverse Labeled Video Dataset for Research
Posted by Sudheendra Vijayanarasimhan and Paul Natsev, Software EngineersMany recent breakthroughs in machine learning and machine perception have ...
688
689
Does Reddit have an astroturfing problem? What the data suggests
In 51,129 comments from six knife subreddits, the 5% most brand-heavy accounts wrote 11.3% of the brand mentions in buying threads, against 7.9% expected by chance. For one brand it is 31% against 8%. The full Reddit histories of those accounts are 4.5 years old and spread over 66 subreddits, the same as a comparison…
690
Ditching Excel for Python in a legacy industry
I spent 3 years as an analyst in the reinsurance industry. During this time, I witnessed firsthand how Python is driving rapid technological change. (Goodbye, Excel!)