Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 332 posts.
How We Found All of Optimizely's Clients
Search Engine For Source Code. Find websites using technology, HTML, Javascript, CSS Tags.
Distributed Consensus – How Shared Data Is Stored
If you don’t work in computers, you probably haven’t spent much time thinking about how data gets stored on computers or in the cloud. I’m…
How I Reduced My DB Server Load by 80%
Database load can be a silent performance killer. I’ve been optimizing the query performance of a web app I run designed to get people involved in open sourc...
The often-overlooked random forest kernel
Ryan Marcus, assistant professor at the University of Pennsylvania. Using machine learning to build the next generation of data systems.
Hash indexes are faster than btree indexes?
PostgreSQL have supported Hash Index for a long time, but they are not much used in production mainly because they are not durable. Now, ...
Implementing State Machines in PostgreSQL
Finite-state machine (FSM) is a wonderful model of computation that has many practical applications. One of my favorites is turning business logic into simple FSMs. For example consider the following requirements for an order management system:
Search at Slack
On average, 20% of a knowledge worker’s day is spent looking for the information they need to get their work done. If you think about a typical work week, that means an entire day is dedicated to this task! To help our users find more time in their day, the Search, Learning, and Intelligence team set…
Oracle’s Cloud Licensing Change
Over the last couple of years I've been doing talks about running Oracle databases in the cloud. In both my talks and articles I refer to the Licensing Oracle Software in the Cloud Computing Environment document. This morning I was reading a post on a mailing list and someone mentioned the document had been updated on…
Making Google Data Studio Free for Everyone
Today, Google's mission to organize the world's information and make it universally accessible and useful is even more relevant and broad reaching.
Elasticsearch 6.0.0 GA released
With 2236 pull requests by 333 commiters added since the release of Elasticsearch 5.0.0, we are proud to announce the release of Elasticsearch 6.0.0 GA, based on Lucene 7.0.1.
Postgres tips for Rails developers
At RailsConf, the Citus engineering team found themselves sharing lots of useful Postgres tips on how to debug and improve the performance of your Postgres database from your Rails app. Includes topics like long-running queries, misbehaving queries, pg_stat_statements, pgBouncer, and more.
How we saved money by replacing Mixpanel with BigQuery and K8S
Insights, guides, and product updates from Cloud Intelligence™.
Getting the Most Out of Sqlite3 with Python
Simplex Sigillum Veri
Playing with 80M Amazon Product Review Ratings Using Apache Spark
Manipulating actually-big-data is just as easy as performing an analysis on a dataset with only a few records.
Ways to paginate in Postgres (2016)
Pagination, pervasive as it is in web applications, is easy to implement inefficiently. This post examines different methods of server-side pagination and their tradeoffs in PostgreSQL. Methods explored include limit-offset, cursors, keyset pagination, as well as more exotic techniques.
LogDevice: a distributed data store for logs
Visit the post for more.
Implementing Stripe-Like Idempotency Keys in Postgres
Building resilient services by identifying foreign state mutations and grouping local changes into restartable atomic phases so that every request can be driven to completion.
Tendermint 0.10.2
Tendermint is a server and a protocol for building linearizable (or sequentially consistent) byzantine fault-tolerant applications. Tendermint validators accept transactions from clients over HTTP, and replicate them to the other validators in the cluster, forming a totally ordered sequence of transactions. Each…
.NET Core Image Processing
Image processing, and in particular image resizing, is a common requirement for web applications. As such, I wanted to paint a panorama of the options that exist for .NET Core to process images. For each option, I’ll give a code sample for image resizing, and I’ll outline interesting features. I’ll conclude with a…
Storage engine design
In time-series databases the querying pattern differs from the write pattern. We usually write data in time order by updating many series every second. But querying is a different story. We usually want to read only a handful of series leaving most of the data behind. Here lies the biggest problem, which is we don’t…