2191
Using the linear distance operator in Postgres 12 to find the closest match
Experience zero data sprawl with EDB Postgres AI. Capable of handling 30B+ trades a day and managing 50 TB.
New
The latest blog posts to take off on Hacker News. 4,224 posts.
2192
File systems unfit as distributed storage back ends: lessons from Ceph evolution
File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., SOSP’19 Ten years of hard-won lessons packed into just 17 pages (13 if you don’t co…
2193
Layers in Software: From Data to Value
Then Back in the 2000s, we wrote applications in layers. Presentation layer, client, data transfer, API, business logic, data access, database. We maintained strict separation bet ween these layers…
2194
Building a Large-Scale Distributed Storage System Based on Raft
Guest post by Edward Huang, Co-founder & CTO of PingCAP In recent years, building a large-scale distributed storage system has become a hot topic. Distributed consensus algorithms like Paxos and Raft…
2195
What SQL Analysts Need to Know About Python (2016)
Explore technical topics, solutions, and resources for building with Twilio – and beyond.
2196
Building columnar compression in a row-oriented database
Read how we built a flexible, high-performance columnar compression mechanism for PostgreSQL to add scalability to our favorite database.
2197
We need new data books, so we started one: Cloud Data Management
Introducing Chartio and Data School’s new book Cloud Data Management (4 Stages for Informed Companies).
2198
FastSpark: A New Fast Native Implementation of Spark from Scratch
TLDR: Here is the code to explore.
2199
2200
2201
The Most Gender-Switched Names in the U.S.
We use some names mostly for boys and some mostly for girls, but then there is a small percentage that, over time, switched from one gender to another. Which names made the biggest switch?
2202
SQLite is easy to compile
SQLite is really easy to compile
2203
PostgreSQL example of self-contained stored procedures
Derek Sivers official site. Thoughts on philosophy, culture, self-improvement. Author of Useful Not True, How to Live, Hell Yeah or No, Anything You Want.
2204
2205
Solving a linear optimization problem on incentive allocation
At Lyft, scientists solve all kinds of optimization problems. While solvers can come in handy, there are times when complicated or…
2206
2207
Microsoft’s visual data explorer SandDance open sourced
SandDance, the beloved data visualization tool from Microsoft Research, has been re-released as an open source project on GitHub.
2208
Books: an immutable double-entry accounting database service
Tracking financial transactions at scale
2209
Apache Arrow Flight: A Framework for Fast Data Transport
This post introduces Arrow Flight, a framework for building high performance data services. We have been building Flight over the last 18 months and are looking for developers and users to get involved.
2210
Amazon’s Consumer Business Turned Off Final Oracle Database
Over my 17 years at Amazon, I have seen that my colleagues on the engineering team are never content to leave good-enough alone. They routinely re-evaluate every internal system to make sure that it is as scalable, efficient, performant, and secure as possible. When they find an avenue for improvement, they will use…
2211
Shareable Jupyter Notebooks That Run on Free Cloud GPUs
Gradient Community Notebooks provide free GPUs with pre-configured environments for machine learning and deep learning projects.
2212
AWS Elasticsearch: a fundamentally-flawed offering
I'm currently working on a logging project that was initially implemented using AWS Elasticsearch. Having worked with large-scale mainline Elasticsearch clusters for several years, I'm absolutely stunned at how poor Amazon's implementation is and I can't fathom why they're unable to fix or at least improve it. I…
2213
PyPy's New JSON Parser
Introduction In the last year or two I have worked on and off on making PyPy's JSON faster, particularly when parsing large JSON files. I...
2214
2215
Scribe: Transporting petabytes per hour via a distributed, buffered queueing
Our hardware infrastructure comprises millions of machines, all of which generate logs that we need to process, store, and serve. The total size of these logs is several petabytes every hour. The o…
2216
Sqlite 3.30.0
This page provides a high-level summary of changes to SQLite. For more detail, see the Fossil checkin logs at https://sqlite.org/src/timeline and https://sqlite.org/src/timeline?t=release . See the chronology a succinct listing of releases.
2217
2218
How much faster is Redis at storing a blob of JSON compared to Postgres?
tl;dr; Redis is 16 times faster at reading these JSON blobs.*
2219
New In Postgres 12: Generated Columns
pgDash is an in-depth monitoring solution designed specifically for PostgreSQL deployments. pgDash shows you information and metrics about every aspect of your PostgreSQL database server, collected using the open-source tool pgmetrics.
2220
Processing 40TB of code from 10M projects with a dedicated server and Go
The command line tool I created Sloc Cloc and Code (scc) (which is now modified and maintained by many other excellent people) counts lines of code, comments and makes a complexity estimate for files …