2911
Non-elementary group-by aggregations in Polars vs pandas
A closer look at non-elementary group-by aggregations
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
2912
Don't use Scatterplots
In a series of blog posts, Gary Rubinstein attempts show that the Value Added Modelling scores recently released by the NYC Department of Education prove that VAM (Value Added Modelling) is not accurate. However, whatever flaws VAM may have, Gary Rubinstein (henceforth GR) hasn't demonstrated them. All he has…
2913
$50 PlanetScale Metal Is GA for Postgres
We've lowered the entry price for using PlanetScale Metal to $50 and added more flexibility in storage-to-compute ratios.
2914
2915
Linux's fsync() woes are getting some attention
In two weeks, I'm headed to LSF/MM and the Linux Collaboration Summit , by invitation of some Linux kernel hackers, to discuss how the Linu...
2916
RethinkDB 2.1 beta: automatic failover with Raft
The upcoming 2.1 release will introduce important improvements , including support for automatic failover. Although we’re still hard at work on the finishing touches that will make the new features ready for production use, the beta offers an opportunity to get an early look.
2917
Why CockroachDB doesn't use EvalPlanQual
Under READ COMMITTED isolation, PostgreSQL can sometimes miss rows when performing UPDATE, DELETE, SELECT FOR UPDATE, or SELECT FOR SHARE statements. This is due to the EvalPlanQual recheck PostgreSQL adds to these statements to prevent lost-update anomalies.
2918
2919
2016's most-edited Wikipedia articles
Which English Wikipedia articles were edited most in 2016? Find out what captured editors’ interests.
2920
Apache Kafka Beyond the Basics: Windowing
Learn what windowing is, the difference between the four types of windows (hopping and tumbling, or session and sliding), and how to create them.
2921
Time-travel queries in CockroachDB
We have added a new feature: time-travel queries. To our knowledge, we are the first database to have implemented the them.
2922
2923
Scalable Stream Processing: A Survey of Storm, Samza, Spark and Flink
(At the bottom of this page, you find a BibTeX reference to cite this article.)
2924
Ledger: Stripe's system for tracking and validating money movement
Technical details on how Stripe built Ledger, a state-of-the-art money movement tracking system, including how teams at Stripe interact with the data quality metrics that underlie our payment processing network.
2925
Guide to data tools landscape for developers
Found yourself on a data project and have no idea what they all are talking about? Feel excluded from all the fun discussions in the office kitchen? If only there were a humongous guide going over all the concepts and buzzwords...
2926
Reproducible machine learning with PyTorch and Quilt
In this article, we'll use Quilt to transfer versioned training data to a remote machine. We'll start with the Berkeley Segmentation Dataset, package the dataset, then train a PyTorch model for super-resolution imaging.
2927
2928
Protocol Buffers, Avro, Thrift & MessagePack
Perhaps one of the first inescapable observations that a new Google developer ( Noogler ) makes once they dive into the code is that Protocol Buffers (PB) is the "language of data" at Google. Put simply, Protocol Buffers are used for serialization, RPC, and about everything in between .
2929
Tokyo Cabinet DB: Beyond Key-Value Store
It took Ruby some time to go from an infant research project by Matz to a language we've all come to know so well. Now, another Japanese developer ( Mikio Hirabayashi ) has all the potential to repeat this cycle with his new database project: Tokyo Cabinet . Developed and sponsored by Mixi Inc . (Japanese Facebook)…
2930
Flyte: A Cloud Native Machine Learning and Data Processing Platform
Today Lyft is excited to announce the open sourcing of Flyte, a structured programming and distributed processing platform for highly…
2931
Visualizing Binary Files
It's all black and white, basically. A while ago, Vim's xxd gained the ability to color the output (this is not included in Vim Classic , which I use):
2932
2933
2934
Build your own SQLite, Part 4: reading tables metadata
As we saw in the opening post, SQLite stores metadata about tables in a special "schema table" starting on page 1. We've been reading records from this…
2935
Using Neural Networks to Find Answers in Tables
Posted by Thomas Müller, Software Engineer, Google Research Much of the world’s information is stored in the form of tables, which can be found o...
2936
Taming Recurrent Neural Networks for Better Summarization
This blog post is about the ACL 2017 paper Get To The Point: Summarization with Pointer-Generator Networks by Abigail See, Peter J Liu, and Christopher Manni...
2937
Lisp Query Notation (LQN)
Query language and terminal utility for transforming various data formats
2938
2939
Cash Is King: Flows, Balances, and Buffer Days
See how our clients and partners—from small business owners to workforce training leaders—work with JPMorganChase to drive meaningful impact and economic growth where they live and work.
2940
Can we replace a $150k Looker with a bucket of HTML files?
(BI) Software is dead, apparently