1441
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
1442
1443
New storage classes for Google Cloud Storage
Businesses seek the best price and performance to suit the storage needs of workloads ranging from multimedia serving, to data analytics and machine learning, to data backup/archiving, all of which drive demand for a variety of storage options. At Google, we aim to build a powerful cloud platform that can meet the…
1444
1445
A lost decade chasing distributed architectures for data analytics?
We benchmark DuckDB on a 2012 MacBook Pro to decide: did we lose a decade chasing distributed architectures for data analytics?
1446
1447
1448
1449
1450
1451
A new storage engine for PostgreSQL to provide better control over bloat
In the past few years, PostgreSQL has advanced a lot in terms of features, performance, and scalability for many-core systems. However, o...
1452
Why isn’t there a decent file format for tabular data?
Tabular data is everywhere. I support reading and writing tabular data in various formats in all 3 of my software application. It is an important part of my data transformation software. But all th…
1453
SQL nulls are weird
Yes, you read that right. SQL does treat all NULLs as distinct values. I learnt this a while back while working on Convoy and again on LiteQueue: a Golang a queueing library. Basically, any column wi
1454
AWS Outperforms GCP in the 2018 Cloud Report
Customers rely on us to help navigate the increasingly competitive cloud wars. This inspired the 2018 Cloud Report, a benchmark of AWS and GCP on performance, latency, CPU, network, I/O, and cost.
1455
Machine learning for financial prediction
Machine learning for trading is a huge domain, but not all applications are practical in terms of making your money grow. Let's find out what really works!
1456
Asynchronous Python and Databases
To quote the last part of this blog post, "I think it's [asyncio] really well done, it's fun to use, and I still am interested in having more of a SQLAlchemy story for it, because I'm sure folks will still want this no matter what anyone says.". To that end, SQLAlchemy 1.4 now includes complete support for asyncio …
1457
1458
PostgreSQL's Hash Indexes Are Now Cool
Since I just committed the last pending patch to improve hash indexes to PostgreSQL 11, and since most of the improvements to hash indexes w...
1459
Language models for text classification: From bag-of-words to Jev
A Visual Guide to RNNs, CNNs, Transformers, and Calibration, with Hands-On Experiments on Accuracy and Efficiency
1460
Zillow, Prophet, time series, and prices
So I made a mildly controversial tweet. Lots of people enjoyed it, but the LinkedIn-adjacent section of data science Twitter is not happy about it. I want to provide as much context for it as I can…
1461
Kafka vs. Redpanda performance – do the claims add up?
Apache Kafka has been the most popular open source event streaming system for many years and it continues to grow in popularity. Within the wider ecosystem there are other open source and source available competitors to Kafka such as Apache Pulsar, NATS Streaming, Redis Streams, RabbitMQ and more re
1462
Bayesians moving from defense to offense
Erik van Zwet, Sander Greenland, Guido Imbens, Simon Schwab, Steve Goodman, and I write :
1463
One million queries per second with MySQL
Discover how PlanetScale handles one million queries per second (QPS) with horizontal sharding in MySQL
1464
Understanding UUIDs, ULIDs and string representations
What UUIDs and ULIDs are under the hood, and how to encode and use them.
1465
1466
A Tale of Query Optimization
Last December, I got an interesting bug report from the VWO support team. It seemed like the loading time of a particular analytics report was ridiculously slow for a big Enterprise customer. Since I am part of the Data platform, a flag was immediately raised and I got involved in debugging the issue.
1467
DuckDB-Wasm: Efficient analytical SQL in the browser
DuckDB-Wasm is an in-process analytical SQL database for the browser. It is powered by WebAssembly, speaks Arrow fluently, reads Parquet, CSV, and JSON files backed by Filesystem APIs or HTTP requests, and has been tested with Chrome, Firefox, Safari, and Node.js. You can try it at shell.duckdb.org or on Observable.
1468
PostgreSQL 11 and Just in Time Compilation of Queries
PostgreSQL 11 includes a new component in the execution engine: a JIT expression compiler. A benchmark comparison shows up to 29.31% speed improvements in PostgreSQL 11 using the JIT expression compiler, executing TPC-H Q1 at scale factor 10 in 20.5s instead of 29s when using PostgreSQL 10.
1469
TimescaleDB 2.0 released, now distributed multi-node
Fully managed PostgreSQL from the creators of TimescaleDB. 99.9% uptime SLA, 10,000+ IOPS, columnar compression up to 95%, and built-in search. Try it free.
1470
Optimizing Ruby's JSON, Part 4
In the previous post, we established that as long as ruby/json wasn’t competitive on micro-benchmarks, public perception wouldn’t change. Since what made ruby/json appear so bad on micro-benchmarks was its setup cost, we had to find ways to reduce it further.