Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
Surviving Data Science at the Speed of Hype
john-foreman.com is your first and best source for information about john foreman. Here you will also find topics relating to issues of general interest. We hope you find what you are looking for!
Reads Causing Writes in Postgres
It is good practice to regularly inspect the statements running in the hot path of your Postgres instance. One way to do this is to examine the pg_stat_statements view , which shows various statistics about the SQL statements executed by the Postgres server.
American solar farms
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
Python: Just Write SQL
I have been writing a lot more Go this past year. For those not familiar, Go favours a non-ORM, non-query-builder approach to interacting with databases. This comes naturally due to the sql package : A common interface to be used alongside database drivers. It’s very common to see actual SQL in Go, even in large…
The AWS and MongoDB Infrastructure of Parse
This is the extended form of a comment that got some interest on Hackernews. After a grace period of one year, Parse is now offline. This…
I analyzed Stack Overflow for secrets
I analyzed stackoverflow for secrets and leaks.
Introducing schema.org: Search engines come together for a richer web
Insights from Googlers into our products, technology, and the Google culture
Why DuckDB 2.0 is faster
DuckDB 2.0 alpha vs 1.5.5 on one laptop: recursive CTEs up to 90x, VARIANT 6x faster than JSON text, async I/O 2.4x on S3. What changes, and how to model data to get the speedup. | Reading time: 15 min read
Sensible SQLite Defaults
SQLite is cool now. DHH uses it, Laravel defaults to it. Here is a list of _sensible defaults_ when using sqlite.
Looking Forward to Postgres 19: Query Hints
Postgres 19 brings plan advice: the query hints the Postgres community held off on for 15 years. Shaun Thomas covers the 15-year debate, pg_plan_advice, pg_stash_advice, and how to use them.
Multi-database support in DuckDB
DuckDB can attach MySQL, Postgres, and SQLite databases in addition to databases stored in its own format. This allows data to be read into DuckDB and moved between these systems in a convenient manner.
CRDTs Turned Inside Out
🔰If CRDTs are new to you, here are some introductory links. - An interactive intro to CRDTs [https://jakelazaroff.com/words/an-interactive-intro-to-crdts/] - An introduction to state-based CRDTs [https://www.bartoszsypytkowski.com/the-state-of-a-state-based-crdts/] - CRDTs for non-academics…
Reducing the Performance Gap of Intel's MKL on AMD Threadripper
In this post I'm going to show you a simple way to significantly speedup Python numpy compute performance on AMD CPU's when using Anaconda Python.
Supabase is acquiring Turso
Supabase is acquiring Turso to build the database infrastructure for agentic AI
Turso SQLite Offline Sync Public Beta
Turso Offline Sync is now in public beta. Write to local SQLite databases offline at file speed, then sync push and pull with Turso Cloud when reconnected.
GraphQL is now available on Supabase
GraphQL support is now in general availability on the Supabase platform via our open source PostgreSQL extension, pg_graphql.
Traffic Prediction with Advanced Graph Neural Networks
By partnering with Google, DeepMind is able to bring the benefits of AI to billions of people all over the world. From reuniting a speech-impaired user with his original voice, to helping users discover personalised apps, we can apply breakthrough research to immediate real-world problems at a Google scale. Today…
PostgreSQL EXPLAIN Output Explained
UPDATED July 2023: How to use EXPLAIN ANALYZE in PostgreSQL, learn tools to visualize the output. See query execution time and row count.
Data-at-Rest Encryption in DuckDB
DuckDB 1.4 ships database encryption capabilities. In this blog post, we dive into the implementation details of the encryption, show how to use it, and demonstrate its performance implications.
Literate SQL
Complex queries are hard to read. Literate SQL is about writing queries that are as easy to read as a good novel.
FreeNAS and TrueNAS Are Unifying
FreeNAS and TrueNAS have been separate-but-related members of the #1 Open Source storage software family since 2012.
Useful Unix commands for data science
The command line tools that ship with any Unix-like system are extremely handy for many data tasks. Here are some of the ones that I've found most useful.