Back to basics: Writing an application using Go and PostgreSQL
Learn how to use PostgreSQL with the Go programming language using the pgx driver and toolkit in a very productive manner. Furthermore, with the provided source code, you'll be able to learn how to write efficient and sound unit and integration tests, ready to be run locally or on a Continuous Integration environment…
Querying Parquet with Precision Using DuckDB
DuckDB, a free and open source analytical data management system, can run SQL queries directly on Parquet files and automatically take advantage of the advanced features of the Parquet format.
Fastest table sort in the West – Redesigning DuckDB's sort
DuckDB, a free and open-source analytical data management system, has a new highly efficient parallel sorting implementation that can sort much more data than fits in main memory.
How ClickHouse saved our data (2020)
The Mux Data platform is used by some of the biggest broadcasters to monitor the video streaming experience of their end users. Think of it like Google Analytics or New Relic for video playback. It's a...
Scaling Relational SQL Databases (2020)
A list of things that we can do when we need to scale a SQL database.
Why start a new database conference?
Somehow I am organizing a conference called Have you tried rubbing a database on it?
Filecoin, StorJ and the problem with decentralized storage (2019)
Blockchains for everything Decentralized storage services such as Filecoin and StorJ seek to disrupt the data-storage industry, using blockchain tokens to create a competitive marketplace that can …
Diving Deep on S3 Consistency
A deep dive on why we changed Amazon S3's consistency model
Joining CSV and JSON data with an in-memory SQLite database
The new sqlite-utils memory command can import CSV and JSON data directly into an in-memory SQLite database, combine and query it using SQL and output the results as CSV, JSON …
What’s the origin of the phrase “big data doesn’t fit in excel”?
Welcome to Yak Shaving School! As part of my MSc I'm reading a book about Data Analytics. So I've been chasing down quotes to find their origin. One paper had this popular quote in it (emphasis added): As with many rapidly emerging concepts, Big Data has been variously defined and operationalized, ranging from trite…
Nearest neighbor indexes for similarity search
Vector similarity search is a game-changer in the world of search. It allows us to efficiently search a huge range of media, from GIFs to articles — with incredible accuracy in sub-second timescales for billion+ size datasets.
Scientific notation bug in MySQL left AWS WAF vulnerable to SQL injection
We provide around-the-clock threat detection and incident response, backed by expert consulting to keep your organization secure.
Why do database columns have a character length of 191?
`varchar(191)` is such an odd number - how did we get here?
The ClickHouse Community
Slack is a new way to communicate with your team. It’s faster, better organized, and more secure than email.
PostgreSQL 15: default permissions for everyone is now restricted to db owner
PostgreSQL always allowed, by default, any user to connect to any database, and create new tables (and views, and so on) in “public" schema. The one that is created by default.
Cleaning Up Your Postgres Database
Actionable steps on how to improve your Postgres database performance.
Timescale Announces New Database Cloud
Timescale Cloud provides a balance between a familiar developer platform and a flexible database for modern applications while retaining the ease.
Let’s Talk OpenZFS Snapshots
Optimize OpenZFS snapshots. Learn which data benefits from snapshots, how long to keep them, and how to avoid performance bottlenecks.
Make Patterns Pop Out of Heatmaps with Seriation (2018)
One of the easiest ways to start visualizing data is to turn a table into a heatmap: every cell gets a colour, the higher the number the brighter the colour. Unfortunately, this is often a fairly unrewarding exercise, yielding graphics that look like plaid or tartan fabric. Part of the problem is that the rows and…
Project Jupyter Celebrates 20 Years, Fernando Pérez Reflects on How It Started
Twenty years ago, UC Berkeley Associate Statistics Professor Fernando Pérez started one of the foundational tools for analyzing large amounts of data in a transparent and collaborative way. We spoke with Pérez about why he started this project, what challenges he’s faced and what to expect from him and Project Jupyter…
Analyzing and breaking an externally encrypted HDD
Analyzing and breaking external encrypted HDD has been a “hobby” of mine for quite some time. With my colleagues Joffrey Czarny and Julien Lenoir we looked at several models in the past :
Getting Started with QGIS, PostgreSQL and PostGIS
Visualizing spatial data is an important task. This tutorial helps you with getting started with visualizing OSM data with PostGIS and QGIS.
R, OpenMP, MKL, Disaster
The answer should be something close to ALPHA , i.e. 0.01 . What R was printing out was weird numbers like 1e-10 .
ChaosDB Explained: Azure's Cosmos DB Vulnerability Walkthrough
This is the full story of the Azure ChaosDB Vulnerability that was discovered and disclosed by the Wiz Research Team, where we were able to gain complete unrestricted access to the databases of several thousand Microsoft Azure customers.
Postgres text search: balancing query time and relevancy
How do you balance query time and relevance with Postgres text search? Stephen Gutekanst, an engineer working on Sourcegraph's API docs feature, shares tips for stirring code analysis with search indexing.