This list is constantly growing. Not seeing a database or file type you need? Open an issue .
Visit datastation.multiprocess.io → On Hacker News Jan 2022 – Jun 2022
Software Engineering 3Systems & Performance 2Databases & Data 2Tools & Productivity 1Open Source 1Life, Learning & Writing 1
dsq is a commandline tool for running SQL queries against all the data file types that DataStation supports (JSON, CSV, Parquet, Excel, etc.). Here is a simple example:
Most people use the mattn/go-sqlite3 package to interact with SQLite in Go. This package uses cgo and bundles the SQLite C amalgamation files with the Go source.
I was looking into some of octosql 's benchmarks the other day and noticed a large chunk of time in DataStation / dsq is spent in encoding JSON objects. JSON is an intermediate format in DataStation and it's pretty inefficient. But the reason it's used is because almost every scripting language supported by…