Topics /
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
Today, it’s my great pleasure to announce the first public release of Hardwood, a new parser for the Apache Parquet file format, optimized for minimal dependencies and great performance. Hardwood is …
(Editor's note: This post is cross-posted on Fauna's blog, where Daniel Abadi serves as an adviser . Fauna is is a serverless, cloud data...
Parallel sequential scan is the first parallel access method in PostgreSQL and is introduced in version 9.6. The committer of this featu...
Just over a year ago Google made all the open source code on GitHub available for querying within BigQuery and as if that wasn’t enough you can run a terabyte of queries each month for free!
When my co-founders and I first started on our startup a little over a year ago, we asked other startups about what to database they were using. Nine out of ten people all had the same response: “Just go with Mongo.”
Some gut-based judgements on the effectiveness of data.
AutoGPT decided to drop the support for vector databases: Pinecone, Milvus, Redis, Weaviate - all gone. What has happened to the original idea of efficiently storing agent's memories?
PostgreSQL 9.6 was released a few days ago and it’s another huge milestone for the PostgreSQL community ! The release notes are way too long, so I’ve decided to pick up 6 big improvements that may change the way you will use PostgreSQL.
Things a programmer coming from another language needs to know about R, especially those things that might be most surprising
Safely leverage PostgreSQL's asynchronous commit for significant performance gains
(This post is coauthored by Alexander Thomson and Daniel Abadi ) It is a poorly kept secret that NoSQL is not really about eliminating SQL ...
At my company we use a small SQLite database. We define the schema in a single file with SQL CREATE TABLE statements. If we add tables, columns, or indexes, our application will create them automatically the next time it starts up.
What in the world is Explorative Modeling?
In my work I’ve developed a mental framework related to data modeling, which has helped greatly both when coming up with a model and when making decisions down the road about how to use that model. Here I will establish three different categories of data in software: Constants, State, and Cached Values. By “data” I…
My previous Let’s Make a Map tutorial describes how to make a basic map with D3 and TopoJSON ; now it’s time to cover thematic mapping in the form of a proportional symbol map. The simplest symbol is a circle, or bubble , whose area is proportional to the associated data. In this tutorial, we’ll make a bubble map of…
This is another experiment in visualizing 24-hour cyclical data. My last post explored a method of linear representation (the Double Time Bar Chart). Linear representations have problems when it comes to showing the cyclical nature of time data (ie there is no start or end of a 24 hour cycle). Inspiration When trying…
The virtual machine? Yep, but not the Java Virtual Machine.
How data businesses start, and how they keep going, and growing, and growing.
I’ve been at OpenAI for almost a year now. In that time, I’ve trained a lot of generative models. More than anyone really has any right to train. As I’ve spent these hours observing the effects of tweaking various model configurations and h
A misconception that I held for a really long time was that systems that use SQL (Structured Query Language) are by definition relational databases, and systems that don’t (e.g., MongoDB, Cassandra) are non-relational. It’s easy to understand whether a database uses SQL or not, but what does it mean when we say a…
When a +10% isn’t really a +10% OK, this is an infuriating startup experience: You ship an experiment that’s +10% in your conversion funnel. Then your revenue/installs/whatever goes up by +10% right?
Optimize your Django SQLite configuration for production.
I attended the SIAM PP 2014 conference this week, because I'm developing an interest in MPI-style parallel algorithms (also, it was close b...
Recently, a Facebook dataset was released consisting of the complete set of users from the Facebook networks at 100 American institutions, and all of the in-network “friendship” links between those…
As a researcher/engineer (really, an algorithm developer) in the general area of audio and speech processing, I've always run into the same difficulty at all the companies I've worked at: How to quickly prototype and develop algorithms, and subsequently turn them into efficient code that can be deployed to customers.
