571
Every database will become a vector database sooner or later
Why every database will become a vector database, sooner or later
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
572
Things that surprised me while running SQLite in production
I've been using SQLite in several production projects for six months, and I've encountered some surprising aspects.
573
JSON and Virtual Columns in SQLite
Faster JSON handling in a relational database.
574
Guide to Making 3D Maps with Satellite Imagery in R
E ver since I released rayshader to the public, there’s been one question that comes up time and time again: “How do I use rayshader to overlay satellite imagery onto a 3D surface?” And I can see why: 3D maps with real satellite images are super cool, and there are few detailed tutorials out there on how it’s done in…
575
Call me maybe: RabbitMQ
RabbitMQ is a distributed message queue, and is probably the most popular open-source implementation of the AMQP messaging protocol. It supports a wealth of durability, routing, and fanout strategies, and combines excellent documentation with well-designed protocol extensions. I’d like to set all these wonderful…
576
Postgres UUIDv7 and per-back end monotonicity
How Postgres’ v7 UUIDs are made monotonic, and why that’s a great feature.
577
578
Track HN: Survival Rate of Show HN Stories
Spoiler alert: many of the good projects didn’t survive
579
Practical Guide to SQL Transaction Isolation
You may have seen isolation levels in the documentation for your database, felt mildly uneasy, and went on with life. Few day-to-day examples of using transactions really mention isolation. Most use the database’s default isolation level and hope for the best. It’s a fundamental topic to understand however and you’ll…
580
Why Databases Are Not for Docker Containers
If we attentively look at IT industry at 2017, all of us will see “containers” and “Docker” as the top buzzwords ever. We started to package developed software in Docker containers in every field. …
581
PgBouncer is useful, important, and fraught with peril
Updated 2024-09-17 to reflect updated PgBouncer support for protocol-level prepared statements 🐘 To start, I want to say that I’m appreciative that PgBouncer exists and the work its open source maintainers put into it. I also love working with PostgreSQL, and I’m thankful for the incredible amount of work and…
582
Image Completion with Deep Learning in TensorFlow
Content-aware fill is a powerful tool designers and photographers use to fill in unwanted or missing parts of images. Image completion and inpainting are closely related technologies used to fill in missing or corrupted parts of images. There are many ways to do content-aware fill, image completion, and inpainting. In…
583
Probabilistic Data Structures For Web Analytics And Data Mining
Statistical analysis and mining of huge multi-terabyte data sets is a common task nowadays, especially in the areas like web analytics and Internet advertising. Analysis of such large data sets oft…
584
Why isn't differential dataflow more popular?
Differential dataflow is a library that lets you write simple dataflow programs and a) then runs them in parallel and b) efficiently updates the outputs when new inputs arrive. Compared to competition like spark and kafka streams , it can handle more complex computations and provides dramatically better throughput and…
585
Anna: A Fast, Scalable, Flexibly Consistent Key-Value Store
There’s fast and there’s fast. This post is about Anna*, a key/value database design from our team at Berkeley that’s got phenomenal speed and buttery smooth scaling, with an unpr…
586
All of the vehicle license plates available in America
States now offer a vast menu of personalized plate options for a dizzying array of organizations, professions, sports teams, causes and other groups.
587
How about trailing commas in SQL?
Anecdotally, this might be the most requested feature in SQL: Allow some trailing commas.
588
Now that people are considering NOSQL will more people consider no-DB
A memory image replaces database interactions with in-memory data using event sourcing to record persistent changes
589
Data centers contain 90% crap data
We need to talk about the data. Crap data. We’re destroying our environment to create and store trillions of blurred images, half-baked videos, rip-off AI ‘songs’, rip-off AI animations, videos and images, emails with mega attachments, never-to-be-watched-again presentations, never-to-be-read-again reports, files and…
590
Replacing Elasticsearch with Rust and SQLite (2017)
Caveat: Elasticsearch is a multi-purpose, distributed, battle-tested, schema-free, log and document storage engine. We’ll be replacing it with a single-purpose, relational schema, me-tested, and custom nginx access log storage engine. Knowing that, let’s begin. Find this project on Github After building my home…
591
592
Thoughts on Time-series Databases
Preetam "recently" blogged about catena , a time-series metric store. There was another blog post about benchmarking boltdb by a Fog Creek engineer, also looking to write a time series database. This is something of a pattern in the Go community, which already boasts seriesly , InfluxDB , and prometheus ; there are…
593
Roaring bitmaps: what they are and how they work
A detailed primer on Roaring bitmaps explaining what they are, how they're different from traditional bitmaps, and how they work internally.
594
NoSQL Data Modeling Techniques
NoSQL databases are often compared by various non-functional criteria, such as scalability, performance, and consistency. This aspect of NoSQL is well-studied both in practice and theory because sp…
595
596
Datasette’s new JSON write API: The first alpha of Datasette 1.0
This week I published the first alpha release of Datasette 1.0, with a significant new feature: Datasette core now includes a JSON API for creating and dropping tables and inserting, …
597
Visualizing How Developers Rate Their Own Programming Skills
As it turns out, there is no correlation between programming ability and the frequency of Stack Overflow visits.
598
Causal inference as a blind spot of data scientists
Throughout much of the 20th century, frequentist statistics dominated the field of statistics and scientific research. Frequentist statistics primarily focus on the analysis of data in terms of probabilities and observed frequencies. Causal inference, on the other hand, involves making inferences about…
599
600
How I Built Zig-SQLite
Article explaining how to leverage Zig's compile time metaprogramming to build a SQLite wrapper that can type check SQL queries