121
Pandas 1.0
These are the changes in pandas 1.0.0. See Release notes for a full changelog including other versions of pandas.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 2,337 posts.
122
Why SQLite Does Not Use Git
SQLite does not use the Git version control system. SQLite uses Fossil instead, which is a version control system that was specifically designed and written to support SQLite.
123
Visualize data instantly with machine learning in Google Sheets
Today we’re rolling out new features in Sheets that make it even easier for you to visualize and share your data, and find insights your teams can act on.
124
PostgreSQL 10 Beta 1 Released
The PostgreSQL Global Development Group announces today that the first beta release of PostgreSQL 10 is available for download. This …
125
The design philosophy of Great Tables
We’ve spent a lot of time thinking about tables. Tables—like plots—are crucial as a last step toward presenting information. There is surprising…
126
SQLite Is Serverless
Most SQL database engines are implemented as a separate server process. Programs that want to access the database communicate with the server using some kind of interprocess communication (typically TCP/IP) to send requests to the server and to receive back results. SQLite does not work this way. With SQLite, the…
127
Getting AI to write good SQL
Learn about text-to-SQL techniques like context building and table retrieval, LLM-as-a-judge, and LLM prompting and post-processing.
128
129
From deep to long learning?
For the last two years , a line of work in our lab has been to increase sequence length. We thought longer sequences would enable a new era of machine learning foundation models: they could learn from longer contexts, multiple media sources, complex demonstrations, and more. All data ready and waiting to be learned…
130
JPEG XL and the Pareto Front
Full details on libjxl v. 0.10 and how it affects jpeg xl lossless compression using Pareto Front for a closer analysis.
131
Vector databases are the wrong abstraction
Today’s vector databases disconnect embeddings from their source data. We should treat embeddings more like database indexes—here’s how.
132
Delivering Billions of Messages Exactly Once
The single requirement of all data pipelines is that they cannot lose data. Data can usually be delayed or re-ordered–but never dropped.
133
View Counting at Reddit
Get the latest product news, company announcements, and user insights from the official Reddit blog.
134
Advent of Code 2024 in pure SQL
A blog by and for database architects.
135
Multi-node TimescaleDB is now free
Fully managed PostgreSQL from the creators of TimescaleDB. 99.9% uptime SLA, 10,000+ IOPS, columnar compression up to 95%, and built-in search. Try it free.
136
DuckDB Internals Part 1
Walk through DuckDB's internals: how it skips serialization overhead, parses and optimizes SQL, and stores data in columnar row groups with zone maps.
137
138
SciPy builds for Python 3.12 on Windows are a minor miracle
Moving SciPy to Meson meant finding a different Fortran compiler on Windows, which was particularly tricky to pull off for conda-forge. This blog tells the story about how things looked pretty grim for the Python 3.12 release, and how things ended up working out just in the nick of time.
139
Polars 2.0
The release Python Polars 2.0, bringing the streaming engine, out-of-core and first class blazingly fast SQL support
140
Elasticsearch 1.0.0 released
Powered by Elasticsearch. Ready to deploy your data? Start free.
141
Lessons learned from sharding Postgres at Notion
With an effort to make Notion faster and more reliable for years to come — we migrated Notion’s PostgreSQL monolith into a horizontally-partitioned database fleet.
142
Postgres is a great pub/sub and job server (2019)
If you need a publish/subscribe or job server at any point in your project, try using Postgres. It'll give you lots of data integrity and performance guarantees, and it doesn't require you or your team learning any new technology.
143
144
DuckDB 2.0.0 LTS “Cinnamon Teal”
The DuckDB team is happy to announce that today we're releasing DuckDB version 2.0.0 LTS, codenamed “Cinnamon Teal” (Spatula cyanoptera). This is our biggest feature release so far, and it ships a polished version of the Quack protocol, asynchronous I/O, a first-class VARIANT type, agent mode, triggers, an extensible…
145
Zq: An easier and faster alternative to jq
Take an in-depth look at the different computational models of zq and jq.
146
Consistency LLM: converting LLMs to parallel decoders accelerates inference 3.5x
TL;DR: LLMs have been traditionally regarded as sequential decoders, decoding one token after another. In this blog, we show pretrained LLMs can be easily taught to operate as efficient parallel decoders. We introduce Consistency Large Language Models (CLLMs), a new family of parallel decoders capable of reducing…
147
Creating a Modern OCR Pipeline Using Computer Vision and Deep Learning
Dash knows your context, your team, and your work, so your team can stay organized, easily find and share knowledge, and keep projects secure, all from one place.
148
A picture got my PostgreSQL database to start mining Monero
A Deep Dive into Database Attacks [Part III]: Why Scarlett Johansson’s Picture Got My Postgres Database to Start Mining Monero
149
How to build a IP geolocation database from scratch?
Download a free IPv4 and IPv6 geolocation database (CSV, CC BY-SA 4.0), or the commercial one with full coverage in CSV and MMDB, updated at least twice a week.
150
An early look at Postgres 14: Performance and monitoring Improvements
We take a look at whats new in Postgres 14, with idle and active connection scaling, memory monitoring, query IDs and more