1681
Historical weather data API for machine learning, free for non-commercial
Get weather data for the past days, weeks or months
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
1682
Introduction to Window Functions in SQL
It is interesting that many people working with data have no clue about window functions in SQL. During a long period of time instead of using window functions, I preferred coding in Python and panda…
1683
1684
1685
1686
1687
You can't just assume UTF-8
How to infer character encodings with statistics
1688
1689
Why LLMs Can't Write Q/Kdb+: Writing Code Right-to-Left
In my previous post I showed how LLMs struggle with coding in q/kdb+; having immediate feedback loops using the q-MCP server does help a…
1690
Debunking the Myth of "Anonymous" Data
Today, almost everything about our lives is digitally recorded and stored somewhere. Each credit card purchase, personal medical diagnosis, and preference about music and books is recorded and then used to predict what we like and dislike, and—ultimately—who we are. This often happens without our...
1691
1692
LlamaCloud and LlamaParse
LlamaIndex introduces LlamaParse and LlamaParse for production-grade RAG. Unlock complex PDF data to improve LLM response quality. Discover how today.
1693
1694
Beware the data science pin factory: The power of the data science generalist
This post discusses the benefits of full-stack data science generalists over narrow functional specialists. The later will help you execute and bring process...
1695
Rails on SQLite: new ways to cause outages
This post was originally given as a talk for Friendly.rb and Kaigi on Rails. The slides are also available. Between Litestack and the Rails 8 trifecta of Solid Cable, Solid Cache, and Solid Queue, it’s easier than ever to spin up a Rails app that doesn’t need a database service, or a redis service, or a file storage…
1696
RavenDB 6.0.2 (A Jepsen Report)
RavenDB is a distributed document database which repeatedly advertises its support for ACID transactions. 1 It’s intended for OLTP workloads, and offers a variety of ETL paths for exporting data to other systems. Its transactional API revolves around a session handle, which “represents a single business transaction on…
1697
1698
A Gentle Visual Intro to Data Analysis in Python Using Pandas
Discussions: Hacker News (195 points, 51 comments), Reddit r/Python (140 points, 18 comments) If you’re planning to learn data analysis, machine learning, or data science tools in python, you’re most likely going to be using the wonderful pandas library. Pandas is an open source library for data manipulation and…
1699
Jepsen: Redis-Raft 1b3fbf6
Redis is a fast single-threaded data structure server, commonly used as a cache, scratchpad, queue, or coordination mechanism between distributed applications. It offers operations over a broad array of datatypes , including binary blobs, lists, sets, sorted sets, maps, geohashes, counters, channels, streams, and…
1700
Notes on the SQLite DuckDB Paper
SQLite: Past, Present, and Future is a newly published paper authored by Kevin P. Gaffney, Martin Prammer and Jignesh M. Patel from the University of Wisconsin-Madison and D. Richard Hipp, …
1701
1702
Oracle’s Cloud Licensing Change
Over the last couple of years I've been doing talks about running Oracle databases in the cloud. In both my talks and articles I refer to the Licensing Oracle Software in the Cloud Computing Environment document. This morning I was reading a post on a mailing list and someone mentioned the document had been updated on…
1703
PostgreSQL and the OOM killer: Why we use strict memory overcommit
In this blog post, we will explain how strict memory overcommit protects your database from catastrophic OOM (out of memory) kills. We will also share how a one character kernel bug forced us to temporarily disable this setting. Finally, we will explain our heuristic for determining the right memory overcommit limit…
1704
Pandas Should Go Extinct
Pandas has taken us a long way, but it's time for a new bear
1705
Ballista: Distributed Compute with Rust, Apache Arrow, and Kubernetes
Software engineer specializing in query engines and distributed systems
1706
1707
Why I Enjoy PostgreSQL – Infrastructure Engineer's Perspective
Why I enjoy PostgreSQL - Infrastructure Engineer's Perspective
1708
1709
Making PostgreSQL tick: New features in pg_cron
Since pg_cron 1.5, you can easily schedule jobs that run every 1-59 seconds. And pg_cron 1.6 added support for Postgres 16. This blog post walks you through the benefits of second granularity jobs with the pg_cron open source extension to Postgres.
1710
How to Make Maps Using Leaflet.js, PostGIS and Chicago Open Data
How to get started with mapping GIS data