Topics /

Databases & Data

The most popular blog posts about databases & data on Hacker News. 4,224 posts.

Any year
1835

33TB of text data for a 1T-parameter model

Important: This page summarizes data scaling only, using tokens to parameters as a ratio, and as derived from large language models like GPT-3, Chinchilla, and beyond, linked to the Compute-Optimal scaling laws like Kaplan and Hoffmann/Chinchilla. Please note that compute scaling laws are outside the scope of my…