Alan D. Thompson

When Microsoft writesa paper on AI,they go to Alan. LifeArchitect.ai is the 'gold standard' for understanding, visualizing, and realizing the capabilities of post-2020 AI. With over 100 papers and articles, 300 videos, and regular editions of The Memo, LifeArchitect.ai provides insights to all major AI labs…

Popular posts: 1
Total points: 185
HN comments: 150
Rank: #13,518 personal

Visit lifearchitect.ai → RSS feedOn Hacker News Apr 2023 – Apr 2023

Databases & Data 1 AI & Machine Learning 1

Most points Most discussed Most cited Newest

33TB of text data for a 1T-parameter model

2023185 points150 comments AI & Machine Learning details

Important: This page summarizes data scaling only, using tokens to parameters as a ratio, and as derived from large language models like GPT-3, Chinchilla, and beyond, linked to the Compute-Optimal scaling laws like Kaplan and Hoffmann/Chinchilla. Please note that compute scaling laws are outside the scope of my…