1
Building the heap: racking 30 petabytes of hard drives for pretraining
We built the heap, a 30 petabyte data storage cluster in downtown San Francisco, and spent under $500,000.
An aligned AGI lab.
Visit si.inc → On Hacker News Nov 2024 – Feb 2026
AI & Machine Learning 3Software Engineering 1Open Source 1Infrastructure & DevOps 1
We built the heap, a 30 petabyte data storage cluster in downtown San Francisco, and spent under $500,000.
We trained a model on our 11-million-hour video dataset. Our model can explore complex websites, complete multi-action CAD modeling sequences, and drive a car in the real world, all at 30 FPS.