Books Aren’t Data For Pretraining, But Prompts For Synthetic Data Generation: Andrej Karpathy
In a characteristically insightful observation that’s reshaping how AI researchers think about training data, Andrej Karpathy just posted on X: “Most people misunderstand…