Andrej Karpathy's 630-line Python script ran 50 experiments overnight without any human input

Andrej Karpathy's 630-line Python script ran 50 experiments overnight without any human input

On the night of March 7, Andrej Karpathy pushed a 630-line Python script to GitHub and went to sleep. By morning, his agent had run 50 experiments, discovered a better learning rate, and committed the proof to git without a single human instruction in between. The story making the rounds is about autonomous machine learning (ML) research. But the more important story is about the design pattern underneath it, and the 40-line Markdown file that m…