Heroes of Deep Learning: Andrej Karpathy

Andrej Karpathy Introduction: Wiki page

Day in the Life of Andrej Karpathy

• night owl; sleeps at 3 am
• build some momentum; load your brain with the problem
• have coffee, consume news from twitter, hackernews, WSJ
• 18-6 intermittent fasting; eat from 12 to 6; prefer plant-based

Andrej Karpathy: Best IDE for programming

• one large 27-inch screen, and laptop on the side
• favorite way: run vscode on mac, but have remote folder through ssh; files that you’re working on are somewhere else
• favorite ide: vscode; github copilot integration

Let’s build the GPT Tokenizer

• Language Models are Unsupervised Multitask Learners
• Llama2:OpenFoundationandFine-TunedChatModels