Let's build GPT: from scratch, in code, spelled out.
1:56:20
YouTubeAndrej Karpathy
Let's build GPT: from scratch, in code, spelled out.
We build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3. We talk about connections to ChatGPT, which has taken the world by storm. We watch GitHub Copilot, itself a GPT, help us write a GPT (meta :D!) . I recommend people watch the earlier makemore videos to get ...
6.7M viewsJan 17, 2023
Andrej Karpathy: Most Viewed Videos
[1hr Talk] Intro to Large Language Models
59:48
[1hr Talk] Intro to Large Language Models
YouTubeAndrej Karpathy
3.3M viewsNov 23, 2023
The spelled-out intro to neural networks and backpropagation: building micrograd
2:25:52
The spelled-out intro to neural networks and backpropagation: building micrograd
YouTubeAndrej Karpathy
3M viewsAug 16, 2022
How I use LLMs
2:11:12
How I use LLMs
YouTubeAndrej Karpathy
2.1M views9 months ago
Shorts
How Andrej Karpathy Sees the Next Decade of AI
1:32
How Andrej Karpathy Sees the Next Decade of AI
The Tesla Space
Let's reproduce GPT-2 (124M)
4:01:26
956.4K views
Let's reproduce GPT-2 (124M)
Andrej Karpathy
Top videos
Deep Dive into LLMs like ChatGPT
3:31:24
Deep Dive into LLMs like ChatGPT
YouTubeAndrej Karpathy
4.2M views10 months ago
Andrej Karpathy — “We’re summoning ghosts, not building animals”
2:26:08
Andrej Karpathy — “We’re summoning ghosts, not building animals”
YouTubeDwarkesh Patel
1M views2 months ago
Andrej Karpathy: Software Is Changing (Again)
39:32
Andrej Karpathy: Software Is Changing (Again)
YouTubeY Combinator
2.2M views6 months ago
Latest From Andrej Karpathy
Let's build the GPT Tokenizer
2:13:35
Let's build the GPT Tokenizer
YouTubeAndrej Karpathy
975.1K viewsFeb 20, 2024
Building makemore Part 5: Building a WaveNet
56:21
Building makemore Part 5: Building a WaveNet
YouTubeAndrej Karpathy
242.9K viewsNov 21, 2022
Building makemore Part 4: Becoming a Backprop Ninja
1:55:24
Building makemore Part 4: Becoming a Backprop Ninja
YouTubeAndrej Karpathy
291.1K viewsOct 11, 2022