Канал: Andrej Karpathy

Let's reproduce GPT-2 (124M)

Let's reproduce GPT-2 (124M)

Let's build the GPT Tokenizer

Let's build the GPT Tokenizer

[1hr Talk] Intro to Large Language Models

[1hr Talk] Intro to Large Language Models

Let's build GPT: from scratch, in code, spelled out.

Let's build GPT: from scratch, in code, spelled out.

Building makemore Part 5: Building a WaveNet

Building makemore Part 5: Building a WaveNet

Building makemore Part 4: Becoming a Backprop Ninja

Building makemore Part 4: Becoming a Backprop Ninja

Building makemore Part 3: Activations & Gradients, BatchNorm

Building makemore Part 3: Activations & Gradients, BatchNorm

Building makemore Part 2: MLP

Building makemore Part 2: MLP

The spelled-out intro to language modeling: building makemore

The spelled-out intro to language modeling: building makemore

Stable diffusion dreams of psychedelic faces

Stable diffusion dreams of psychedelic faces

Stable diffusion dreams of steampunk brains

Stable diffusion dreams of steampunk brains

Stable diffusion dreams of tattoos

Stable diffusion dreams of tattoos

The spelled-out intro to neural networks and backpropagation: building micrograd

The spelled-out intro to neural networks and backpropagation: building micrograd

Stable diffusion dreams of "blueberry spaghetti" for one night

Stable diffusion dreams of "blueberry spaghetti" for one night

Stable diffusion dreams of steam punk neural networks

Stable diffusion dreams of steam punk neural networks