Resources:
*LLM comparison notebook* [ Ссылка ]
*Runpod affiliate link* [ Ссылка ]
*Supervised Fine-tuning Tutorial* [ Ссылка ]
0:00 Intro
0:08 Video Overview
0:34 Mistral 7B architecture and design
3:33 Runpod setup
4:24 Mistral 7B Evaluation
6:18 Test 1: Random sequence reversal
7:24 Test 2: Code generation
9:03 Test 3: Passkey retrieval
10:26 Test 4: Fine-tuning
13:06 Evaluation Summary
14:30 EXTRA: Grouped Query Attention
15:31 EXTRA: Sliding Window Attention
![](https://s2.save4k.ru/pic/h7BWIAjzSSs/maxresdefault.jpg)