Brief explanation of swin transformer paper.
Paper link: [ Ссылка ]
Table of Content:
00:00 Intro
00:13 Patch Embedding
02:56 Swin transformer block
03:57 W-MSA
05:14 SW-MSA
08:56 Masked MSA implementation
14:58 Patch Merging
16:12 stages
18:28 Image classification result
19:12 Relative position bias
Icon made by Freepik from flaticon.com
![](https://i.ytimg.com/vi/qUSPbHE3OeU/maxresdefault.jpg)