Vision Transformer Attention from “Emerging Properties in Self-Supervised Vision Transformers” paper explained as fast as possible.

An episode of AIQuickie with PyTorch1.x code.

▬ Contents of this video ▬▬▬▬▬▬▬▬▬▬ 👀

0:00 - Intro
0:30 - Theory part
4:39 - Code part

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

Link to the Notebook: [ Ссылка ]

Link to the paper: [ Ссылка ]

свернуть