A general high-level introduction to the Transformer architecture.
This video is part of the Hugging Face course: [ Ссылка ]
Related videos:
- Encoder models: [ Ссылка ]
- Decoder models: [ Ссылка ]
- Encoder-Decoder models: [ Ссылка ]
To understand what happens inside the Transformer network on a deeper level, we recommend the following blogposts by Jay Alammar:
- The Illustrated Transformer: [ Ссылка ]
- The Illustrated GPT-2: [ Ссылка ]
- Understanding Attention: [ Ссылка ]
Furthermore, for a code-oriented perspective, we recommend taking a look at the following post:
- The Annotated Transformer, by Harvard NLP [ Ссылка ]
Have a question? Checkout the forums: [ Ссылка ]
Subscribe to our newsletter: [ Ссылка ]
