TIMESTAMPS:
0:00 Introduction
0:22 Attention Mechanism Overview
1:20 Self-Attention Introduction
3:02 CNN Limitations
4:09 Using Attention in CNNs
6:30 Attention Integration in CNN
9:06 Learnable Scale Parameter
10:14 Attention Implementation
12:52 Performance Comparison
14:10 Attention Map Visualization
14:29 Conclusion
In this video I show how we can add Self-Attention to a CNN in order to improve the performance of our classifier!
Donations
www.buymeacoffee.com/lukeditria
The corresponding code is available here!
github.com/LukeDitria/pytorch...
Discord Server:
/ discord
Негізгі бет Ғылым және технология Adding Self-Attention to a Convolutional Neural Network! : PyTorch Deep Learning Tutorial Section 13
Пікірлер: 9