The purpose of this video is to dissect and learn about the Attention Is All You Need transformer model by using bare-bones PyTorch classes to forecast time series data.
Code Repo:
github.com/BrandenKeck/pytorc...
Very helpful:
github.com/oliverguhr/transfo...
github.com/ctxj/Time-Series-T...
github.com/huggingface/transf...
Attention Is All You Need:
arxiv.org/pdf/1706.03762.pdf
Негізгі бет A Very Simple Transformer Encoder for Time Series Forecasting in PyTorch
Пікірлер: 8