When it comes to machine translation, we often focus on accuracy, but just as important is speed! In this video, I explain some techniques that achieve blazing-fast translation without sacrificing accuracy.
Efficient NLP: efficientnlp.com
Building affordable and accurate language APIs
Sources mentioned in this video:
A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond by Xiao et al. (2022)
arxiv.org/abs/2204.09269
Mask-Predict: Parallel Decoding of Conditional Masked Language Models by Ghazvininejad et al. (2019)
arxiv.org/abs/1904.09324
Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation by Kasai et al. (2021)
arxiv.org/abs/2006.10369
Recent Advances in Google Translate
ai.googleblog.com/2020/06/rec...
Негізгі бет Non-Autoregressive and Shallow Decoding: Speeding up Translation
Пікірлер: 2