Experiments on two machine translation tasks show these models to be superior in quality while being more parallelizable and requiring significantly less time to train. Ashish Vaswani, et al., "Attention Is All You Need" https://arxiv.org/…

We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely. Ashish Vaswani, et al., "Attention Is All You Need" https://arxiv.org/abs/1706.03762…