We show that the Transformer generalizes well to other tasks by applying it successfully to English constituency parsing both with large and limited training data. Ashish Vaswani, et al., "Attention Is All You Need" https://arxiv.org/abs/1…

On the WMT 2014 English-to-French translation task, our model establishes a new single-model state-of-the-art BLEU score of 41.8 after training for 3.5 days on eight GPUs, a small fraction of the training costs of the best models from the …