All these experimental results were obtained with new initialization or training mechanisms. Xavier Glorot and Yoshua Bengio, "Understanding the difficulty of training deep feedforward neural networks" http://proceedings.mlr.press/v9/gloro…