Generative Modeling with Sparse Transformers

1 · OpenAI · April 23, 2019, 3:59 p.m.
We've developed the Sparse Transformer, a deep neural network which sets new records at predicting what comes next in a sequence—whether text, images, or sound....