Autoregressive Models in Deep Learning — A Brief Survey

My current project involves working with deep autoregressive models: a class of remarkable neural networks that aren’t usually seen on a first pass through deep learning. These notes are a quick write-up of my reading and research: I assume basic familiarity with deep learning, and aim to highlight general trends and similarities across autoregressive models, instead of commenting on individual architectures. tldr: Deep autoregressive models are sequence models, yet feed-forward (i.e. not recurr...

Submit