Discrete Autoencoders for Sequence Models

The contributions of this paper are: * A discretization technique that works well without any extra losses or parameters to tune. * A way to measure performance of autoencoders for sequence models (and baselines). * An improved way to sample from sequence models (trained with an autoencoder part).

• Machine Intelligence