Learning Nonregular Languages: A Comparison of Simple Recurrent Networks and {LSTM}

J. Schmidhuber
F.A. Gers
Neural Computation, 14 (2002), pp. 2039-2041

Abstract

In response to Rodriguez' recent article (Rodriguez 2001) we compare the performance of simple recurrent nets and {\em ``Long Short-Term Memory''} (LSTM) recurrent nets on context-free and context-sensitive languages.