Learning Nonregular Languages: A Comparison of Simple Recurrent Networks and {LSTM}
Abstract
In response to Rodriguez' recent article (Rodriguez 2001) we compare the performance of simple recurrent nets and {\em ``Long Short-Term Memory''} (LSTM) recurrent nets on context-free and context-sensitive languages.