Jump to Content
Ebrahim Songhori

Ebrahim Songhori

My research interests include machine learning, computer system design, and digital privacy.
Authored Publications
Google Publications
Other Publications
Sort By
  • Title
  • Title, descending
  • Year
  • Year, descending
    Efficient Imitation Learning with Local Trajectory Optimization
    Jialin Song
    Anna Darling Goldie
    Navdeep Jaitly
    Azalia Mirhoseini
    ICML 2020 Workshop on Inductive Biases, Invariances and Generalization in RL (2020)
    Preview abstract Imitation learning is a powerful approach to optimize sequential decision making policies from demonstrations. Most strategies in imitation learning rely on per-step supervision from pre-collected demonstrations as in behavioral cloning or from interactive expert policy queries such as DAgger. In this work, we present a unified view of behavioral cloning and DAgger through the lens of local trajectory optimization, which offers a means of interpolating between them. We provide theoretical justification for the proposed local trajectory optimization algorithm and show empirically that our method, POLISH (Policy Optimization by Local Improvement through Search), is much faster than methods that plan globally, speeding up training by a factor of up to 14 in wall clock time. Furthermore, the resulting policy outperforms strong baselines in both reinforcement learning and imitation learning. View details
    No Results Found