Vinay Venkatesh Ramasesh

Vinay Venkatesh Ramasesh

I am a research scientist working to better understand the capabilities of modern deep learning models, recently focusing on language models. I received my PhD in experimental physics from the University of California at Berkeley in 2019, where I studied superconducting quantum circuits as a potential substrate for quantum computation.
Authored Publications
Sort By
  • Title
  • Title, descending
  • Year
  • Year, descending
    Google
Exploring Length Generalization in Large Language Models
Cem Anil
Yuhuai Wu
Aitor Lewkowycz
Guy Gur-Ari
Ethan S Dyer
Behnam Neyshabur
NeurIPS Oral (2022)
Solving Quantitative Reasoning Problems with Language Models
Aitor Lewkowycz
David Martin Dohan
Ethan S Dyer
Henryk Michalewski
Cem Anil
Imanol Schlag
Theo Gutman-Solo
Yuhuai Wu
Behnam Neyshabur
Guy Gur-Ari
NeurIPS (2022)
Understanding How Encoder-Decoder Architectures Attend
Kyle Aitken
Yuan Cao
Niru Maheswaranathan
NeurIPS (2021)
The geometry of integration in text classification RNNs
Kyle Aitken
Ankush Garg
Yuan Cao
David Sussillo
Niru Maheswaranathan
ICLR (2020)
Caliban: Docker-based job manager for reproducible workflows
Sam Ritchie
Journal of Open Source Software, 5 (2020), pp. 2403