Ankit Singh Rawat

Ankit Singh Rawat

Authored Publications
Sort By
  • Title
  • Title, descending
  • Year
  • Year, descending
    Google
Understanding Self-Attention through Prompt-Conditioned Markov Chains
Muhammed Emrullah Ildiz
Yixiao Huang
Yingcong Li
Samet Oymak
International Conference on Machine Learning (ICML) (2024)
Dual-Encoders for Extreme Multi-label Classification
Nilesh Gupta
Devvrit Khatri
Inderjit Dhillon
International Conference on Learning Representations (ICLR) (2024)
Think before you speak: Training language models with pause tokens
Sachin Goyal
Ziwei Ji
Aditya Menon
Vaishnavh Nagarajan
International Conference on Learning Representations (ICLR) (2024)
A Statistical Framework for Data-dependent Retrieval-Augmented Models
Manzil Zaheer
International Conference on Machine Learning (ICML) (2024)
Mechanics of Next Token Prediction with Transformers
Yingcong Li
Yixiao Huang
Muhammed Emrullah Ildiz
Samet Oymak
International Conference on Artificial Intelligence and Statistics (AISTATS) (2024)
USTAD: Unified Single-model Training Achieving Diverse Scores for Information Retrieval
Seungyeon Kim
Manzil Zaheer
Veeru Sadhanala
Sadeep Jayasumana
Aditya Menon
Rob Fergus
International Conference on Machine Learning (ICML) (2024)
DistillSpec: Improving speculative decoding via knowledge distillation
Yongchao Zhou
Kaifeng Lyu
Aditya Menon
Afshin Rostamizadeh
Jean-François Kagy
Rishabh Agarwal
International Conference on Learning Representations (ICLR) (2024)
Towards Understanding the Role of Attention in Prompt-tuning
Samet Oymak
Mahdi Soltanolkotabi
Christos Thrampoulidis
International Conference on Machine Learning (ICML) (2023)
Teacher Guided Training: An Efficient Framework for Knowledge Transfer
Manzil Zaheer
Seungyeon Kim
Chong You
Himanshu Jain
Rob Fergus
International Conference on Learning Representations (ICLR) (2023)