Ankit Singh Rawat
Research Areas
Authored Publications
Sort By
Google
Understanding Self-Attention through Prompt-Conditioned Markov Chains
Muhammed Emrullah Ildiz
Yixiao Huang
Yingcong Li
Samet Oymak
International Conference on Machine Learning (ICML) (2024)
USTAD: Unified Single-model Training Achieving Diverse Scores for Information Retrieval
Seungyeon Kim
Manzil Zaheer
Veeru Sadhanala
Sadeep Jayasumana
Aditya Menon
Rob Fergus
International Conference on Machine Learning (ICML) (2024)
Language Model Cascades: Token-Level Uncertainty And Beyond
Neha Gupta
Aditya Menon
International Conference on Learning Representations (2024)
DistillSpec: Improving speculative decoding via knowledge distillation
Yongchao Zhou
Kaifeng Lyu
Aditya Menon
Afshin Rostamizadeh
Jean-François Kagy
Rishabh Agarwal
International Conference on Learning Representations (ICLR) (2024)
A Statistical Framework for Data-dependent Retrieval-Augmented Models
Manzil Zaheer
International Conference on Machine Learning (ICML) (2024)
Mechanics of Next Token Prediction with Transformers
Yingcong Li
Yixiao Huang
Muhammed Emrullah Ildiz
Samet Oymak
International Conference on Artificial Intelligence and Statistics (AISTATS) (2024)
Think before you speak: Training language models with pause tokens
Sachin Goyal
Ziwei Ji
Aditya Menon
Vaishnavh Nagarajan
International Conference on Learning Representations (ICLR) (2024)
Dual-Encoders for Extreme Multi-label Classification
Nilesh Gupta
Devvrit Khatri
Inderjit Dhillon
International Conference on Learning Representations (ICLR) (2024)
On Emergence of Activation Sparsity in Trained Transformers
Zonglin Li
Chong You
Daliang Li
Ke Ye
International Conference on Learning Representations (ICLR) (2023)
Towards Understanding the Role of Attention in Prompt-tuning
Samet Oymak
Mahdi Soltanolkotabi
Christos Thrampoulidis
International Conference on Machine Learning (ICML) (2023)
