Achin (Ace) Kulshrestha
Ace is a Staff Software Engineer & Manager in Google's AR semantic perception team under Federico Tombari, focusing on privacy-aware ambient perception, On-Device LLMs, VLMs and 3D computer vision.
Beginning with a prestigious Microsoft award in 2009 to pursue privacy research, their contributions have extended to privacy, machine learning and anti-abuse roles at Facebook, UW-Madison, Yelp, and Google, spanning over 14+ years. They have a graduate degree in Computer Sciences from the University of Wisconsin-Madison.
Authored Publications
Sort By
Model Swarms: Collaborative Search of Adapted LLM Experts via Swarm Intelligence
Shangbin Feng
Yike Wang
Nathalie Rauschmayr
Yejin Choi
Yulia Tsvetkov
Preview abstract
We propose Model Swarms, a collaborative search algorithm to adapt LLM experts via swarm intelligence. Specifically, Model Swarms starts with a pool of LLM experts and a utility function. Guided by the best-found checkpoints across models, diverse LLM experts collaboratively move in the weight space and search for adapted models that optimize the utility function. Compared to existing model composition approaches, Model Swarms offers modularity, works in low-data regimes, and doesn't need assumptions about existing experts and how they should be composed. Extensive experiments demonstrate that Model Swarms could flexibly adapt LLM experts to a single dataset, multi-dataset domains, reward models, as well as diverse human preferences. Further analysis reveals that LLM experts discover previously unseen capabilities in the search process and that Model Swarms enable the weak-to-strong transition of experts through the collaborative search process.
View details
