Palash Goyal
Palash Goyal is a research scientist at Google, working on improving large language models (LLMs) and agentic systems built on top of these models. His research interests include agentic optimization, time series forecasting and enhancing planning capability of models. He received his PhD in computer science from University of Southern California advised by Prof. Emilio Ferrara. He has also previously worked in Samsung Research America on multi-modal learning and in Amazon AGI on responsible training of LLMs.
Authored Publications
Sort By
Heterogeneous Swarms: Jointly Optimizing Model Roles and Weights for Multi-LLM Systems
Shangbin Feng
Yike Wang
Weijia Shi
Huang Xia
Luke Zettlemoyer
Yulia Tsvetkov
2025
Preview abstract
We propose Heterogeneous Swarms, an algorithm to discover and adapt multi-LLM systems by jointly optimizing model roles and weights. Given a pool of LLM experts and a utility function, Heterogeneous Swarms employs two iterative steps: role-step and weight-step. For role-step, we interpret model roles as input-output relationships and optimize the directed acyclic graph (DAG) of LLMs representing a multi-LLM system. Starting from a swarm of randomly initialized continuous adjacency matrices, we decode them into discrete DAGs, call the LLMs in topological order with message passing, evaluate on the utility function, and optimize the adjacency matrices with swarm intelligence based on the utility score. For weight-step, we define JFK-score to evaluate the contribution of individual LLMs in the best-found DAG of the role-step, then optimize model weights with swarm intelligence based on the JFK-score. Extensive experiments demonstrate that Heterogeneous Swarms outperforms 15 baselines spanning role-based and weight-based approaches by 18.5% on average across 12 tasks and contexts. Further analysis reveals that Heterogeneous Swarms discovers multi-LLM systems with heterogeneous model roles and substantial collaborative gains, and benefits from the diversity of initial LLMs.
View details
