Google Research

Evolving intrinsic motivations for altruistic behavior

  • Jane Wang
  • Edward Hughes
  • Chrisantha Fernando
  • Wojciech Czarnecki
  • Edgar Duenez Guzman
  • Joel Z Leibo
AAMAS (2019)

Abstract

Multi-agent cooperation is an important feature of the natural world. Many tasks involve individual incentives that are misaligned with the common good, yet a wide range of organisms from insects to humans display a remarkable ability to overcome their differences and collaborate. Therefore, the emergence of cooperative behaviour amongst self-interested individuals is an important question for the fields of multi-agent reinforcement learning (MARL) and evolutionary theory. Here, we study a particular class of multi-agent problems called intertemporal social dilemmas, where the conflict between the individual and the group is particularly sharp. By combining MARL with appropriately structured natural selection, we demonstrate that individual inductive biases for cooperation can be learned in a model-free way, in contrast to previous work. To achieve this, we introduce an innovative modular architecture for deep reinforcement learning agents which supports multi-level selection. We present state-of-the-art results in two challenging environments, and interpret these in the context of cultural and ecological evolution.

Research Areas

Learn more about how we do research

We maintain a portfolio of research projects, providing individuals and teams the freedom to emphasize specific types of work