Google Research

Free-Viewpoint Facial Re-Enactment from a Casual Capture

  • Srinivas Rao
  • Rodrigo Ortiz-Cayon
  • Matteo Munaro
  • Aidas Liaudanskas
  • Krunal Chande
  • Tobias Bertel
  • Christian Richardt
  • Alexander JB Trevor
  • Stefan Holzer
  • Abhishek Kar
SIGGRAPH Asia 2020 Posters, Association for Computing Machinery, Virtual Event, Republic of Korea

Abstract

We propose a system for free-viewpoint facial re-enactment from a casual video capture of a target subject. Our system can render and re-enact the subject consistently in all the captured views. Furthermore, our system also enables interactive free-viewpoint facial re-enactment of the target from novel views. The re-enactment of the target subject is driven by an expression sequence of a source subject, which is captured using a custom app running on an iPhone X. Our system handles large pose variations in the target subject while keeping the re-enactment consistent. We demonstrate the efficacy of our system by showing various applications.

Research Areas

Learn more about how we do research

We maintain a portfolio of research projects, providing individuals and teams the freedom to emphasize specific types of work