Efficient Encoding and Decoding of Binaural Sound with Resonance Audio

Frank Boland
Alper Gungormusler
Ian Kelly
Yero Yeh
Andrew Allen
Marcin Gorzel

Abstract

Resonance Audio is an open source project designed for creating and controlling dynamic spatial sound in Virtual & Augmented Reality (VR/AR), gaming or video experiences. It also provides integrations with popular game development platforms and digital audio workstations as a preview plugin. Resonance Audio binaural decoder is used in YouTube VR to provide cinematic spatial audio experiences. This paper describes the core sound spatialization algorithms used in Resonance Audio.