Google Research

Spacing Loss for Discovering Novel Categories

  • Joseph K J
  • Sujoy Paul
  • Gaurav Aggarwal
  • Soma Biswas
  • Piyush Rai
  • Kai Han
  • Vineeth N Balasubramanian
Computer Vision and Pattern Recognition (CVPR) Workshop on Continual Learning in Computer Vision (2022)


Novel Class Discovery (NCD) is a learning paradigm, where a machine learning model is tasked to semantically group instances from unlabeled data, by utilizing labeled instances from a disjoint set of classes. In this work, we first characterize existing NCD approaches into single-stage and two-stage methods based on whether they require access to labeled and unlabeled data together while discovering new classes.Next, we devise a simple yet powerful loss function that enforces separability in the latent space using cues from multi-dimensional scaling, which we refer to as Spacing Loss. Our proposed formulation can either operate as a standalone method or can be plugged into existing methods to enhance them. We validate the efficacy of Spacing Loss with thorough experimental evaluation across multiple settings on CIFAR-10 and CIFAR-100 datasets.

Learn more about how we do research

We maintain a portfolio of research projects, providing individuals and teams the freedom to emphasize specific types of work