Learning to Learn across Diverse Data Biases in Deep Face Recognition

Publication Date: 6/19/2022

Event: CVPR’22

Reference: pp. 4062-4072, 2022

Authors: Chang Liu, NEC Laboratories America, Inc., Northeastern University,; Xiang Yu, NEC Laboratories America, Inc.; Yi-Hsuan Tsai, NEC Laboratories America, Inc.; Masoud Faraki, NEC Laboratories America, Inc.; Ramin Moslemi, NEC Laboratories America, Inc.; Manmohan Chandraker, NEC Laboratories America, Inc., University of California, San Diego; Raymond Fu, Northeastern University

Abstract: Convolutional Neural Networks have achieved remarkable success in face recognition, in part due to the abundant availability of data. However, the data used for training CNNs is often imbalanced. Prior works largely focus on the long-tailed nature of face datasets in data volume per identity or focus on single bias variation. In this paper, we show that many bias variations such as ethnicity, head pose, occlusion and blur can jointly affect the accuracy significantly. We propose a sample level weighting approach termed Multi-variation Cosine Margin (MvCoM), to simultaneously consider the multiple variation factors, which orthogonally enhances the face recognition losses to incorporate the importance of training samples. Further, we leverage a learning to learn approach, guided by a held-out meta learning set and use an additive modeling to predict the MvCoM. Extensive experiments on challenging face recognition benchmarks demonstrate the advantages of our method in jointly handling imbalances due to multiple variations.

Publication Link: https://ieeexplore.ieee.org/document/9879488