MENDAM: Multi-Expert Network with Distribution-Aware Momentum for Long-Tailed Recognition

Long-tailed data distribution (i.e., minority classes occupy most of the data, while most classes have very few samples) is a common problem in image classification. The existing deferred re-balancing methods suffer from low accuracy for tail classes due to their bias towards head classes. In this paper, we find that properly adjusting the momentum can significantly improve the performance for class-imbalanced tasks, which provides a novel perspective to solve this thorny problem. Based on this finding, we propose a new way to calculate a distribution-aware momentum (DAM) based on the data distribution to avoid bias towards head classes. Furthermore, we design a multi-expert network (MEN) to designate each expert to focus on different tail classes. We achieve new state-of-the-art on CIFAR-10-LT, CIFAR-100-LT, ImageNet-LT and iNaturalist2018 for image classification.