LOW LIGHT RGB AND IR IMAGE FUSION WITH SELECTIVE CNN-TRANSFORMER NETWORK

In low-light images, contrast and brightness are corrupted, making it difficult to accurately percept detail and edge information with the naked eye. Because of the development of multi sensor imaging, RGB-IR image fusion can enhance the imaging quality in low light conditions. However, the existing fusion algorithms have insufficient enhancement, distorted detail and low contrast, which make it difficult to generate high-quality fusion results. In this paper, we propose a Transformer-CNN image fusion method which considers global-local features fusion for low light image enhancement. The ConvGRU module is developed to alternatively select the global and local features from transformer and CNN network. To effectively improve the network performance, a learnable weight adaptive loss function is proposed to adjust the weight of loss functions during training. Numerous experiments prove that our method can enrich fusion image information, improve image contrast and edge in low-light scenes compared to state of art methods.