Fast Fusion of Hyperspectral and Multispectral Images : A Tucker Approximation Approach

Most autoencoder-based generative machine learning models use a two-factor cost function composed of reconstruction error and prior distribution distance. The latter is often evaluated with kernel-based methods. We notice that the impact of the batch size is different on each of the factors: kernel distribution profits from larger batches, while the reconstruction term achieves peak performance on smaller ones. Thus, we define a batch size reconstruction-distribution trade-off. instead of searching for an optimum global size of the batch, we propose to use small batches for the sake of reconstruction together with a vector enhanced with previously computed latent data for the sake of prior distribution optimization. We evaluate our method on standard benchmarks and illustrate that it can improve the model's generative scores.