Joint Classification and Out-of-Distribution Detection Based On Structured Latent Space of Variational Auto-Encoders

The segmentation of the liver, lesions, and vessels from pre-operative CT scans is of major importance in hepatic surgery planning. However, large databases with reference segmentations for these regions of interest remain unavailable, a challenge often encountered in medical image segmentation. in this work, we propose the FuSe loss, a novel loss function for multi-task learning on datasets with partial annotations. By employing the nnU-Net?s 3D self-configuring pipeline to calibrate and train a deep network for the joint segmentation of the liver, lesions, and vessels, we show how the FuSe loss allows to learn from the differently annotated IRCAD and LiTS datasets, improving the overall baseline segmentation performance. With the FuSe loss, the dice scores reached up to 95.9%, 70.6% and 60.0% for the liver, lesions, and vessels respectively.