X-Ray2Em: Uncertainty-Aware Cross-Modality Image Reconstruction From X-Ray to Electron Microscopy In Connectomics

Comprehensive, synapse-resolution imaging of the brain will be crucial for understanding neuronal computations and function. In connectomics, this has been the sole purview of serial section electron microscopy (EM), which is an excruciatingly difficult process because it requires cutting tissue into many thin, fragile slices that then need to be imaged, aligned, and reconstructed. Unlike EM, X-ray imaging can penetrate thick tissues, eliminating the need for thin sectioning, and delivering fast acquisition, alignment, and isotropic resolution. Unfortunately, current state-of-the-art X-ray microscopy provides much lower resolution, to the extent that segmenting membranes is often challenging. We propose an uncertainty-aware 3D reconstruction model that translates X-ray images to EM-like images with enhanced membrane segmentation quality, showing its potential for developing simpler, faster, and more accurate X-ray based connectomics pipelines.