Multi-modal 3D Image Registration Using Interactive Voxel Grid Deformation and Rendering

Abstract
We introduce a novel multi-modal 3D image registration framework based on 3D user-guided deformation of both volume's shape and intensity values. Being able to apply deformations in 3D gives access to a wide new range of interactions allowing for the registration of images from any acquisition method and of any organ, complete or partial. Our framework uses a state of the art 3D volume rendering method for real-time feedback on the registration accuracy as well as the image deformation. We propose a novel methodological variation to accurately display 3D segmented voxel grids, which is a requirement in a registration context for visualizing a segmented atlas. Our pipeline is implemented in an open-source software (available via GitHub) and was directly used by biologists for registration of mouse brain model autofluorescence acquisition on the Allen Brain Atlas. The latter mapping allows them to retrieve regions of interest properly identified on the segmented atlas in acquired brain datasets and therefore extract only high-resolution images of those areas, avoiding the creation of images too large to be processed.
Description

        
@inproceedings{
10.2312:vcbm.20221191
, booktitle = {
Eurographics Workshop on Visual Computing for Biology and Medicine
}, editor = {
Renata G. Raidou
and
Björn Sommer
and
Torsten W. Kuhlen
and
Michael Krone
and
Thomas Schultz
and
Hsiang-Yun Wu
}, title = {{
Multi-modal 3D Image Registration Using Interactive Voxel Grid Deformation and Rendering
}}, author = {
Richard, Thomas
and
Chastagnier, Yan
and
Szabo, Vivien
and
Chalard, Kevin
and
Summa, Brian
and
Thiery, Jean-Marc
and
Boubekeur, Tamy
and
Faraj, Noura
}, year = {
2022
}, publisher = {
The Eurographics Association
}, ISSN = {
2070-5786
}, ISBN = {
978-3-03868-177-9
}, DOI = {
10.2312/vcbm.20221191
} }
Citation