X2Vision: 3D CT Reconstruction from Biplanar X-Rays with Deep Structure Prior

Alexandre Cafaro, Quentin Spinat, Amaury Leroy, Pauline Maury, Alexandre Munoz, Guillaume Beldjoudi, Charlotte Robert, Eric Deutsch, Vincent Grégoire, Vincent Lepetit, Nikos ParagiosMICCAI 2023 · OpenReview

Abstract

We propose an unsupervised deep learning method to reconstruct a 3D tomographic image from biplanar X-rays, to reduce the number of required projections, the patient dose, and the acquisition time. To address this ill-posed problem, we introduce prior knowledge of anatomic structures by training a generative model on 3D CTs of head and neck. We optimize the latent vectors of the generative model to recover a volume that both integrates this prior knowledge and ensures consistency between the reconstructed image and input projections. Our method outperforms recent methods in terms of reconstruction error while being faster and less radiating than current clinical workflow. We evaluate our method in a clinical configuration for radiotherapy.
BibTeX
@inproceedings{cafaro2023x,
  author = {Alexandre Cafaro and Quentin Spinat and Amaury Leroy and Pauline Maury and Alexandre Munoz and Guillaume Beldjoudi and Charlotte Robert and Eric Deutsch and Vincent Grégoire and Vincent Lepetit and Nikos Paragios},
  title = {{X2Vision: 3D CT Reconstruction from Biplanar X-Rays with Deep Structure Prior}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2023},
  url = {https://openreview.net/forum?id=Ym4lNyY-lAJ},
}

Loading related content...

Figure