• Zixuan Chen
  • Zekai Xu
  • Weiwei Yi
  • Xin Yang
  • Wenguang Hou
  • Mingyue Ding
  • Oleg Granichin

Brain slice-to-volume registration is an essential problem in numerous clinical applications; it is aimed at determining the rigid transformation parameters for locating intraoperative 2D slices in the preoperative 3D volume. This task has several challenges: (1) it has to be carried out in real-time; (2) it should not require manual intervention; (3) it requires multimodal operation; (4) it should not require landmark; and (5) it should not require initialization. However, available methods are incapable of overcoming these obstacles simultaneously. In this study, a discrete strategy is introduced, and the slice-to-volume registration is transformed into a global multilabel classification problem. An automatic system using a convolutional neural network (CNN) is applied to implement multilabel classification. The network is trained by slices extracted from the volume and applied in a multibranch manner. Moreover, silhouettes are utilized to unify the multimodal images into the same metric. Centralization and spindle transformation are applied to reduce the dimension of the parameter space, resulting in fewer training samples and less computational complexity. This system exhibits the advantages of not requiring initialization, landmark, or manual intervention; moreover, it can satisfy the real-time and multimodal requirements simultaneously. Experiments on five datasets demonstrate that our system can achieve highly accurate registration and strong robustness; moreover, it is observed to be superior to the state-of-the-art methods by an average of approximately 4.5 mm in terms of the mean target registration error. (C) 2019 Elsevier Ltd. All rights reserved.

Original languageEnglish
Pages (from-to)86-96
Number of pages11
JournalExpert Systems with Applications
Volume133
DOIs
StatePublished - 1 Nov 2019

    Research areas

  • Brain slice-to-volume registration, Convolutional neural network, Multimodal, Real-time, System, MEDICAL IMAGE REGISTRATION, OF-THE-ART

    Scopus subject areas

  • Engineering(all)
  • Artificial Intelligence
  • Computer Science Applications

ID: 42363955