Real-time and multimodal brain slice-to-volume registration using CNN

Zixuan Chen, Zekai Xu, Weiwei Yi, Xin Yang, Wenguang Hou, Mingyue Ding, Oleg Granichin

Результат исследований: Научные публикации в периодических изданияхстатья

Выдержка

Brain slice-to-volume registration is an essential problem in numerous clinical applications; it is aimed at determining the rigid transformation parameters for locating intraoperative 2D slices in the preoperative 3D volume. This task has several challenges: (1) it has to be carried out in real-time; (2) it should not require manual intervention; (3) it requires multimodal operation; (4) it should not require landmark; and (5) it should not require initialization. However, available methods are incapable of overcoming these obstacles simultaneously. In this study, a discrete strategy is introduced, and the slice-to-volume registration is transformed into a global multilabel classification problem. An automatic system using a convolutional neural network (CNN) is applied to implement multilabel classification. The network is trained by slices extracted from the volume and applied in a multibranch manner. Moreover, silhouettes are utilized to unify the multimodal images into the same metric. Centralization and spindle transformation are applied to reduce the dimension of the parameter space, resulting in fewer training samples and less computational complexity. This system exhibits the advantages of not requiring initialization, landmark, or manual intervention; moreover, it can satisfy the real-time and multimodal requirements simultaneously. Experiments on five datasets demonstrate that our system can achieve highly accurate registration and strong robustness; moreover, it is observed to be superior to the state-of-the-art methods by an average of approximately 4.5 mm in terms of the mean target registration error. (C) 2019 Elsevier Ltd. All rights reserved.

Язык оригиналаАнглийский
Страницы (с-по)86-96
Число страниц11
ЖурналExpert Systems with Applications
Том133
DOI
СостояниеОпубликовано - 1 ноя 2019

Отпечаток

Brain
Neural networks
Computational complexity
Experiments

Предметные области Scopus

  • Технология (все)
  • Прикладные компьютерные науки
  • Искусственный интеллект

Цитировать

Chen, Zixuan ; Xu, Zekai ; Yi, Weiwei ; Yang, Xin ; Hou, Wenguang ; Ding, Mingyue ; Granichin, Oleg. / Real-time and multimodal brain slice-to-volume registration using CNN. В: Expert Systems with Applications. 2019 ; Том 133. стр. 86-96.
@article{ecc42e1fa2b74d0abe77d33b6918686a,
title = "Real-time and multimodal brain slice-to-volume registration using CNN",
abstract = "Brain slice-to-volume registration is an essential problem in numerous clinical applications; it is aimed at determining the rigid transformation parameters for locating intraoperative 2D slices in the preoperative 3D volume. This task has several challenges: (1) it has to be carried out in real-time; (2) it should not require manual intervention; (3) it requires multimodal operation; (4) it should not require landmark; and (5) it should not require initialization. However, available methods are incapable of overcoming these obstacles simultaneously. In this study, a discrete strategy is introduced, and the slice-to-volume registration is transformed into a global multilabel classification problem. An automatic system using a convolutional neural network (CNN) is applied to implement multilabel classification. The network is trained by slices extracted from the volume and applied in a multibranch manner. Moreover, silhouettes are utilized to unify the multimodal images into the same metric. Centralization and spindle transformation are applied to reduce the dimension of the parameter space, resulting in fewer training samples and less computational complexity. This system exhibits the advantages of not requiring initialization, landmark, or manual intervention; moreover, it can satisfy the real-time and multimodal requirements simultaneously. Experiments on five datasets demonstrate that our system can achieve highly accurate registration and strong robustness; moreover, it is observed to be superior to the state-of-the-art methods by an average of approximately 4.5 mm in terms of the mean target registration error. (C) 2019 Elsevier Ltd. All rights reserved.",
keywords = "Brain slice-to-volume registration, Convolutional neural network, Multimodal, Real-time, System",
author = "Zixuan Chen and Zekai Xu and Weiwei Yi and Xin Yang and Wenguang Hou and Mingyue Ding and Oleg Granichin",
year = "2019",
month = "11",
day = "1",
doi = "10.1016/j.eswa.2019.05.016",
language = "Английский",
volume = "133",
pages = "86--96",
journal = "Expert Systems with Applications",
issn = "0957-4174",
publisher = "Elsevier",

}

Real-time and multimodal brain slice-to-volume registration using CNN. / Chen, Zixuan; Xu, Zekai; Yi, Weiwei; Yang, Xin; Hou, Wenguang; Ding, Mingyue; Granichin, Oleg.

В: Expert Systems with Applications, Том 133, 01.11.2019, стр. 86-96.

Результат исследований: Научные публикации в периодических изданияхстатья

TY - JOUR

T1 - Real-time and multimodal brain slice-to-volume registration using CNN

AU - Chen, Zixuan

AU - Xu, Zekai

AU - Yi, Weiwei

AU - Yang, Xin

AU - Hou, Wenguang

AU - Ding, Mingyue

AU - Granichin, Oleg

PY - 2019/11/1

Y1 - 2019/11/1

N2 - Brain slice-to-volume registration is an essential problem in numerous clinical applications; it is aimed at determining the rigid transformation parameters for locating intraoperative 2D slices in the preoperative 3D volume. This task has several challenges: (1) it has to be carried out in real-time; (2) it should not require manual intervention; (3) it requires multimodal operation; (4) it should not require landmark; and (5) it should not require initialization. However, available methods are incapable of overcoming these obstacles simultaneously. In this study, a discrete strategy is introduced, and the slice-to-volume registration is transformed into a global multilabel classification problem. An automatic system using a convolutional neural network (CNN) is applied to implement multilabel classification. The network is trained by slices extracted from the volume and applied in a multibranch manner. Moreover, silhouettes are utilized to unify the multimodal images into the same metric. Centralization and spindle transformation are applied to reduce the dimension of the parameter space, resulting in fewer training samples and less computational complexity. This system exhibits the advantages of not requiring initialization, landmark, or manual intervention; moreover, it can satisfy the real-time and multimodal requirements simultaneously. Experiments on five datasets demonstrate that our system can achieve highly accurate registration and strong robustness; moreover, it is observed to be superior to the state-of-the-art methods by an average of approximately 4.5 mm in terms of the mean target registration error. (C) 2019 Elsevier Ltd. All rights reserved.

AB - Brain slice-to-volume registration is an essential problem in numerous clinical applications; it is aimed at determining the rigid transformation parameters for locating intraoperative 2D slices in the preoperative 3D volume. This task has several challenges: (1) it has to be carried out in real-time; (2) it should not require manual intervention; (3) it requires multimodal operation; (4) it should not require landmark; and (5) it should not require initialization. However, available methods are incapable of overcoming these obstacles simultaneously. In this study, a discrete strategy is introduced, and the slice-to-volume registration is transformed into a global multilabel classification problem. An automatic system using a convolutional neural network (CNN) is applied to implement multilabel classification. The network is trained by slices extracted from the volume and applied in a multibranch manner. Moreover, silhouettes are utilized to unify the multimodal images into the same metric. Centralization and spindle transformation are applied to reduce the dimension of the parameter space, resulting in fewer training samples and less computational complexity. This system exhibits the advantages of not requiring initialization, landmark, or manual intervention; moreover, it can satisfy the real-time and multimodal requirements simultaneously. Experiments on five datasets demonstrate that our system can achieve highly accurate registration and strong robustness; moreover, it is observed to be superior to the state-of-the-art methods by an average of approximately 4.5 mm in terms of the mean target registration error. (C) 2019 Elsevier Ltd. All rights reserved.

KW - Brain slice-to-volume registration

KW - Convolutional neural network

KW - Multimodal

KW - Real-time

KW - System

UR - http://www.scopus.com/inward/record.url?scp=85065744945&partnerID=8YFLogxK

U2 - 10.1016/j.eswa.2019.05.016

DO - 10.1016/j.eswa.2019.05.016

M3 - статья

AN - SCOPUS:85065744945

VL - 133

SP - 86

EP - 96

JO - Expert Systems with Applications

JF - Expert Systems with Applications

SN - 0957-4174

ER -