Deformable MRI-Ultrasound Registration Using 3D Convolutional Neural Network

Sun, Li; Zhang, Songtao

10.1007/978-3-030-01045-4_18

2018

16113349

1611-3349

SIMULATION, IMAGE PROCESSING, AND ULTRASOUND SYSTEMS FOR ASSISTED DIAGNOSIS AND NAVIGATION

11042

152-158

Granada, Spain

GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND

SPRINGER INTERNATIONAL PUBLISHING AG

Precise tracking of intra-operative tissue shift is important for accurate resection of brain tumor. Alignment of pre-interventional magnetic resonance imaging (MRI) to intra-operative ultrasound (iUS) is required to access tissue shift and enable guided surgery. However, accurate and robust image registration needed to relate pre-interventional MRI to iUS images is difficult due to the very different nature of image intensity between modalities. Here we present a framework that can perform non-rigid MRI-ultrasound registration using 3D convolutional neural network (CNN). The framework is composed of three components: feature extractor, deformation field generator and spatial sampler. Our automatic registration framework adopts unsupervised learning approach, allows accurate end-to-end deformable MRI-ultrasound registration. Our proposed method avoids the downfall of intensity-based methods by considering both image intensity and gradient. It achieves competitive registration accuracy on RESECT dataset. In addition, our method takes only about one second to register each image pair, enabling applications such as real time registration.

MRI-ultrasound registration 3D CNN Deep learning

第一 ; 通讯

英语

CPCI-S ; EI

Computer Science

Computer Science, Artificial Intelligence ; Computer Science, Theory & Methods

WOS:000477753600018

20184105917326

Convolution ; Deep learning ; Deformation ; Diagnosis ; Image processing ; Medical computing ; Medical imaging ; Neural networks ; Patient treatment ; Tissue ; Ultrasonics

Bioengineering and Biology:461 ; Information Theory and Signal Processing:716.1 ; Imaging Techniques:746 ; Ultrasonic Waves:753.1

Web of Science

Southern Univ Sci & Technol, Shenzhen 518055, Peoples R China

Sun, Li,Zhang, Songtao. Deformable MRI-Ultrasound Registration Using 3D Convolutional Neural Network[C]. GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND:SPRINGER INTERNATIONAL PUBLISHING AG,2018:152-158.