Abstract
Image-to-patient or pre-operative to intra-operative registration is an essential problem in computer-assisted surgery (CAS). Non-rigid or deformable registration is still a challenging problem with partial overlapping between point sets due to limited camera view, missing data due to tumor resection and the surface reconstruction error intra-operatively. In this paper, we propose and validate a normal-vector assisted non-rigid registration framework for accurately registering soft tissues in CAS. Two stages including rigid and non-rigid registrations are involved in the framework. In the stage of the rigid registration that does the initial alignment, the normal vectors extracted from the point sets are used while the position uncertainty is assumed to be anisotropic. With the normal vectors incorporated, the algorithm can better recover the point correspondences and is more robust to intra-operative partial data which is often the case in a typical laparoscopic surgery. In the stage of the non-rigid registration, the anisotropic coherent point drift (CPD) method is formulated, where the isotropic error assumption is generalized to anisotropic cases. Extensive experiments on the human liver data demonstrate our proposed algorithm’s several great advantages over the existing state-of-the-art ones. First, the rigid transformation matrix is recovered more accurately. Second, the proposed registration framework is much more robust to partial scan. Besides, the anisotropic CPD outperforms the original CPD significantly in terms of robustness to noise.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
- 2.
\(\theta _{deg}=\text {arccos}\Big [ \frac{ \text {tr}(\mathbf {R}^g \mathbf {R}^{\mathsf {T}} ) -1}{2}\Big ]/\pi \times 180\), where \(\mathbf {R}^g\) and \(\mathbf {R}\) denote the ground-truth and the computed rotation matrix using one specific test method, respectively.
References
Bayer, S., et al.: Intraoperative brain shift compensation using a hybrid mixture model. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11073, pp. 116–124. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00937-3_14
Cignoni, P., Callieri, M., Corsini, M., Dellepiane, M., Ganovelli, F., Ranzuglia, G.: MeshLAB: an open-source mesh processing tool. In: Eurographics Italian Chapter Conference, pp. 129–136 (2008)
Collins, J.A., et al.: Improving registration robustness for image-guided liver surgery in a novel human-to-phantom data framework. IEEE TMI 36(7), 1502–1510 (2017)
Luo, J., et al.: Using the variogram for vector outlier screening: application to feature-based image registration. IJCARS 13(12), 1871–1880 (2018)
Min, Z., Ren, H., Meng, M.Q.H.: Statistical model of total target registration error in image-guided surgery. IEEE TASE (2019). https://doi.org/10.1109/TASE.2019.2909646
Min, Z., Wang, J., Meng, M.Q.-H.: Joint registration of multiple generalized point sets. In: Reuter, M., Wachinger, C., Lombaert, H., Paniagua, B., Lüthi, M., Egger, B. (eds.) ShapeMI 2018. LNCS, vol. 11167, pp. 169–177. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-04747-4_16
Min, Z., Wang, J., Meng, M.Q.H.: Robust generalized point cloud registration using hybrid mixture model. In: ICRA 2018, pp. 4812–4818. IEEE (2018)
Min, Z., Wang, J., Meng, M.Q.H.: Joint rigid registration of multiple generalized point sets with hybrid mixture models. IEEE TASE (2019). https://doi.org/10.1109/TASE.2019.2906391
Min, Z., Wang, J., Meng, M.Q.H.: Robust generalized point cloud registration with orientational data based on expectation maximization. IEEE TASE (2019). https://doi.org/10.1109/TASE.2019.2914306
Min, Z., Wang, J., Song, S., Meng, M.Q.H.: Robust generalized point cloud registration with expectation maximization considering anisotropic positional uncertainties. In: IROS 2018, pp. 1290–1297. IEEE (2018)
Myronenko, A., Song, X.: Point set registration: coherent point drift. IEEE Trans. Pattern Anal. Mach. Intell. 32(12), 2262–2275 (2010)
Ravikumar, N., Gooya, A., Beltrachini, L., Frangi, A.F., Taylor, Z.A.: Generalised coherent point drift for group-wise multi-dimensional analysis of diffusion brain MRI data. Med. Image Anal. 53, 47–63 (2019)
Ravikumar, N., Gooya, A., Frangi, A.F., Taylor, Z.A.: Generalised coherent point drift for group-wise registration of multi-dimensional point sets. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10433, pp. 309–316. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66182-7_36
Robu, M.R., et al.: Global rigid registration of ct to video in laparoscopic liver surgery. Int. J. Comput. Assist. Radiol. Surg. 13(6), 947–956 (2018)
Sinha, A., Liu, X., Reiter, A., Ishii, M., Hager, G.D., Taylor, R.H.: Endoscopic navigation in the absence of CT imaging. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11073, pp. 64–71. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00937-3_8
Suwelack, S., et al.: Physics-based shape matching for intraoperative image guidance. Med. Phys. 41(11), 111901 (2014)
Acknowledgement
This project is partially supported by the Hong Kong RGC GRF grants 14210117, RGC NSFC RGC Joint Research Scheme N_CUHK448/17 and the shenzhen Science and Technology Innovation projects JCYJ20170413161616163 awarded to Max Q.-H. Meng.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Min, Z., Liu, L., Meng, M.QH. (2019). Generalized Non-rigid Point Set Registration with Hybrid Mixture Models Considering Anisotropic Positional Uncertainties. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11768. Springer, Cham. https://doi.org/10.1007/978-3-030-32254-0_61
Download citation
DOI: https://doi.org/10.1007/978-3-030-32254-0_61
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32253-3
Online ISBN: 978-3-030-32254-0
eBook Packages: Computer ScienceComputer Science (R0)