Skip to main content

A Real-Time Target Tracking Algorithm for a Robotic Flexible Endoscopy Platform

  • Conference paper
  • First Online:
Computer-Assisted and Robotic Endoscopy (CARE 2015)

Abstract

Complex endoscopic interventions require a new generation of devices and instruments. A robotic platform for flexible endoscopy through telemanipulation was developed to meet this demand. The concept of telemanipulation allows the development of software for computer-aided surgery. Intelligent navigation such as automated target centralization could assist the endoscopist during procedures.

A real-time algorithm was designed for tracking a target region that is of specific interest for the surgeon. Therefore, the physician needs to indicate the region to be tracked, which then will be centralized (locked). The goal of this research is to investigate the robustness and accuracy of the tracking algorithm during endoscopic interventions. The region of interest can be a polyp for polypectomy, Vater’s ampulla for Endoscopic Retrograde CholangioPancreatography (ERCP), Barrett’s epithelia for gastroscopic biopsy or any area in more complex procedures. The algorithm was tested in vitro on image sequences obtained during real endoscopic interventions.

The indicated area of interest could be tracked in all image sequences, with an accuracy of 91.6 % (Q1–Q3 77.7 %–99.0 %, intraclass correlation). The algorithm was robust against instruments or smoke in the field of view. Tracking was less robust against very large camera movements.

The developed target lock worked robustly, in real-time and was found to be accurate. Improvements include improving the robustness of the algorithm against motion blur and drift.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 34.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Valdastri, P., Simi, M., Webster III, R.J.: Advanced technologies for gastrointestinal endoscopy. Ann. Rev. Biomed. Eng. 14, 397–429 (2012). http://www.ncbi.nlm.nih.gov/pubmed/22655598

    Article  Google Scholar 

  2. Van der Stap, N., Reilink, R., Misra, S., Broeders, I., van der Heijden, F.: The use of the focus of expansion for automated steering of flexible endoscopes. In: IEEE BioRob, pp. 13–18. IEEE, Rome (2012). http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6290804

  3. van der Stap, N., Slump, C.H., Broeders, I.A.M.J., van der Heijden, F.: Image-based navigation for a robotized flexible endoscope. In: Luo, X., Reich, T., Mirota, D., Soper, T. (eds.) CARE 2014. LNCS, vol. 8899, pp. 77–87. Springer, Heidelberg (2014)

    Google Scholar 

  4. Ott, L., Nageotte, F., Zanne, P., Mathelin, M.D., Member, S.: Robotic assistance to flexible endoscopy by physiological-motion tracking. IEEE Trans. Robot. 27(2), 346–359 (2011)

    Article  Google Scholar 

  5. Atasoy, S., Mateus, D., Meining, A., Yang, G.-Z., Navab, N.: Endoscopic video manifolds for targeted optical biopsy. IEEE Trans. Med. Imaging 31(3), 637–653 (2012). http://www.ncbi.nlm.nih.gov/pubmed/22057050

    Article  Google Scholar 

  6. Allain, B., Hu, M., Lovat, L., Cook, R., Vercauteren, T., Ourselin, S., Hawkes, D.: Re-localisation of a biopsy site in endoscopic images and characterisation of its uncertainty. Med. Image Anal. 16(2), 482–496 (2012). http://www.ncbi.nlm.nih.gov/pubmed/22197442

    Article  Google Scholar 

  7. Ye, M., Giannarou, S., Patel, N., Teare, J., Yang, G.-Z.: Pathological site retargeting under tissue deformation using geometrical association and tracking. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013, Part II. LNCS, vol. 8150, pp. 67–74. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  8. Liu, J., Wang, B., Hu, W., Zong, Y., Si, J., Duan, H.: A non-invasive navigation system for retargeting gastroscopic lesions. Biomed. Mater. Eng. 24(6), 2673–2679 (2014). http://www.ncbi.nlm.nih.gov/pubmed/25226971

    Google Scholar 

  9. Chu, Y.-J., Liu, S.-P., Luo, R.C., Hu, R.-H., Yeh, C.-C., Peng, Y.W., Yen, P.-L.: Dynamic tracking of anatomical object for a steerable endoscope. In: International Conference on Advanced Intelligent Mechatronics (2012)

    Google Scholar 

  10. Ruiter, J., Rozeboom, E., Voort, M.V.D., Bonnema, M., Broeders, I.: Design and evaluation of robotic steering of a flexible endoscope. In: IEEE BioRob, pp. 761–767. IEEE, Roma (2012)

    Google Scholar 

  11. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 1–28 (2004)

    Article  Google Scholar 

  12. Bay, H., Ess, A., Tuytelaars, T., Vangool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008). http://linkinghub.elsevier.com/retrieve/pii/S1077314207001555

    Article  Google Scholar 

  13. Speidel, S., Krappe, S.: Robust feature tracking for endoscopic pose estimation and structure recovery. In: Proceedings of the SPIE. SPIE digital library, vol. 8671, pp. 1–7 (2013). http://proceedings.spiedigitallibrary.org/proceeding.aspx?articleid=1663315

  14. Jellinek, E.M.: On the use of the intra-class correlation coefficient in the testing of the difference of certain variance ratios. J. Educ. Psychol. 31(1), 60–63 (1940). http://dx.doi.org/10.1037/h0062703

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nanda van der Stap .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

van der Stap, N. et al. (2016). A Real-Time Target Tracking Algorithm for a Robotic Flexible Endoscopy Platform. In: Luo, X., Reichl, T., Reiter, A., Mariottini, GL. (eds) Computer-Assisted and Robotic Endoscopy. CARE 2015. Lecture Notes in Computer Science(), vol 9515. Springer, Cham. https://doi.org/10.1007/978-3-319-29965-5_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-29965-5_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-29964-8

  • Online ISBN: 978-3-319-29965-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics