Skip to main content
Log in

Development of a colon endoscope robot that adjusts its locomotion through the use of reinforcement learning

International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

Fibre optic colonoscopy is usually performed with manual introduction and advancement of the endoscope, but there is potential for a robot capable of locomoting autonomously from the rectum to the caecum. A prototype robot was designed and tested.

Methods

The robot colonic endoscope consists in a front body with clockwise helical fin and a rear body with anticlockwise one, both connected via a DC motor. Input voltage is adjusted automatically by the robot, through the use of reinforcement learning, determining speed and direction (forward or backward).

Results

Experiments were performed both in-vitro and in-vivo, showing the feasibility of the robot. The device is capable of moving in a slippery environment, and reinforcement learning algorithms such as Q-learning and SARSA can obtain better results than simply applying full tension to the robot.

Conclusions

This self-propelled robotic endoscope has potential as an alternative to current fibre optic colonoscopy examination methods, especially with the addition of new sensors under development.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  1. Boyle P, Levin B (2008) World Cancer Report 2008. Int Agency Res Cancer Treat 88(1):123–132 (in Japanese)

    Google Scholar 

  2. Johnston PG (2006) The colorectal cancer coalition: reflections on the future. Oncologist 11: 970–972

    Article  PubMed  Google Scholar 

  3. Colquhoun P, Weiss EG, Efron J, Nogueras JJ, Vernava AM, Wexner SD (2006) Colorectal cancer screening: do we practice what we preach? Surg Innov 13:81–85

    Article  PubMed  Google Scholar 

  4. Church JM (1995) Endoscopy of the colon, rectum and anus. Igaku-Shoin Medical Publishers, New York

    Google Scholar 

  5. Wickham J (1996) Editorial. Min Invas Ther & Allied Tech

  6. Cuschieri A, Melzer A (1997) The impact of technologies on minimally invasive therapy. Surg Endosc 11: 91–92

    Article  CAS  PubMed  Google Scholar 

  7. Kassim I, Phee L, Ng WS, Gong F, Dario P, Mosse CA (2006) Locomotion techniques for robotic colonoscopy, Inst. of Nat. Neuroscience, Singapore; Engineering in Medicine and Biology Magazine

  8. Iddan G, Meron G, Glukhovsky A, Swain P (2000) Wireless capsule endoscopy. Nature 405: 417

    Article  CAS  PubMed  Google Scholar 

  9. Valdastri P, Webster RJ, Quaglia C, Quirini M, Menciassi A, Dario P (2009) A new mechanism for mesoscale legged locomotion in compliant tubular environments. IEEE Trans Robot 25:1047–1057

    Article  Google Scholar 

  10. Accoto D, Stefanini C, Phee L, Arena A, Pernorio G, Menciassi A, Carrozza MC, Dario P (2001) Measurements of the frictional properties of the gastrointestinal tract. In: Proceedings of the 2nd World Tribology Congress. Vienna, p 728

  11. Tanaka S et al (2006) The present condition of a capsule endoscope and a double balloon endoscope, a view. Med Treat 88(1):123–132 (in Japanese)

    Google Scholar 

  12. Hassan C, Zullo A, Winn S, Morini S (2008) Cost-effectiveness of capsule endoscopy in screening for colorectal cancer. Endoscopy 40:414–421

    Article  CAS  PubMed  Google Scholar 

  13. Grundfest WS, Burdick IV JW, Slatkin AB (1994) Robotic endoscopy. US Patent 5,337,732, 1994

  14. Slatkin AB, Burdick G, Grundfest WS (1995) The development of a robotic endoscope Intelligent Robots and Systems. IEEE/RSJ Int Conf Intell Robots Syst 2: 2162

    Google Scholar 

  15. Menciassi A, Park JH, Lee S, Gorini S, Dario P, Park JO (2002) Robotic solutions and mechanisms for a semi-autonomous endoscope. In: Proceedings of the IEEE RSJ International Conference on intelligent robots and systems, Lausanne, Switzerland, pp. 1379–1384

  16. Phee L, Accoto D, Menciassi A, Stefanini C, Carrozza MC, Dario P (2002) Analysis and development of locomotion devices for the gastrointestinal tract. IEEE Trans Biomed Eng 49:613–616

    Article  PubMed  Google Scholar 

  17. Kalmár Z, Szepesvári C, Lorincz A (1998) Modular reinforcement learning: an application a real robot task. Lecture notes in computer science, ISSN 0302-9743

  18. Abbeel P, Ng AY (2005) Exploration and apprenticeship learning in reinforcement learning. In: ICML ’05 proceedings of the 22nd international conference on Machine learning, pp 1–8

  19. Abbeel P, Quigley M, Ng AY (2006) Using inaccurate models in reinforcement learning. In: ICML ’06 proceedings of the 23rd international conference on Machine learning

  20. Ito et al (2007) Development of colon endoscope robots with new drive mechanisms—self-propelled endoscope robots of rotatory inertia and reverse screw types. In: Proceedings of the 25th Annual conference of the robotics society of Japan 2J17 (in Japanese)

  21. Moore A (1990) Efficient memory-based learning for robot control. PhD. Thesis, Technical Report No.229, Computer Laboratory, University of Cambridge

  22. Sutton RS, Barto G (1998) Reinforcement learning: an introduction. MIT Press, Cambridge

    Google Scholar 

  23. Asada M, Noda S, Tawaratsumida S, Hosoda K (1996) Purposive behavior acquisition for a real robot by vision-based reinforcement learning. Mach Learn 23: 279–303

    Google Scholar 

  24. Uchibe E, Asada M, Hosoda K (1996) Behavior coordination for a mobile robot using modular reinforcement learning. In: Proceedings of IEEE/RSJ Int Conf on Intelligent Robot and Sytems. pp 1329–1336

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to G. Trovato.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Trovato, G., Shikanai, M., Ukawa, G. et al. Development of a colon endoscope robot that adjusts its locomotion through the use of reinforcement learning. Int J CARS 5, 317–325 (2010). https://doi.org/10.1007/s11548-010-0481-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-010-0481-0

Keywords

Navigation