Skip to main content
Log in

Automatic performance evaluation of the intracorporeal suture exercise

  • Short communication
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

This work uses deep learning algorithms to provide automated feedback on the suture with intracorporeal knot exercise in the fundamentals of laparoscopic surgery simulator. Different metrics were designed to provide informative feedback to the user on how to complete the task more efficiently. The automation of the feedback will allow students to practice at any time without the supervision of experts.

Methods

Five residents and five senior surgeons participated in the study. Object detection, image classification, and semantic segmentation deep learning algorithms were used to collect statistics on the practitioner’s performance. Three task-specific metrics were defined. The metrics refer to the way the practitioner holds the needle before the insertion to the Penrose drain, and the amount of movement of the Penrose drain during the needle’s insertion.

Results

Good agreement between the human labeling and the different algorithms’ performance and metric values was achieved. The difference between the scores of the senior surgeons and the surgical residents was statistically significant for one of the metrics.

Conclusion

We developed a system that provides performance metrics of the intracorporeal suture exercise. These metrics can help surgical residents practice independently and receive informative feedback on how they entered the needle into the Penrose.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

References

  1. Soper NJ, Fried GM (2008) The fundamentals of laparoscopic surgery: its time has come. Bull Am Coll Surg 93(9):30–32

    PubMed  Google Scholar 

  2. Sroka G, Feldman LS, Vassiliou MC (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room-a randomized controlled trial. Am J Surg 199(1):115–120

    Article  PubMed  Google Scholar 

  3. Goldbraikh A, D’Angelo A-L, Pugh CM, Laufer S (2022) Video-based fully automatic assessment of open surgery suturing skills. Int J Comput Assist Radiol Surg 17(3):437–448

    Article  PubMed  PubMed Central  Google Scholar 

  4. Zhang J, Nie Y, Lyu Y, Yang X, Chang J, Zhang JJ (2021) SD-Net: joint surgical gesture recognition and skill assessment. Int J Comput Assist Radiol Surg 16:1675–1682

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Zia A, Essa I (2018) Automated surgical skill assessment in RMIS training. Int J Comput Assist Radiol Surg 13(5):731–739

    Article  PubMed  Google Scholar 

  6. Forestier G, Petitjean F, Senin P, Despinoy F, Huaulmé A, Fawaz HI, Weber J, Idoumghar L, Muller P-A, Jannin P (2018) Surgical motion analysis using discriminative interpretable patterns. Artif Intell Med 91:3–11

    Article  PubMed  Google Scholar 

  7. Sánchez-Margallo JA, Sánchez-Margallo FM, Oropesa I, Enciso S, Gómez EJ (2017) Objective assessment based on motion-related metrics and technical performance in laparoscopic suturing. Int J Comput Assist Radiol Surg 12:307–314

    Article  PubMed  Google Scholar 

  8. Vedula SS, Malpani A, Ahmidi N, Khudanpur S, Hager G, Chen CCG (2016) Task-level vs. segment-level quantitative metrics for surgical skill assessment. J Surg Educ 73(3):482–489

    Article  PubMed  Google Scholar 

  9. Verhoeven DJ, Hillemans V, Leijte E, Verhoeven BH, Botden SMBI (2023) Assessment of minimally invasive suturing skills: is instrument tracking an accurate prediction? J Laparoendosc Adv Surg Tech 33(2):137–145. https://doi.org/10.1089/lap.2022.0313

    Article  Google Scholar 

  10. Yanik E, Intes X, Kruger U, Yan P, Diller D, Voorst BV, Makled B, Norfleet J, De S (2022) Deep neural networks for the assessment of surgical skills: a systematic review. J Def Model Simul 19(2):159–171. https://doi.org/10.1177/15485129211034586

    Article  Google Scholar 

  11. Jocher G, Chaurasia A, Stoken A et al. ultralytics/yolov5: V7.0-YOLOv5 SOTA realtime instance segmentation. https://doi.org/10.5281/zenodo.7347926

  12. He K, Zhang X, Ren S, Sun J (2015) Deep residual learning for image recognition. CoRR. arXiv:1512.03385

  13. Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. CoRR. arXiv:1505.04597

Download references

Funding

Study approval was granted by the Technion-Israel Institute of Technology Institutional Review Board. Informed consent was obtained from all individual participants included in the study. Funding was provided by the E. & J. Bishop Research Fund.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Liran Halperin.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Halperin, L., Sroka, G., Zuckerman, I. et al. Automatic performance evaluation of the intracorporeal suture exercise. Int J CARS 19, 83–86 (2024). https://doi.org/10.1007/s11548-023-02963-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-023-02963-6

Keywords

Navigation