Skip to main content
Log in

A practical computer based vision system for posture and movement sensing in occupational medicine

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Back pain and upper extremities injuries due to overexertion account for over twenty percent of leave days from work in the US. This explains why a vast amount of initiatives have been, to this date, carried out aiming at reducing the occurrence of such type of injuries. However, although such type of lesions are among the most studied in occupational medicine, no automatic detection and prevention technologies are pervasively available, to this date, at workplaces. Such deficiency is ascribable to the absence of any flexible and cost-effective tectaphnology that may play such role. This work aims at filling such gap: the contribution of this paper is the design and implementation of a movement-posture computer-vision based system that, performing as a sensor, can detect overexertion movements, helping avoid the most common injuries that these cause. Such tasks are carried out with the use of a simple webcam, thus not requiring any expensive or specialized (e.g., Microsoft Kinect) hardware device. The proposed technology is, hence, easily affordable by any type of company and production plant throughout the world and easy adaptable to recognize and detect a wide set of movements and postures. The validity of such approach is demonstrated in realistic settings through a wide set of experiments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Agustin HC (1992) Posture position sensor. U.S. Patent 5,168,264, issued December 1

  2. Alexiadis DS, Kelly P, Daras P, O’Connor NE, Boubekeur T, Moussa MB (2011) Evaluating a dancer’s performance using kinect-based skeleton tracking. In: Proceedings of the 19th ACM international conference on Multimedia. ACM, p 659–662

  3. Andreoni G, Mazzola M, Ciani O, Zambetti M, Romero M, Costa F, Preatoni E (2009) Method for movement and gesture assessment (MMGA) in ergonomics. International Conference on Digital Human Modeling, San Diego, CA, USA, p 591–598

  4. Available, online: http://ergo.human.cornell.edu/pub/AHquest/CURULA.pdf

  5. Available, online. http://structure.io/openni. Accessed 25 May 2015

  6. Available, online. http://www.bls.gov/iif/oshcdnew.htm. Accessed 25 May 2015

  7. Available, online. http://www.fastcoexist.com/3025324/fund-this/does-this-posture-sensing-device-really-keep-you-sitting-up-straight. Accessed 5 May 2014

  8. Available, online. http://www.lumobodytech.com/lumoback/. Accessed 5 May 2014

  9. Bernard BP, Putz-Anderson V (1997) Musculoskeletal disorders and workplace factors: a critical review of epidemiologic evidence for work-related disorders of the neck, upper extremities, and low back. DHHS (NIOSH) Publication No. 97B141

  10. Bernmark E, Wiktorin CCPS (2002) A triaxial accelerometer for measuring arm movements. Appl Ergon 33:541–547

    Article  Google Scholar 

  11. Como JJ, Smith CE, & Grabinsky A (2012) Trauma epidemiology, mechanisms of injury. Essent Trauma Anesth 1

  12. Côté JN, Raymond D, Mathieu PA, Feldman AG, Levin MF (2005) Differences in multi-joint kinematic patterns of repetitive hammering in healthy, fatigued and shoulder-injured individuals. Clin Biomech 20(6):581–590

    Article  Google Scholar 

  13. da Costa BR, Vieira ER (2010) Risk factors for work-related musculoskeletal disorders: a systematic review of recent longitudinal studies. Am J Ind Med 53(3):285–323

    Google Scholar 

  14. Da Gama A, Chaves T, Figueiredo L, Teichrieb V (2012) Poster: improving motor rehabilitation process through a natural interaction based system using kinect sensor. In: 3D User Interfaces (3DUI), 2012 I.E. Symposium on IEEE, p 145–146

  15. David GC (2005) Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders. Occup Med 55:190–199

    Article  Google Scholar 

  16. Fimland MS, Vasseljen O, Gismervik S, Rise MB, Halsteinli V, Jacobsen HB, Borchgrevink PC, Tenggren H, Johnsen R (2014) Occupational rehabilitation programs for musculoskeletal pain and common mental health disorders: study protocol of a randomized controlled trial. BMC Public Health 14(1):368

    Article  Google Scholar 

  17. Freivalds A, Kong Y, You H, Park S (2000) A comprehensive risk assessment model for work-related musculoskeletal disorders of the upper extremities. Proc Hum Factors Ergon Soc Annu Meet 44(31):5–728

    Article  Google Scholar 

  18. Gatchel RJ, Kishino ND, Strizak AM (2014). Occupational musculoskeletal pain and disability disorders: An overview. In: Handbook of Musculoskeletal Pain and Disability Disorders in the Workplace. Springer, New York, p 3–17

  19. Gatchel RJ, Schultz IZ (2014) Future research directions for preventing and treating occupational musculoskeletal disorders. In: Handbook of Musculoskeletal Pain and Disability Disorders in the Workplace. Springer, New York, p 485–498

  20. Gerr F, Fethke N, Merlino L, Anton D, Rosecrance J, Jones MP, Marcus M, and Meyers A (2013) A prospective study of musculoskeletal outcomes among manufacturing workers I. Effects of physical risk factors. Human Factors J Human Factors Ergon Soc 0018720813491114

  21. González-Ortega D, Díaz-Pernas FJ, Martínez-Zarzuela M, Antón-Rodríguez M (2014) A kinect-based system for cognitive rehabilitation exercises monitoring. Comput Methods Prog Biomed 113(2):620–631

    Article  Google Scholar 

  22. Herrin GD, Jaraiedi M, Anderson CK (1986) Prediction of overexertion injuries using biomechanical and psychophysical models. Am Ind Hyg Assoc J 47(6):322–330

    Article  Google Scholar 

  23. Hollerbach JM, Flash T (1982) Dynamic interactions between limb segments during planar arm movement. Biol Cybern 44(1):67–77

    Article  Google Scholar 

  24. Kar A (2010) Skeletal tracking using microsoft kinect. Methodology 1:1–11

    Google Scholar 

  25. Knauf MT, Schultz IZ, Stewart AM, Gatchel RJ (2014) Models of return to work for musculoskeletal disorders: advances in conceptualization and research. In: Handbook of Musculoskeletal Pain and Disability Disorders in the Workplace. Springer, New York, p 431–452

  26. Machado S, Osório R, Silva N, Magini M (2010) Biomechanical analysis of the muscular power of martial arts athletes. Med Biol Eng Comput 48(6):573–577

    Article  Google Scholar 

  27. Marfia G, Roccetti M, Matteucci G, Marcomini A (2012) Technoculture of handcraft: fine gesture recognition for haute couture skills preservation and transfer in Italy. ACM SIGGRAPH 2012 Posters. ACM, p 81

  28. Massey T, Marfia G, Stoelting A, Tomasi R, Spirito M, Sarrafzadeh M, Pau G (2011) Leveraging social system networks in ubiquitous high-data-rate health systems. IEEE Trans Inf Technol Biomed 15(3):491–498

    Article  Google Scholar 

  29. McAtamney L, Corlett EN (1993) RULA e a survey method for the investigation of work-related upper limb disorders. Appl Ergon 24:91–99

    Article  Google Scholar 

  30. Miedema HS, Molen HF, Kuijer PPFM, Koes BW, Burdorf A (2014) Incidence of low back pain related occupational diseases in the Netherlands. Eur J Pain 18(6):873–882

    Article  Google Scholar 

  31. Mullineaux DR, Underwood SM, Shapiro R, Hall JW (2012) Real-time biomechanical biofeedback effects on top-level rifle shooters. Appl Ergon 43:109–114

    Article  Google Scholar 

  32. Mustard CA, Chambers A, Ibrahim S, Etches J, Smith P (2014). Time trends in musculoskeletal disorders attributed to work exposures in Ontario using three independent data sources, 2004–2011. Occup. Environ. Med oemed-2014

  33. Ni B, Pei Y, Liang Z, Lin L, Moulin P (2013). Integrating multi-stage depth-induced contextual information for human action recognition and localization. In: Automatic Face and Gesture Recognition (FG), 2013 10th IEEE International Conference and Workshops on IEEE, p 1–8

  34. Nordander C, Ohlsson K, Åkesson I, Arvidsson I, Balogh I, Hansson G, Stromberg U, Rittner R, Skerfving S (2009) Risk of musculoskeletal disorders among females and males in repetitive/constrained work. Ergonomics 52(10):1226–1239

    Article  Google Scholar 

  35. Osborne A, Blake C, Fullen BM, Meredith D, Phelan J, McNamara J, Cunningham C (2012) Prevalence of musculoskeletal disorders among farmers: a systematic review. Am J Ind Med 55(2):143–158

    Article  Google Scholar 

  36. Radwin RG, Lin ML (1993) An analytical method for characterizing repetitive motion and postural stress using spectral-analysis. Ergonomics 36:379–389

    Article  Google Scholar 

  37. Rainville J, Smeets RJ, Bendix T, Tveito TH, Poiraudeau S, Indahl AJ (2011) Fear-avoidance beliefs and pain avoidance in low back pain—translating research into clinical practice. Spine J 11(9):895–903

    Article  Google Scholar 

  38. Raja R, Kingsbury SR, Wise E, Conaghan PG (2014). Primary care approaches to musculoskeletal multiple-site joint pain pharmacological therapy: a survey of general practitioners. Prim Health Care Res Dev 1–6

  39. Ray SJ, Teizer J (2012) Real-time construction worker posture analysis for ergonomics training. Adv Eng Inform 26(2):439–455

    Article  Google Scholar 

  40. Roccetti M, Marfia G, Semeraro A (2012) Playing into the wild: a gesture-based interface for gaming in public spaces. J Vis Commun Image Represent 23(3):426–440

    Article  Google Scholar 

  41. Spyropoulos E, Chroni E, Katsakiori P, Athanassiou G (2013) A quantitative approach to assess upper limb fatigue in the work field. Occup Ergon 11(1):45–57

    Google Scholar 

  42. van den Bogert AJ, Geijtenbeek T, Even-Zohar O, Steenbrink F, Hardin EC (2013) A real-time system for biomechanical analysis of human movement and muscle function. Med Biol Eng Comput 51(10):1069–1077

    Article  Google Scholar 

  43. Vignais N, Miezal M, Bleser G, Mura K, Gorecky D, Marin F (2013) Innovative system for real-time ergonomic feedback in industrial manufacturing. Appl Ergon 44:566–574

    Article  Google Scholar 

  44. Wang K, Wang X, Lin L, Wang M, Zuo W (2014) 3D human activity recognition with reconfigurable convolutional neural networks. In: Proceedings of the ACM International Conference on Multimedia. ACM, p 97–106

  45. Yoon J, Shiekhzadeh A, Nordin M (2012) The effect of load weight vs. pace on muscle recruitment during lifting. Appl Ergon 43(6):1044–1050

    Article  Google Scholar 

  46. Yu W, Yu I, Li Z, Wang X, Sun T, Lin H, Xie S (2012) Work-related injuries and musculoskeletal disorders among factory workers in a major city of China. Accid Anal Prev 48:457–463

    Article  Google Scholar 

  47. Zhang S, Hu H, Zhou H (2008) An interactive internet-based system for tracking upper limb motion in home-based rehabilitation. Med Biol Eng Comput 46(3):241–249

    Article  Google Scholar 

  48. Zheng H, Black ND, Harris ND (2005) Position-sensing technologies for movement analysis in stroke rehabilitation. Med Biol Eng Comput 43(4):413–420

    Article  Google Scholar 

Download references

Acknowledgments

The authors feel indebted to Cristian Bertuccioli and Andrea Marcomini for the aid provided during the experiments phases of this work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marco Roccetti.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Marfia, G., Roccetti, M. A practical computer based vision system for posture and movement sensing in occupational medicine. Multimed Tools Appl 76, 8109–8129 (2017). https://doi.org/10.1007/s11042-016-3469-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3469-0

Keywords

Navigation