Gisela Miranda Difini
ABSTRACT
Human pose estimation is an important field of Computer Vision that aims to predict poses of individuals from videos and images. It has been used in many different areas including human-computer interaction, motion analysis, surveillance, action prediction, action correction, augmented reality, virtual reality, and healthcare. This review is focused on the most significant contributions in human pose estimation for training assistance. Executing movements correctly is crucial in all kinds of physical activities, both to increase performance and reduce risk of injury. Human pose estimation is poised to help athletes better analyse the quality of their movements. The systematic review study was conducted in five databases including articles from January 2011 to March 2021. The initial search resulted in 129 articles, of which 8 were selected after applying the filtering criteria. Moreover this study presents the challenges related to pose estimation, which pose estimation methods have been used in recent years, in which specific activities the selected articles have focused on, and a taxonomy of human pose estimation methods.
- Reza Afrouzian, Hadi Seyedarabi, and Shohreh Kasaei. 2016. Pose estimation of soccer players using multiple uncalibrated cameras. Multimedia Tools and Applications 75, 12 (2016), 6809--6827.Google Scholar
Digital Library
- Serge Belongie, Jitendra Malik, and Jan Puzicha. 2002. Shape matching and object recognition using shape contexts. IEEE transactions on pattern analysis and machine intelligence 24, 4 (2002), 509--522.Google ScholarDigital Library
- Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2019. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. IEEE transactions on pattern analysis and machine intelligence 43, 1 (2019), 172--186.Google ScholarDigital Library
- Qi Dang, Jianqin Yin, Bin Wang, and Wenqing Zheng. 2019. Deep learning based 2d human pose estimation: A survey. Tsinghua Science and Technology 24, 6 (2019), 663--676.Google ScholarCross Ref
- Felix Escalona, Ester Martinez-Martin, Edmanuel Cruz, Miguel Cazorla, and Francisco Gomez-Donoso. 2019. EVA: EVAluating at-home rehabilitation exercises using augmented reality and low-cost sensors. Virtual Reality (2019), 1--15.Google ScholarDigital Library
- Hao-Shu Fang, Shuqin Xie, Yu-Wing Tai, and Cewu Lu. 2017. Rmpe: Regional multi-person pose estimation. In Proceedings of the IEEE International Conference on Computer Vision (ICCV). 2334--2343.Google ScholarCross Ref
- Yiwen Gu, Shreya Pandit, Elham Saraee, Timothy Nordahl, Terry Ellis, and Margrit Betke. 2019. Home-Based Physical Therapy with an Interactive Computer Vision System. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops.Google ScholarCross Ref
- Hong Guo, Shanchen Zou, Chuying Lai, and Hongxin Zhang. 2021. PhyCoVIS: A visual analytic tool of physical coordination for cheer and dance training. Computer Animation and Virtual Worlds 32, 1 (2021), e1975.Google ScholarCross Ref
- Gang Hua and Ying Wu. 2004. Multi-scale visual tracking by sequential belief propagation. In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004., Vol. 1. IEEE, I--I.Google Scholar
- Hiteshi Jain and Gaurav Harit. 2017. Detecting missed and anomalous action segments using approximate string matching algorithm. In National Conference on Computer Vision, Pattern Recognition, Image Processing, and Graphics. Springer, 101--111.Google Scholar
- Angjoo Kanazawa, Michael J Black, David W Jacobs, and Jitendra Malik. 2018. End-to-end recovery of human shape and pose. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7122--7131.Google ScholarCross Ref
- Soudeh Kasiri, Clinton Fookes, Sridha Sridharan, and Stuart Morgan. 2017. Finegrained action recognition of boxing punches from depth imagery. Computer Vision and Image Understanding 159 (2017), 143--153.Google ScholarCross Ref
- Naimat Ullah Khan and Wanggen Wan. 2018. A review of human pose estimation from single image. In 2018 International Conference on Audio, Language and Image Processing(ICALIP). IEEE, 230--236.Google ScholarCross Ref
- Barbara Kitchenham, O Pearl Brereton, David Budgen, Mark Turner, John Bailey, and Stephen Linkman. 2009. Systematic literature reviews in software engineering-a systematic literature review. Information and software technology 51, 1 (2009), 7--15.Google Scholar
- Wee Kheng Leow, Ruixuan Wang, and Hon Wai Leong. 2012. 3-D-2-D spatiotemporal registration for sports motion analysis. Machine Vision and Applications 23, 6 (2012), 1177--1194.Google ScholarCross Ref
- Jen Jui Liu, Jacob Newman, and Dah-Jye Lee. 2020. Body Motion Analysis for Golf Swing Evaluation. In International Symposium on Visual Computing. Springer, 566--577.Google Scholar
- Yi Liu, Ying Xu, and Shao-bin Li. 2018. 2-D human pose estimation from images based on deep learning: a review. In 2018 2nd IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC). IEEE, 462--465.Google Scholar
- Dushyant Mehta, Srinath Sridhar, Oleksandr Sotnychenko, Helge Rhodin, Mohammad Shafiei, Hans-Peter Seidel, Weipeng Xu, Dan Casas, and Christian Theobalt. 2017. Vnect: Real-time 3d human pose estimation with a single rgb camera. ACM Transactions on Graphics (TOG) 36, 4 (2017), 1--14.Google ScholarDigital Library
- Thomas B Moeslund, Adrian Hilton, Volker Krüger, and Leonid Sigal. 2011. Visual analysis of humans. Springer.Google Scholar
- Nikolaos Sarafianos, Bogdan Boteanu, Bogdan Ionescu, and Ioannis A Kakadiaris. 2016. 3d human pose estimation: A review of the literature and analysis of covariates. Computer Vision and Image Understanding 152 (2016), 1--20.Google ScholarDigital Library
- Pourya Shamsolmoali, Masoumeh Zareapoor, Huiyu Zhou, and Jie Yang. 2020. AMIL: Adversarial Multi-instance Learning for Human Pose Estimation. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 16, 1s (2020), 1--23.Google ScholarDigital Library
- Dan Shi and Xin Jiang. 2021. Sport training action correction by using convolutional neural network. Internet Technology Letters 4 (2021), e261.Google ScholarCross Ref
- Cristian Sminchisescu. 2008. 3D Human Motion Analysis in Monocular Video: Techniques and Challenges. Springer Netherlands, 185--211.Google Scholar
- Atima Tharatipyakul, Kenny TW Choo, and Simon T Perrault. 2020. Pose Estimation for Facilitating Movement Learning from Online Videos. In Proceedings of the International Conference on Advanced Visual Interfaces. 1--5.Google ScholarDigital Library
- Jianbo Wang, Kai Qiu, Houwen Peng, Jianlong Fu, and Jianke Zhu. 2019. AI coach: Deep human pose estimation and analysis for personalized athle tictraining assistance. In Proceedings of the 27th ACM International Conference on Multimedia. 374--382.Google ScholarDigital Library
- Xiaolin Wei, Peizhao Zhang, and Jinxiang Chai. 2012. Accurate realtime full-body motion capture using a single depth camera. ACM Transactions on Graphics (TOG) 31, 6 (2012), 1--12.Google ScholarDigital Library
- Barry D Wilson. 2008. Development in video technology for coaching. Sports Technology 1, 1 (2008), 34--40.Google ScholarCross Ref
- Ce Zheng, Wenhan Wu, Taojiannan Yang, Sijie Zhu, Chen Chen, Ruixu Liu, Ju Shen, Nasser Kehtarnavaz, and Mubarak Shah. 2020. Deep Learning-Based Human Pose Estimation: A Survey. arXiv preprint arXiv:2012.13392 (2020).Google Scholar
- Jiaqi Zou, Bingyi Li, Luyao Wang, Yue Li, Xiangyuan Li, Rongjia Lei, and Songlin Sun. 2018. Intelligent Fitness Trainer System Based on Human Pose Estimation. In International Conference On Signal And Information Processing, Networking And Computers. Springer, 593--599.Google Scholar
Index Terms
- Human Pose Estimation for Training Assistance: a Systematic Literature Review
Recommendations
Recent Advances of Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspective
Estimation of the human pose from a monocular camera has been an emerging research topic in the computer vision community with many applications. Recently, benefiting from the deep learning technologies, a significant amount of research efforts have ...
Semi- and weakly-supervised human pose estimation
Highlights- Human pose estimation is achieved by semi- and weakly-supervised learning.
- Semi-...
Graphical abstractDisplay Omitted
AbstractFor human pose estimation in still images, this paper proposes three semi- and weakly-supervised learning schemes. While recent advances of convolutional neural networks improve human pose estimation using supervised training data, our ...
A survey of human pose estimation
Summarization of methods on human pose estimation in recent years.Conclusion of the traditional human pose estimation methods.Illustrated based on a two-stage framework.Comprehensive comparisons are given based on the open source methods. Estimating ...
Comments