Skip to main content
SpringerLink
Log in

An optimized hybrid deep learning model using ensemble learning approach for human walking activities recognition

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Recent advancements in edge computing devices motivate us to develop a sustainable and reliable technique for multiple gait activities recognition using wearable sensors. This research work presents the multitask human walking activities recognition using human gait patterns. Human locomotion is defined as the change in the joint angles of hip, knee and ankle. To achieve the aforementioned objective, the data are collected for 50 subjects in a controlled laboratory environment using inertial measurement unit (IMU) sensors for 7 different activities. The IMU sensor is placed on the chest, left thigh, and right thigh. Total 100 samples are collected for all 7 activities. The sampling rate considered was 50 Hz. Following 7 walking activities are performed for all the 50 subjects: (i) natural walk, (ii) standing, (iii) climbing stairs, (iv) cycling, (v) jogging, (vi)running, (vii) knees bending(Crouching). The major contribution of this research paper is the design of four hybrid deep learning models to provide the generic activity recognition framework and tune the performance. The following combination of the deep learning model is designed for the classification of gait activities, namely, convolution neural network–long short-term memory (CNN–LSTM), CNN–gated recurrent unit (CNN–GRU), LSTM–CNN and LSTM–GRU. To support edge computing, the ensemble learning is utilized to optimized the model size. The proposed ensemble learning-based hybrid deep learning framework has provided a promising classification accuracy of 99.34% over other models. The other models namely CNN, LSTM, GRU, CNN–LSTM, LSTM–CNN, CNN–GRU, GRU–CNN have achieved 97.26%, 90.67%, 77.38%, 97.83%, 94.35%, 97.64%, 96.98% accuracy, respectively, on our HAG data set. The proposed technique is also validated on MHEALTH data set for comparative analysis. The hybrid deep learning model in combination with ensemble learning has outperformed other techniques. The optimized code can be used on small computation devices for walking activity recognition.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Ahmed MH, Sabir AT (2017) Human gender classification based on gait features using kinect sensor. In: 2017 3rd IEEE International Conference on Cybernetics (Cybconf). IEEE, pp 1–5

  2. Semwal VB, Raj M, Nandi GC (2015) Biometric gait identification based on a multilayer perceptron. Robot Auton Syst 65:65–75

    Article  Google Scholar 

  3. Semwal V. B (2017) Data driven computational model for bipedal walking and push recovery. arXiv:1710.06548

  4. Semwal VB, Katiyar SA, Chakraborty R, Nandi GC (2015) Biologically-inspired push recovery capable bipedal locomotion modeling through hybrid automata. Robot Auton Syst 70:181–190

    Article  Google Scholar 

  5. Semwal VB, Bhushan A, Nandi G (2013) Study of humanoid push recovery based on experiments. In: 2013 International Conference on Control, Automation, Robotics and Embedded Systems (CARE). IEEE, pp 1–6

  6. Guo Y, Wu X, Shen L, Zhang Z, Zhang Y (2019) Method of gait disorders in Parkinson’s disease classification based on machine learning algorithms. In: 2019 IEEE 8th Joint International Information Technology and Artificial Intelligence Conference (ITAIC). IEEE, pp 768–772

  7. Patil P, Kumar KS, Gaud N, Semwal VB (2019) Clinical human gait classification: extreme learning machine approach. In: 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT). IEEE, pp 1–6

  8. Semwal VB, Nandi GC (2016) Generation of joint trajectories using hybrid automate-based model: a rocking block-based approach. IEEE Sens J 16(14):5805–5816

    Article  Google Scholar 

  9. Nandi GC, Semwal VB, Raj M, Jindal A (2016) Modeling bipedal locomotion trajectories using hybrid automata. In: 2016 IEEE Region 10 Conference (TENCON). IEEE, pp 1013–1018

  10. Li X, Yuan Z, Zhao J, Du B, Liao X, Humar I (2021) Edge-learning-enabled realistic touch and stable communication for remote haptic display. IEEE Netw 35(1):141–147

    Article  Google Scholar 

  11. Gupta JP, Polytool D, Singh N, Semwal VB (2014) Analysis of gait pattern to recognize the human activities. IJIMAI 2(7):7–16

    Article  Google Scholar 

  12. Semwal VB, Nandi GC (2015) Toward developing a computational model for bipedal push recovery-a brief. IEEE Sens J 15(4):2021–2022

    Article  Google Scholar 

  13. Hsu W-C, Sugiarto T, Lin Y-J, Yang F-C, Lin Z-Y, Sun C-T, Hsu C-L, Chou K-N (2018) Multiple-wearable-sensor-based gait classification and analysis in patients with neurological disorders. Sensors 18(10):3397

    Article  Google Scholar 

  14. Mekruksavanich S, Jitpattanakul A, Youplao P, Yupapin P (2020) Enhanced hand-oriented activity recognition based on smartwatch sensor data using LSTMs. Symmetry 12(9):1570

    Article  Google Scholar 

  15. Kwapisz J, Weiss G, Moore S (2010) Activity recognition using cell phone accelerometers. SigKDD Explor Newslett 12(101145):1964897–1964918

    Google Scholar 

  16. Papavasileiou I, Zhang W, Wang X, Bi J, Zhang L, Han S (2017) Classification of neurological gait disorders using multi-task feature learning. In: 2017 IEEE/ACM International Conference on Connected Health: Applications, Systems And Engineering Technologies (CHASE). IEEE, pp 195–204

  17. Semwal VB, Gaud N, Nandi G (2019) Human gait state prediction using cellular automata and classification using ELM. In: Machine Intelligence and Signal Analysis. Springer, pp 135–145

  18. Semwal VB, Singha J, Sharma PK, Chauhan A, Behera B (2017) An optimized feature selection technique based on incremental feature analysis for bio-metric gait data classification. Multimed Tools Appl 76(22):24457–24475

    Article  Google Scholar 

  19. Semwal VB, Kumar C, Mishra PK, Nandi GC (2016) Design of vector field for different subphases of gait and regeneration of gait pattern. IEEE Trans Autom Sci Eng 15(1):104–110

    Article  Google Scholar 

  20. Chen Z, Li G, Fioranelli F, Griffiths H (2018) Personnel recognition and gait classification based on multistatic micro-Doppler signatures using deep convolutional neural networks. IEEE Geosci Remote Sens Lett 15(5):669–673

    Article  Google Scholar 

  21. Semwal VB, Mondal K, Nandi GC (2017) Robust and accurate feature selection for humanoid push recovery and classification: deep learning approach. Neural Comput Appl 28(3):565–574

    Article  Google Scholar 

  22. Poschadel N, Moghaddamnia S, Alcaraz JC, Steinbach M, Peissig J (2017) A dictionary learning based approach for gait classification. In: 2017 22nd International Conference on Digital Signal Processing (DSP). IEEE, pp 1–4

  23. Semwal VB, Chakraborty P, Nandi GC (2015) Less computationally intensive fuzzy logic (type-1)-based controller for humanoid push recovery. Robot Auton Syst 63:122–135

    Article  Google Scholar 

  24. Wang X, Zhang J, Yan WQ (2019) Gait recognition using multichannel convolution neural networks. Neural Comput Appl 32:14275–14285

    Article  Google Scholar 

  25. V B, Gupta V, Semwal VB (2021) Wearable sensor based pattern mining for human activity recognition: deep learning approach. Ind Robot 48(1)

  26. Gupta A, Semwal VB (2020) Multiple task human gait analysis and identification: ensemble learning approach. In: Emotion and information processing. Springer, pp 185–197

  27. Wang X, Yan K (2020) Gait classification through CNN-based ensemble learning. Multimed Tools Appl 80:1565–1581

    Article  Google Scholar 

  28. Sun L, Yuan Y-X, Zhang Q, Wu Y-C (2018) Human gait classification using micro-motion and ensemble learning. In: IGARSS 2018–2018 IEEE International Geoscience And Remote Sensing Symposium. IEEE, pp 6971–6974

  29. Wang X, Yan WQ (2020) Cross-view gait recognition through ensemble learning. Neural Comput Appl 32(11):7275–7287

    Article  Google Scholar 

  30. Shu J, Hamano F, Angus J (2014) Application of extended Kalman filter for improving the accuracy and smoothness of Kinect skeleton-joint estimates. J Eng Math 88(1):161–175

    Article  MathSciNet  Google Scholar 

  31. Banos O, Villalonga C, Garcia R, Saez A, Damas M, Holgado-Terriza JA, Lee S, Pomares H, Rojas I (2015) Design, implementation and validation of a novel open framework for agile development of mobile health applications. Biomed Eng Online 14(2):1–20

    Google Scholar 

  32. Banos O, Garcia R, Holgado-Terriza JA, Damas M, Pomares H, Rojas I, Saez A, Villalonga C (2014) Mhealthdroid: a novel framework for agile development of mobile health applications. In: International Workshop on Ambient Assisted Living. Springer, pp 91–98

Download references

Acknowledgements

The author(s) would like to thank all the participants who have allowed us to capture the data using a wearable device. The author(s) would like to express thanks to Human locomotion analysis laboratory of the Institute of Technology Gopeshwar, Uttarakhand and Human motion capturing and analysis unit of MANIT Bhopal for providing the opportunity to collect data and providing the computing facility.

Funding

This paper is the results of Project Funded by SERB, DST Govt. of India under the schema of Early career award to Dr. Vijay Bhaskar Semwal, MANIT Bhopal, DST No: ECR/2018/000203 dated on 04/06/2019.

Author information

Authors and Affiliations

  1. Maulana Azad National Institute of Technology, Bhopal, Madhya Pradesh, India

    Vijay Bhaskar Semwal & Anjali Gupta

  2. VIT, Bhopal, Madhya Pradesh, India

    Praveen Lalwani

Authors
  1. Vijay Bhaskar Semwal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anjali Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Praveen Lalwani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vijay Bhaskar Semwal.

Ethics declarations

Conflict of interest

The authors declare there is no conflict regarding this research paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The work is Funded by SERB, DST, Govt. of India to Dr. Vijay Bhaskar Semwal under Early Career Award(ECR) with DST No: ECR/2018/000203 dated 04-June-2019.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Semwal, V.B., Gupta, A. & Lalwani, P. An optimized hybrid deep learning model using ensemble learning approach for human walking activities recognition. J Supercomput 77, 12256–12279 (2021). https://doi.org/10.1007/s11227-021-03768-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-021-03768-7

Keywords

Search

Navigation