Skip to main content
SpringerLink
Log in
Book cover

Proceedings of 3rd International Conference on Computing Informatics and Networks pp 333–345Cite as

A Review on Human Behavior Using Machine Learning for Ambient Assisted Living

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 167))

Abstract

With advances in machine learning, the evaluation and analysis of human behavior continue to attract large number of researchers around the globe. In this paper, we furnish an extensive overview of ways to identifying, analyzing and assessing human behavior, taking into account various behavioral characteristics. Most promising attributes and recognition techniques for vision and sensor-based approaches have been detailed. Most prominently used datasets for both vision- and sensor-based approaches have also been studied, keeping in mind the nature, source and applications of the same in the field of human behavior and activity detection. The study indicates that sensor-based approaches tend to have an upper hand because of the privacy breach caused by vision-based approaches, which accounts for the evolving usage of sensor-based monitoring for real-time behavior detection. Various other deep learning methods and their applications in the field of behavioral recognition have also been stated.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Abbreviations

AAL:

Ambient Assisted Living

ADL:

Activities of Daily Living

AmI:

Ambient Intelligence

DBN:

Deep Belief Network

EFS:

Evolution Fuzzy Systems

HBA:

Human Behaviour Analysis

HBU:

Human Behavioral awareness and Understanding

HMM:

Hidden Markov Model

HOHA:

Hollywood Human Action

SCC:

Source Code Control

SRBM:

Social Restricted Boltzmann Machine

SVM:

Support Vector Machines

TLN:

Temporary Logic Network

References

  1. Affendy AH, Nurilia A (2014) The influence of subconscious mind on human behavior. J Postgrad Curr Bus Res 2(2)

    Google Scholar 

  2. Salah AA, Gevers T, Sebe N, Vinciarelli A (2010) Challenges in human behavior understanding. In: Proceedings first international workshop, HBU, Springer, Istanbul, pp 1–12

    Google Scholar 

  3. Wang L, Hu W, Tan T (2003) Recent developments in human motion analysis. Pattern Recogn 36(3):585–601

    Article  Google Scholar 

  4. Weinland D, Ronfard R, Boyer E (2011) A survey of vision-based methods for action representation, segmentation and recognition. Comput Vis Image Underst 115(2):224–241

    Google Scholar 

  5. Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. ACM Comput Surv 38(4):13

    Google Scholar 

  6. Chen L, Hoey J, Nugent CD, Cook DJ, Yu Z (2012) Sensor-based activity recognition. IEEE Trans Syst Man Cybern Part C Appl Rev 42(6):790–808

    Google Scholar 

  7. Almeida A, Azkune G (2018) Predicting human behaviour with recurrent neural networks. Appl Sci 8(2):305

    Article  Google Scholar 

  8. Yordanova K (2011) Human behaviour modelling approach for intention recognition in ambient assisted living. In: Novais P, Preuveneers D, Corchado JM (eds) Ambient intelligence—software and applications. Advances in intelligent and soft computing, vol 92. Springer, Berlin, pp 247–257

    Google Scholar 

  9. Ramos C (2007) Ambient intelligence—a state of the art from artificial intelligence perspective. In: Neves J, Santos MF, Machado JM (eds) Progress in artificial intelligence. EPIA 2007. Lecture notes in computer science, vol 4874. Springer, Berlin, pp 285–295

    Google Scholar 

  10. Sun H, Florio VD, Gui N, Blondia C (2009) Promises and challenges of ambient assisted living systems. In: Sixth international conference on information technology, ITNG, IEEE, Las Vegas, Nevada, US, pp 1201–1207

    Google Scholar 

  11. Cook D, Das S (2007) How smart are our environments? An updated look at the state of the art. Pervasive Mob Comput 3(2):53–73

    Article  Google Scholar 

  12. Camarinha-Matos L, Vieira W (1999) Intelligent mobile agents in elderly care. Robot Auton Syst 27(2):59–75

    Article  Google Scholar 

  13. Costa R, Carneiro D, Novais P, Lima L, Machado J, Marques A, Neves J (2008) Ambient assisted living. In: 3rd symposium of ubiquitous computing and ambient intelligence, Springer, Berlin

    Google Scholar 

  14. Moeslund TB, Hilton A, Krüger V (2006) A survey of advances in vision-based human motion capture and analysis. Comput Vis Image Underst 104(2):90–126

    Article  Google Scholar 

  15. Poppe R (2010) A survey on vision-based human action recognition. Image Vis Comput 28(6):976–990

    Article  Google Scholar 

  16. Wu J, Osuntogun A, Choudhury T, Philipose M, Rehg J (2007) A scalable approach to activity recognition based on object use. In: IEEE 11th International Conference on Computer Vision (ICCV), vol 200. IEEE, Rio de Janeiro, pp 1–8

    Google Scholar 

  17. Turaga P, Chellappa R, Subrahmanian V, Udrea O (2008) Machine recognition of human activities: a survey. IEEE Trans Circuits Syst Video Technol 18(11):1473–1488

    Article  Google Scholar 

  18. Ji X, Liu H, Li Y, Brown D (2008) Visual-based view-invariant human motion analysis: a review. In: Lovrek I, Howlett R, Jain L (eds) Knowledge-based intelligent information and engineering systems, vol 5177. Lecture notes in computer science. Springer, Berlin, pp 741–748

    Chapter  Google Scholar 

  19. Monekosso DN, Remagnino P (2010) Behavior analysis for assisted living. IEEE Trans Autom Sci Eng 7:879–886

    Article  Google Scholar 

  20. Chaaraoui AA, Climent-Pérez P, Flórez-Revuelta F (2012) A review on vision techniques applied to human behaviour analysis for ambient-assisted living. Expert Syst Appl 39:10873–10888

    Article  Google Scholar 

  21. Brdiczka O, Crowley J, Reignier P (2009) Learning situation models in a smart home. IEEE Trans Syst Man Cybern B Cybern 39:56–63

    Article  Google Scholar 

  22. Chung P-C, Liu C-D (2008) A daily behavior enabled hidden markov model for human behavior understanding. Pattern Recogn 41:1572–1580

    Article  Google Scholar 

  23. Robertson N, Reid I (2006) A general method for human activity recognition in video. Comput Vis Image Underst 104:232–248

    Article  Google Scholar 

  24. Robertson N, Reid I, Brady M (2006) Behaviour recognition and explanation for video surveillance. In: The institution of engineering and technology conference on crime and security, pp 458–463

    Google Scholar 

  25. Yamamoto M, Mitomi H, Fujiwara F, Sato T (2006) Bayesian classification of task-oriented actions based on stochastic context-free grammar. In: 7th international conference on automatic Face and Gesture Recognition (FGR). IEEE, Southampton, UK, pp 317–322

    Google Scholar 

  26. Lafferty JD, McCallum A, Pereira FCN (2001) Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the eighteenth International Conference on Machine Learning (ICML ’01). Morgan Kaufmann Publishers Inc., San Francisco, pp 282–289

    Google Scholar 

  27. Fischer A (2015) Training restricted boltzmann machines. KI - KünstlicheIntelligenz 29(4):441–444

    Google Scholar 

  28. Van Kasteren T, Noulas A, Englebienne G, Krose B (2008) Accurate activity recognition in a home setting. In: UbiComp—proceedings of the 10th international conference on ubiquitous computing. ACM, Seoul, pp 1–9

    Google Scholar 

  29. Duong T, Bui H, Phung D, Venkatesh S (2005) Activity recognition and abnormality detection with the switching hidden semi-markov model. In: IEEE computer society conference on computer vision and pattern recognition CVPR1. IEEE, San Diego, pp 838–845

    Google Scholar 

  30. Nguyen N, Phung D, Venkatesh S, Bui H (2005) Learning and detecting activities from movement trajectories using the hierarchical hidden markov model. In: IEEE computer society conference on computer vision and pattern recognition, CVPR 2. IEEE, San Diego, pp 955–960

    Google Scholar 

  31. Hongeng S, Nevatia R (2001) Multi-agent event recognition. In: IEEE international conference on computer vision, eighth ICCV. IEEE, Vancouver, pp 84–91

    Google Scholar 

  32. Liu C-D, Chung Y-N, Chung P-C (2010) An interaction-embedded hmm framework for human behavior understanding: with nursing environments as examples. IEEE Trans Inf Technol Biomed 14:1236–1246

    Article  Google Scholar 

  33. https://www.di.ens.fr/~laptev/actions/. Accessed 23 March 2020

  34. https://www.csc.kth.se/cvap/actions/. Accessed 23 March 2020

  35. http://4drepository.inrialpes.fr/public/viewgroup/6. Accessed 23 March 2020

  36. https://ias.in.tum.de/dokuwiki/software/kitchen-activity-data. Accessed 23 March 2020

  37. https://ias.in.tum.de/dokuwiki/software/kitchen-activity-data. Accessed 24 March 2020

  38. http://velastin.dynu.com/MuHAVi-MAS. Accessed 24 March 2020

  39. https://www.crcv.ucf.edu/data/UCF_Sports_Action.php. Accessed 24 March 2020

  40. Bao L, Intille SS (2004) Activity recognition from user-annotated acceleration data. In: Proceedings of the international conference on pervasive computing. Springer, Berlin, pp 1–17

    Google Scholar 

  41. Pratama BY, Sarno R (2015) Personality classification based on Twitter text using Naive Bayes, KNN and SVM. In: International conference on data and software engineering, IEEE, Yogyakarta, Indonesia

    Google Scholar 

  42. Fatima I, Fahim M, Lee YK, Lee S (2013) A unified framework for activity recognition-based behavior analysis and action prediction in smart homes. Sensors 13(2):2682–2699

    Article  Google Scholar 

  43. Oliver N, Garg A, Horvitz E (2004) Layered representations for learning and inferring office activity from multiple sensory channels. Comput Vis Image Underst 96:163–180

    Article  Google Scholar 

  44. Liao W, Zhang W, Zhu Z, Ji Q (2005) A real-time human stress monitoring system using dynamic bayesian network. In: IEEE computer society conference on Computer Vision and Pattern Recognition (CVPR’05), vol 3. IEEE, San Diego, pp 70

    Google Scholar 

  45. Ordóñez FJ, Iglesias JA, De Toledo P, Ledezma A, Sanchis A (2013) Online activity recognition using evolving classifiers. Expert Syst Appl 40:1248–1255

    Article  Google Scholar 

  46. Van Kasteren T, Noulas A, Englebienne G, Kröse B (2008) Accurate activity recognition in a home setting. In: Proceedings of the 10th international conference on ubiquitous computing. ACM, New York, pp 1–9

    Google Scholar 

  47. Bao L, Intille S (2004) Activity recognition from user-annotated acceleration data. Pervasive Comput 3001:17

    Google Scholar 

  48. Podgorelec V, Kokol P, Stiglic B et al (2002) J Med Syst 26(5):445–463

    Article  Google Scholar 

  49. Safavian SR, Landgrebe D (1991) A survey of decision tree classifier methodology. IEEE Trans Syst Man Cybern 21(3):660–674

    Article  MathSciNet  Google Scholar 

  50. Ordonez F, Iglesias J, De Toledo P, Ledezma Espino A, de Miguel Araceli S (2013) Online activity recognition using evolving classifiers. Int J Expert Syst Appl 1248–1255

    Google Scholar 

  51. Lones M, Smith S, Alty J, Lacy S, Possin K, Jamieson D, Tyrrell A (2013) Evolving classifiers to recognise the movement characteristics of Parkinson’s disease patients. IEEE Trans Evol Comput 18:559–576

    Google Scholar 

  52. Sutton C, Mccallum A (2012) An introduction to conditional random fields. Foundations and trends in machine learning, pp 267–373 (Now Publishers)

    Google Scholar 

  53. Choi S, Kim E, Oh S (2013) Human behavior prediction for smart homes using deep learning. In: Proceedings—IEEE International workshop on robot and human interactive communication. IEEE, Gyeongju, pp 173–179

    Google Scholar 

  54. Phan N, Dou D, Brigitte P, Kil D (2016) A deep learning approach for human behavior prediction with explanations in health social networks: social restricted Boltzmann machine (SRBM+). Social network analysis and mining. Springer-Verlag Wien, Austria

    Google Scholar 

  55. Paul E, Krishna Mohan C (2017) Human behavioral analysis using evolutionary algorithms and deep learning. Hybrid intelligence for image analysis and understanding. Wiley, Hoboken

    Google Scholar 

  56. Aghdam H, Heravi E (2017) Guide to convolutional neural networks: a practical application to traffic-sign detection and classification. Springer, Berlin

    Google Scholar 

  57. Du K-L, Swamy MNS (2019) Recurrent neural networks. Neural networks and statistical learning. Springer, Heidelberg

    Google Scholar 

  58. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 1735–1780

    Google Scholar 

  59. Gers FA, Schmidhuber J, Cummins F (1999) Learning to forget: continual prediction with LSTM. In: 9th International Conference on Artificial Neural Networks (ICANN), IET, Edinburgh, UK

    Google Scholar 

  60. Cardinaux F, Brownsell S, Hawley M, Bradley D (2008) Modelling of behavioural patterns for abnormality detection in the context of lifestyle reassurance. Progress in pattern recognition, image analysis and applications. Lecture notes in computer science, vol 5197. Springer, Heidelberg, pp 243–251

    Google Scholar 

  61. Hara K, Omori T, Ueno R (2002) Detection of unusual human behavior in intelligent house. In: Proceedings of the 2002 12th IEEE workshop on neural networks for signal processing. IEEE, Martigny, pp 697–706

    Google Scholar 

  62. Hayes T, Pavel M, Kaye J (2008) An approach for deriving continuous health assessment indicators from in-home sensor data. In: Technology and aging: selected papers from the 2007 international conference on technology and aging, vol 21. Ios Press, Amsterdam, pp 130–137

    Google Scholar 

  63. Jain G, Cook D, Jakkula V (2006) Monitoring health by detecting drifts and outliers for a smart environment inhabitant. In: Proceedings of the international conference on smart homes and health telematics. Springer, Berlin, pp 1–8

    Google Scholar 

  64. Mahmoud S, Akhlaghinia M, Lotfi A, Langensiepen C (2011) Trend modelling of elderly lifestyle within an occupancy simulator. In: UkSim 13th international conference on computer modelling and simulation. UkSim, Cambridge, pp 156–161

    Google Scholar 

  65. Park K, Lin Y, Metsis V, Le Z, Makedon F (2010) Abnormal human behavioral pattern detection in assisted living environments. In: Proceedings of the 3rd international conference on pervasive technologies related to assistive environments. ACM, New York, pp 9:1–9:8

    Google Scholar 

  66. Virone G, Sixsmith A (2008) Monitoring activity patterns and trends of older adults. In: 30th Annual international conference of the IEEE engineering in medicine and biology society. IEEE, pp 2071–2074

    Google Scholar 

  67. Wood A, Stankovic J, Virone G, Selavo L, He Z, Cao Q et al (2008) Contextaware wireless sensor networks for assisted living and residential monitoring. IEEE Network 22:26–33

    Article  Google Scholar 

  68. Hara K, Omori T, Ueno R (2002) Detection of unusual human behavior in intelligent house. In: Proceedings of the 12th IEEE workshop on neural networks for signal processing. IEEE, Martigny, pp 697–706

    Google Scholar 

  69. https://sites.google.com/site/tim0306/datasets

  70. https://courses.media.mit.edu/2004fall/mas622j/04.projects/home

Download references

Author information

Authors and Affiliations

  1. Bharati Vidyapeeth’s College of Engineering, New Delhi, India

    Vanita Jain, Nishant Khurana & Sameer Bhardwaj

Authors
  1. Vanita Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nishant Khurana
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sameer Bhardwaj
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vanita Jain .

Editor information

Editors and Affiliations

  1. Scientific Network for Innovation and Research Excellence, Machine Intelligence Research Labs (MIR Labs), Auburn, WA, USA

    Ajith Abraham

  2. Tijuana Institute of Technology, Tijuana, Mexico

    Oscar Castillo

  3. Bhagwan Parshuram Institute of Technology, New Delhi, India

    Deepali Virmani

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jain, V., Khurana, N., Bhardwaj, S. (2021). A Review on Human Behavior Using Machine Learning for Ambient Assisted Living. In: Abraham, A., Castillo, O., Virmani, D. (eds) Proceedings of 3rd International Conference on Computing Informatics and Networks. Lecture Notes in Networks and Systems, vol 167. Springer, Singapore. https://doi.org/10.1007/978-981-15-9712-1_28

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-9712-1_28

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-9711-4

  • Online ISBN: 978-981-15-9712-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation