Skip to main content

Identification of Cooking Preparation Using Motion Capture Data: A Submission to the Cooking Activity Recognition Challenge

  • Chapter
  • First Online:
Human Activity Recognition Challenge

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 199))

Abstract

The Cooking Activity Recognition Challenge tasked the competitors with recognizing food preparation using motion capture and acceleration sensors. This paper summarizes our submission to this competition, describing how we reordered the training data, relabeled it and how we handcrafted features for this dataset. Our classification pipeline first detected basic user actions (micro-activities); using them it recognized the recipe, and then used the recipe to refine the original micro-activity predictions. After the post-processing step using a Hidden Markov Model, we achieved the competition score of 95% on the training data with cross-validation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Brown, R.T., Komaiko, K.D., Shi, Y., Fung, K.Z., Boscardin, W.J., Au-Yeung, A., Tarasovsky, G., Jacob, R., Steinman, M.A.: Bringing functional status into a big data world: validation of national Veterans Affairs functional status data. PLoS One (2017). https://doi.org/10.1371/journal.pone.0178726

    Article  Google Scholar 

  2. Shen, J., Naeim, A.: Telehealth in older adults with cancer in the United States: The emerging use of wearable sensors. J. Geriatr. Oncol. (2017). https://doi.org/10.1016/j.jgo.2017.08.008

    Article  Google Scholar 

  3. Alia, S.S., Lago, P., Takeda, S., Adachi, K., Benaissa, B., Ahad, M.A.R., Inoue, S.: Summary of the cooking activity recognition challenge. Human activity recognition challenge, smart innovation, systems and technologies. Springer Nature, Berlin (2020)

    Google Scholar 

  4. Lago, P., Takeda, S., Kohei, A., Alia, S.S., Matsuki, M., Benaissa, B., Inoue, S., Charpillet, F.: Cooking activity dataset with macro and micro activities. IEEE DataPort (2020). https://doi.org/10.21227/hyzg-9m49

  5. Lago, P., Takeda, S., Alia, S.S., Adachi, K., Benaissa, B., Charpillet, F., Inoue, S.: A dataset for complex activity recognition with micro and macro activities in a cooking scenario’, preprint (2020)

    Google Scholar 

  6. Kubota, A., Iqbal, T., Shah, J.A., Riek, L.D.: Activity recognition in manufacturing: the roles of motion capture and sEMG+inertial wearables in detecting fine vs. gross motion. In: International Conference on Robotics and Automation (ICRA), Montreal, Canada (2019)

    Google Scholar 

  7. Mobark, M., Chuprat, S., Mantoro, T.: Improving the accuracy of complex activities recognition using accelerometer-embedded mobile phone classifiers. In: 2017 second international conference on informatics and computing (ICIC). Jayapura, Indonesia (2017)

    Google Scholar 

  8. Unity.: https://unity.com/

  9. scikit-learn.: https://scikit-learn.org/stable/

  10. Cvetković, B., Szeklicki, R., Janko, V., Lutomski, P., Luštrek, M.: Real-time activity monitoring with a wristband and a smartphone. Inf. Fus. 43, 77–93 (2018)

    Google Scholar 

  11. XGB.: https://xgboost.readthedocs.io/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Clément Picard .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Picard, C., Janko, V., Reščič, N., Gjoreski, M., Luštrek, M. (2021). Identification of Cooking Preparation Using Motion Capture Data: A Submission to the Cooking Activity Recognition Challenge. In: Ahad, M.A.R., Lago, P., Inoue, S. (eds) Human Activity Recognition Challenge. Smart Innovation, Systems and Technologies, vol 199. Springer, Singapore. https://doi.org/10.1007/978-981-15-8269-1_9

Download citation

Publish with us

Policies and ethics