Skip to main content

Haar Cascade Classifier and Lucas–Kanade Optical Flow Based Realtime Object Tracker with Custom Masking Technique

  • Conference paper
  • First Online:
Advances in Information and Communication Networks (FICC 2018)

Abstract

Computer vision has been proven a remarkable entity in modern computer science. Different applications of this field have been used on a regular basis. In this paper, we propose a new model for tracking real time object (i.e., car, human face, interior objects, arms, etc.) from video feed by providing training with HAAR features and also with the implementation of Lucas Kanade Optical Flow including Custom Masking technique. Object tracking has been considered to be very much useful in augmented reality, security, virtual reality, training with simulation, etc. In this research, we have trained our classifier of a specific object for detection purpose. Upon successful training of the classifier, a video footage has been passed into the classifier. Firstly, it detects region of interest (ROI) consisting of the object(s). Secondly, with necessary preprocessing techniques we have detected the contour area enclosing the object. Finding out the contour within the detected object(s) enabled us to create green color within the contour enclosing area. We only kept green contours and subtracted everything from the frames of the scene by Custom Masking technique. Finally, we tracked the object by trailing the green contours of the detected object(s) by Lucas Kanade Optical Flow. Our developed system is able to detect and track different object(s) from a video feed with the settings of less than or equal to 30 frames per second (FPS).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.li8bot.wordpress.com/2014/07/13/opencvpythonpart-3-tracking-object-using-colorspaces/.

  2. 2.

    https://www.udemy.com/master-computer-vision-with-opencv-in-python/.

References

  1. Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. (CSUR) 38(4), 13 (2006)

    Article  Google Scholar 

  2. Chau, D.P., Bremond, F., Thonnat, M.: Object tracking in videos: approaches and issues. arXiv preprint arXiv:1304.5212 (2013)

  3. Krause, J., Stark, M., Deng, J., Fei-Fei, L.: 3D object representations for fine-grained categorization. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 554–561 (2013)

    Google Scholar 

  4. Tamgade, S.N., Bora, V.R.: Motion vector estimation of video image by Pyramidal implementation of Lucas Kanade Optical flow. In: 2009 2nd International Conference on Emerging Trends in Engineering and Technology (ICETET). IEEE, pp. 914–917 (2009)

    Google Scholar 

  5. Rezaei, M.: Creating a Cascade of Haar-Like Classifiers: Step by Step. Obtenido de University of Auckland (2014). https://www.cs.auckland.ac.nz/~m.rezaei/Tutorials/Creating_a_Cascade_of_HaarLike_Classifiers_Step_by_Step.pdf

  6. Soo, S.: Object detection using Haar-cascade Classifier. Institute of Computer Science, University of Tartu (2014)

    Google Scholar 

  7. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1, p. I. IEEE (2001)

    Google Scholar 

  8. Ranftl, A., Alonso-Fernandez, F., Karlsson, S.: Face tracking using optical flow. In: 2015 International Conference of the Biometrics Special Interest Group (BIOSIG), pp. 1–5. IEEE (2015)

    Google Scholar 

  9. Abdat, F., Maaoui, C., Pruski, A.: Real time facial feature points tracking with Pyramidal Lucas–Kanade algorithm. In: The 17th IEEE International Symposium on Robot and Human Interactive Communication, 2008. RO-MAN 2008. IEEE. pp. 71–76 (2008)

    Google Scholar 

  10. Abisheva, B.B., Baisakov, B.M., Maratov, M.M.: Real-time facial feature point detection and tracking in a video sequence. Comput. Model. New Technol. 17(2), 48–52 (2013). http://www.cmnt.lv/en/on-line-journal/2013/2013-volume-17-2

  11. Reinius, S.: Object recognition using the OpenCV Haar cascade-classifier on the iOS platform (Dissertation) (2013). http://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-193282

  12. Kanan, C., Cottrell, G.W.: Color-to-grayscale: does the method matter in image recognition? PLoS ONE 7(1), e29740 (2012)

    Article  Google Scholar 

  13. Green, B.: Canny edge detection tutorial (2002). http://www.scribd.com/doc/40036113/Canny-Edge-Detection-Tutorial

  14. Patel, D., Upadhyay, S.: Optical flow measurement using Lucas Kanade method. Int. J. Comput. Appl. 61(10), 6–10 (2013)

    Google Scholar 

  15. Lucas, R.R.: Kanade in a Nutshell. http://www.inf.fu-berlin.de/inst/agki/rojas_home/documents/tutorials/Lucas–Kanade2.pdf

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Karishma Mohiuddin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mohiuddin, K., Alam, M.M., Das, A.K., Munna, M.T.A., Allayear, S.M., Ali, M.H. (2019). Haar Cascade Classifier and Lucas–Kanade Optical Flow Based Realtime Object Tracker with Custom Masking Technique. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Advances in Information and Communication Networks. FICC 2018. Advances in Intelligent Systems and Computing, vol 887. Springer, Cham. https://doi.org/10.1007/978-3-030-03405-4_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-03405-4_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-03404-7

  • Online ISBN: 978-3-030-03405-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics