Skip to main content
Log in

Object recognition and 3D reconstruction of occluded objects using binocular stereo

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Object recognition is one of the key areas in computer vision which comprises of object detection, recognition and reconstruction. The image of the object to be recognized is captured using camera and matched with pre-stored templates of the model object. Recognizing 3D view of the object is difficult in the presence of object occlusion and view-point invariants. This paper focuses on the problem of occlusion and provides a solution for handling self and inter-object occlusion. Self-occlusion has been addressed by the suitable calibration of the cameras and a novel algorithm has been proposed to address inter-object occlusion. A modified geometric mapping technique has been proposed for the 3D reconstruction of the recognized object. Real-time setup has been used to test the proposed solutions to identify objects of multiple shapes and sizes. The results show that the performance of the algorithm was superior and enabled recognition of objects with 80% occlusion or less.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Allen, P.K.: Robotic Object Recognition Using Vision and Touch. Kluwer Academic Publishers, Boston (1987)

    Book  Google Scholar 

  2. Yang, T., Zhang, Y., Yu, R., Zhang, X., Chen, T., Ran, L., Song, Z., Ma, W.: Simultaneous active camera array focus plane estimation and occluded moving object imaging. Image Vis. Comput. 32, 510–521 (2014)

    Article  Google Scholar 

  3. Zeeshan Zia, M., Stark, M., Schindler, K.: Explicit occlusion modeling for 3D object representations. In: IEEE Conference on Computer Vision and Pattern Recognition (2013)

  4. Priya, L., Anand, S., Uma, K.: Detection of occluded objects under backlighting. IJCSE, ISBN: 9788192958022 (2016)

  5. Toshev, A., Taskar, B., Daniilidis, K.: Object detection via boundary structure segmentation. In: CVPR (2010)

  6. Wu, B.-F., et al.: A relative-discriminative-histogram-of-oriented-gradients-based particle filter approach to vehicle occlusion handling and tracking. IEEE Trans. Ind. Electron. 61(8), 4228–4237 (2014)

    Article  Google Scholar 

  7. Leibe, B., Leonardis, A., Schiele, B.: Robust object detection with interleaved categorization and segmentation. IJCV 77(1–3), 259–289 (2008)

    Article  Google Scholar 

  8. Shah, SAA.: A novel local surface description for automatic 3D object recognition in low resolution cluttered scenes. In: ICCV 2013, IEEE Xplore (2013)

  9. Gao, T., Packer, B., Koller, D.: A segmentation-aware object detection model with occlusion handling. In: CVPR (2011)

  10. Joglekar, J., Gedam, S.S.: Area/based stereo matching technique using Hausdorff distance and texture analysis, PIA11. International Archives of Photogrammetry

  11. http://www.techbriefs.com/component/content/article/ntb/features/feature-articles/14925

  12. Suzuki, M.T., Yaginuma, Y., Shimizu, Y.: A partial shape matching technique for 3D model retrieval systems. In: SIGGRAPH 2005, The 32nd International Conference on Computer Graphics and Interactive Techniques ISBN:1-59593-100-7, ACM-ON:428052, 2005

  13. Zhang, S., Qu, X., Ma, S., Yang, Z., Kong, L.: A dense stereo matching algorithm based on triangulation. J. Comput. Inf. Syst. 8(1), 283–292 (2012)

    Google Scholar 

  14. Niknejad, H.T., Kawano, T., Oishi, Y., Mita, S.: Occlusion handling using discriminative model of trained part templates and conditional random field. In: IEEE Intelligent Vehicles Symposium (IV) June 23–26, 2013. Gold Coast, Australia (2013)

  15. Sabourin, C., Moreno, R., Madani, K.: A machine learning based intelligent vision system for autonomous object detection and recognition. Appl. Intell. 40(2), 358–375 (2014)

    Article  Google Scholar 

  16. Torralba, A., Murphy, K.P., Freeman, W.T.: Sharing features: efficient boosting procedures for multiclass object detection. In: CVPR (2004)

  17. Lowe, D.: Distinctive image features from scale-invariant keypoints. In: IJCV (2004)

  18. Hinterstoisser, S., Lepetit, V., Ilic, S., Fua, P., Navab, N.: Dominant orientation templates for real-time detection of texture-less objects. In: CVPR (2010)

  19. Borgefors, G.: Hierarchical chamfer matching: a parametric edge matching algorithm. PAMI 10(6), 849–865 (1988)

    Article  Google Scholar 

  20. Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47(1), 7–42 (2002)

    Article  MATH  Google Scholar 

  21. Okada, R.: Discriminative generalized hough transform for object detection. In: ICCV (2009)

  22. Chandel, H., Bahra University Waknaghat, Shimla, Vatta, S.: Occlusion detection and handling: a review. Int. J. Comput. Appl. 120(10), 0975–8887 (2015)

  23. Amit, Y., Geman, D., Fan, X.: A coarse-to-fine strategy for multiclass shape detection. TPAMI 26(12), 1606–1621 (2004)

    Article  Google Scholar 

  24. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Conference on Computer Vision and Pattern Recognition (2001)

  25. Priya, L., Anand, S.: Shape based object detection for partially occluded objects under front lighting techniques. In: 2015 IEEE European Modeling Symposium, 978-1-5090-0206-1/15. IEEE, doi:10.1109/EMS.2015.27 (2015)

  26. Loncaric, S.: A survey of shape analysis techniques. Pattern Recognit. 31(8), 983–1001 (1998)

  27. Gandhi, C., Viradiya, J.: A survey on occlusion detection and handling. Int. J. Adv. Eng. Res. Dev. 3(2), 203–209 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to L. Priya.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Priya, L., Anand, S. Object recognition and 3D reconstruction of occluded objects using binocular stereo. Cluster Comput 21, 29–38 (2018). https://doi.org/10.1007/s10586-017-0891-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-017-0891-7

Keywords

Navigation