Skip to main content
SpringerLink
Log in

License plate detection for multi-national vehicles – a generalized approach

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

License plate detection for vehicle identification is one of the key problems for traffic surveillance in urban areas. Most of the existing methods that can handle multiple license plates are country-specific as color information has been typically targeted. In this paper, we propose a real-time multiple license plate detection method feasible for multi-national vehicles having variable colors, sizes and geometrical attributes. A region-of-interest is initially identified for each vehicle using a fuzzy inference system based on the salient feature of its rear lights as license plates generally exist in a vicinity of these lights. Due to the abundance of edges within the license plate region, a local recursive analysis approach is utilized to locate the license plate candidate within each region-of-interest after tilt correction using a rear-light alignment technique. To verify the detected region as a true license plate, a unique combination of local image features is used to achieve high precision. The proposed method has been tested on 2200 images taken during various weather and illumination conditions to detect 5379 license plates out of 5945 available vehicles with 90.5% accuracy. The proposed approach outperforms the conventional and deep learning methods to achieve superior performance with the ability of being applied to multi-national vehicles.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Asif MR, Chun Q, Hussain S, Fareed MS (2016) Multiple license plate detection for Chinese vehicles in dense traffic scenarios. IET Intell Transp Syst 10(8):535–544

    Article  Google Scholar 

  2. Asif MR, Chun Q, Hussain S, Fareed MS, Khan S (2017) Multinational vehicle license plate detection in complex backgrounds. J Vis Commun Image Represent 46:176–186

    Article  Google Scholar 

  3. Bai X, Zhang T, Wang C, El-Latif AAA, Niu X (2013) A fully automatic player detection method based on one-class SVM. IEICE Trans Inf Syst E96.D(2):387–391

    Article  Google Scholar 

  4. Chao G, Kunfeng W, Yanjie Y, Zhengxi L (2016) Vehicle license plate recognition based on extremal regions and restricted Boltzmann machines. IEEE Trans Intell Transp Syst 17(4):1096–1107

    Article  Google Scholar 

  5. Chu J, Guo Z, Leng L (2018) Object detection based on multi-layer convolution feature fusion and online hard example mining. IEEE Access 6:19959–19967

    Article  Google Scholar 

  6. Jing H, He X, Han Q, El-Latif AAA, Niu X (2014) Saliency detection based on integrated features. Neurocomputing 129:114–121

    Article  Google Scholar 

  7. Jingyu D, Sanyuan Z, Xiuzi Y, Yin Z (2015) Chinese license plate localization in multi-lane with complex background based on concomitant colors. IEEE Intell Transp Syst Mag 7(3):51–61

    Article  Google Scholar 

  8. Jo A, Jang GJ, Han B (2015) Occlusion detection using horizontally segmented windows for vehicle tracking. Multimed Tools Appl 74(1):227–243. https://doi.org/10.1007/s11042-013-1846-5

    Article  Google Scholar 

  9. Kang YK, Kim H, Heo G, Song SY (2017) Diagnosis of feedwater heater performance degradation using fuzzy inference system. Expert Syst Appl 69:239–246

    Article  Google Scholar 

  10. Kim SG, Jeon HG, Koo HI (2017) Deep-learning-based license plate detection method using vehicle region extraction. Electron Lett 53(15):1034–1036

    Article  Google Scholar 

  11. Le, TS, Tran VN, Hamamoto K (2014) A robust and flexible license plate detection method. Proc IEEE Intl Conf Advanced Technologies Communication, p 326-331

  12. Li H, Yang R, Chen X (2017) License plate detection using convolutional neural network. IEEE Intl Conf Comp Comm:1736–1740

  13. Li J, Liang X, Shen S, Xu T, Feng J, Yan S (2018) Scale-aware fast R-CNN for pedestrian detection. IEEE Trans Multimedia 20(4):985–996

    Google Scholar 

  14. Li-Hung W, Chao-Kai C, Chung-Bin W (2014) A real-time architecture of multiple features extraction for vehicle verification. Proc IEEE Asia Pacific Conf Circuits Systems, p 615–618

  15. Peng J, Li Q, El-Latif AAA, Wang N, Niu X (2013) Finger vein recognition with Gabor wavelets and local binary patterns. IEICE Trans Inf Syst E96.D(8):1886–1889

    Article  Google Scholar 

  16. Peng J, Wang N, El-Latif AAA, Li Q, Niu X Finger-vein verification using Gabor filter and SIFT feature matching. Eighth Intl Conf Intell Inf Hiding and Multimed Sig Proc, p 45-48.

  17. Prabhakar P, Anupama P (2014) A novel design for vehicle license plate detection and recognition. Proc IEEE 2nd Intl Conf Current Trends in Engineering and Technology, p 7–12.

  18. Runmin W, Nong S, Rui H, Yuehuan W (2014) License plate detection using gradient information and cascade detectors. Optik 125(1):186–190

    Article  Google Scholar 

  19. Shi Z, Yu L, El-Latif AAA, Niu X Skeleton modulated topological perception map for rapid viewpoint selection. IEICE Trans Inf Syst E95.D(10):2585–2588

    Article  Google Scholar 

  20. Tian B, Li Y, Li B, Wen D (2014) Rear-view vehicle detection and tracking by combining multiple parts for complex urban surveillance. IEEE Intell Transp Syst Mag 15(2):597–606

    Article  Google Scholar 

  21. Vladimir T, Miodrag P, Peter O (2016) Fuzzified Gabor filter for license plate detection. Eng Appl Artif Intell 48:40–58

    Article  Google Scholar 

  22. Wang N, Li Q, El-Latif AAA, Peng J, Niu X (2014) An enhanced thermal face recognition method based on multiscale complex fusion for Gabor coefficients. Multimed Tools Appl 72:2339–2358

    Article  Google Scholar 

  23. Wang H, Xu M, Zhua F, Deng Z, Li Y, Zhou B (2018) Shadow traffic: a unified model for abnormal traffic behavior simulation. Comput Graph 70:235–241

    Article  Google Scholar 

  24. Xie L, Ahmad T, Jin L, Liu Y, Zhang S (2018) A new CNN-based method for multi-directional car license plate detection. IEEE Trans Intell Transp Syst 19(2):507–517

    Article  Google Scholar 

  25. Yang S, Xu J, Chen Y et al (2014) On-road vehicle tracking using keypoint-based representation and online co-training. Multimed Tools Appl 72(2):1561–1583. https://doi.org/10.1007/s11042-013-1453-5

    Article  Google Scholar 

  26. Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. Proc Euro Conf Comp Vis, p 818–833.

  27. Zeng D, Zhu M (2018) Multiscale fully convolutional network for foreground object detection in infrared videos. IEEE Geosci Remote Sens Lett 15(4):617–621

    Article  Google Scholar 

  28. Zhang Q, Wan C, Han W (2018) A modified faster region-based convolutional neural network approach for improved vehicle detection performance. Multimed Tools Appl. https://doi.org/10.1007/s11042-018-6769-8

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank Dr. Bin Tian from Institute of Automation, Chinese Academy of Sciences, Beijing, China for providing the dataset for experimentation.

Funding

This research is supported by the National Natural Science Foundation of China (Grant No. 61572395 and 61675161).

Author information

Authors and Affiliations

  1. School of Electronics and Information Engineering, Xi’an Jiaotong University, Xi’an, People’s Republic of China

    Muhammad Rizwan Asif, Chun Qi, Tiexiang Wang & Muhammad Sadiq Fareed

  2. Department of Engineering, Aarhus University, Aarhus N, Denmark

    Muhammad Rizwan Asif

  3. School of Mechanical and Manufacturing Engineering, University of New South Wales (UNSW), Sydney, Australia

    Subhan Khan

Authors
  1. Muhammad Rizwan Asif
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chun Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tiexiang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Muhammad Sadiq Fareed
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Subhan Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Conceptualization, Muhammad Rizwan Asif; methodology, Muhammad Rizwan Asif; software, Muhammad Rizwan Asif and Tiexiang Wang; validation, Muhammad Sadiq Fareed and Subhan Khan; formal analysis, Muhammad Sadiq Fareed and Subhan Khan; resources, Chun Qi; data writing—original draft preparation, Muhammad Rizwan Asif; writing—review and editing, Muhammad Rizwan Asif and Chun Qi; supervision, Chun Qi; funding acquisition, Chun Qi.

Corresponding author

Correspondence to Chun Qi.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Supplementary materials

The code may be available on request.

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Asif, M.R., Qi, C., Wang, T. et al. License plate detection for multi-national vehicles – a generalized approach. Multimed Tools Appl 78, 35585–35606 (2019). https://doi.org/10.1007/s11042-019-08199-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-08199-4

Keywords

Search

Navigation