Abstract
Automatic license plate recognition systems have various applications in intelligent automated transportation systems and thus have been frequently researched over the past years. Yet designing a highly accurate license plate recognition pipeline is challenging in an unconstrained environment, where difficulties arise from variations in photographic conditions like illumination, distortion, blurring, etc., and license plate structural variations like background, text font, size, and color across different countries. In this paper, we tackle the problem of license plate detection and propose a novel approach based on localization of the license plates with prior vehicle detection, using the state-of-the-art RetinaNet object detector. This helps us to achieve real-time detection performance, while having superior localization accuracy compared to other state-of-the-art object detectors. Our system proved to be robust to all those variations that can occur in an unconstrained environment and outperformed other state-of-the-art license plate detection systems to the best of our knowledge.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Caltech car plates dataset. http://www.vision.caltech.edu/html-files/archive.html
Y. Cui, B. Oztan, Automated firearms detection in cargo x-ray images using retinanet, in Anomaly Detection and Imaging with X-Rays (ADIX) IV, vol. 10999 (International Society for Optics and Photonics, 2019), p. 109990P
K. He, X. Zhang, S. Ren, J. Sun, Deep residual learning for image recognition, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 5 (2015), p. 6
B. Hongliang, L. Changping, A hybrid license plate extraction method based on edge statistics and morphology, in Proceedings of the 17th International Conference on Pattern Recognition (ICPR 2004), vol. 2. IEEE (2004), pp. 831–834
G.S. Hsu, J.C. Chen, Y.Z. Chung, Application-oriented license plate recognition. IEEE Trans. Veh. Technol. 62(2), 552–561 (2012)
R. Laroca, E. Severo, L.A. Zanlorensi, L.S. Oliveira, G.R. Gonçalves, W.R. Schwartz, D. Menotti, A robust real-time automatic license plate recognition based on the yolo detector, in 2018 International Joint Conference on Neural Networks (IJCNN). IEEE (2018), pp. 1–10
W. Le, S. Li, A hybrid license plate extraction method for complex scenes, in 18th International Conference on Pattern Recognition (ICPR’06), vol. 2. IEEE (2006), pp. 324–327
B. Li, B. Tian, Y. Li, D. Wen, Component-based license plate detection using conditional random field model. IEEE Trans. Intell. Transport. Syst. 14(4), 1690–1699 (2013)
H. Li, C. Shen, Reading car license plates using deep convolutional neural networks and lstms. arXiv preprint arXiv:1601.05610 (2016)
X. Li, H. Zhao, L. Zhang, Recurrent retinanet: a video object detection model based on focal loss, in International Conference on Neural Information Processing (Springer, Berlin, 2018), pp. 499–508
H.W. Lim, Y.H. Tay, Detection of license plate characters in natural scene with MSER and SIFT unigram classifier. https://doi.org/10.1109/STUDENT.2010.5686998
T.Y. Lin, P. Goyal, R. Girshick, K. He, P. Dollár, Focal loss for dense object detection, in Proceedings of the IEEE International Conference on Computer Vision (2017), pp. 2980–2988
W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.Y. Fu, A.C. Berg, in Ssd: single shot multibox detector, in European Conference on Computer Vision (Springer, Berlin, 2016), pp. 21–37
M.A.A. Milton, in Towards pedestrian detection using retinanet in eccv 2018 wider pedestrian detection challenge. arXiv preprint arXiv:1902.01031 (2019)
J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: unified, real-time object detection. arXiv preprint arXiv:1506.02640 (2015)
J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: unified, real-time object detection, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016), pp. 779–788
S. Ren, K. He, R. Girshick, J. Sun, Faster r-cnn: Towards real-time object detection with region proposal networks, in Advances in Neural Information Processing Systems (2015), pp. 91–99
S. Safie, N.M.A.N Azmi, R. Yusof, R., Yunus, M.F.Z.C. Sayuti, K.K. Fai, Object localization and detection for real-time automatic license plate detection (ALPR) system using retinanet algorithm, in Proceedings of SAI Intelligent Systems Conference (Springer, Berlin, 2019), pp. 760–768
S.M. Silva, C.R. Jung, Real-time Brazilian license plate detection and recognition using deep convolutional neural networks, in 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI). IEEE (2017), pp. 55–62
K. Simonyan, A. Zisserman, in Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Y. Yuan, W. Zou, Y. Zhao, X. Wang, X. Hu, N. Komodakis, A robust and efficient approach to license plate detection. IEEE Trans. Image Process. 26(3), 1102–1114 (2016)
Y. Zhao, Y. Yuan, S. Bai, K. Liu, W. Fang, Voting-based license plate location, in 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC). IEEE (2011), pp. 314–317
D. Zheng, Y. Zhao, J. Wang, An efficient method of license plate location. Pattern Recogn. Lett. 26(15), 2431–2438 (2005)
W. Zhou, H. Li, Y. Lu, Q. Tian, Principal visual word discovery for automatic license plate detection. IEEE Trans. Image Process. 21(9), 4269–4279 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Sanyal, R., Jethanandani, M., Reddy, G.D., Kurtakoti, A. (2021). Localizing License Plates in Real Time with RetinaNet Object Detector. In: Sharma, M.K., Dhaka, V.S., Perumal, T., Dey, N., Tavares, J.M.R.S. (eds) Innovations in Computational Intelligence and Computer Vision. Advances in Intelligent Systems and Computing, vol 1189. Springer, Singapore. https://doi.org/10.1007/978-981-15-6067-5_64
Download citation
DOI: https://doi.org/10.1007/978-981-15-6067-5_64
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-6066-8
Online ISBN: 978-981-15-6067-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)