Abstract
UAVs have been deployed in various object tracking applications such as disaster management, traffic monitoring, wildlife monitoring and crowd management. Recently, various deep learning methodologies have a profound effect on object detection and tracking. Deep learning-based object detectors rely on pre-trained networks. Problems arise when there is a mismatch between the pre-trained network domain and the target domain. UAV images possess different characteristics than images used in pre-trained networks due to camera view variation, altitude ranges and camera motion. In this paper, we propose a novel methodology to detect and track objects from UAV data. A deeply supervised object detector (DSOD) is entirely trained on UAV images. Deep supervision and dense layer-wise connection enriches the learning of DSOD and performs better object detection than pre-trained-based detectors. Long–Short-Term Memory (LSTM) is used for tracking the detected object. LSTM remembers the inputs from the past and predicts the object in the next frame thereby bridging the gap of undetected objects which improves tracking. The proposed methodology is compared with pre-trained-based models and it outperforms.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.References
Ammour, N., Alhichri, H., Bazi, Y., Benjdira, B., Alajlan, N., & Zuair, M. (2017). Deep learning approach for car detection in UAV imagery. Remote Sensing, 9(4), 312.
Colomina, I., & Molina, P. (2014). Unmanned aerial systems for photogrammetry and remote sensing: A review. ISPRS Journal of photogrammetry and remote sensing, 92, 79–97.
Fang, P., Lu, J., Tian, Y., & Miao, Z. (2011). An improved object tracking method in UAV videos. Procedia Engineering, 15, 634–638.
Máttyus, G., Benedek, C., Szirányi, T. (2015). Multi target tracking on Aerial videos. In ISPRS Istanbul Workshop 2010 on Modeling of Optical Airborne and Spaceborne Sensors. International society for photogrammetry and remote sensing.
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K. Q. (2017). Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4700–4708).
Jabar, F., Farokhi, S., Sheikh, U. U. (2015, October). Object tracking using SIFT and KLT tracker for UAV-based applications. In 2015 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS) (pp. 65–68). IEEE.
Kiszka, J. J., Mourier, J., Gastrich, K., & Heithaus, M. R. (2016). Using unmanned aerial vehicles (UAVs) to investigate shark and ray densities in a shallow coral lagoon. Marine Ecology Progress Series, 560, 237–242.
Li, C., Zhang, Y., Qu, Y. (2018, March). Object detection based on deep learning of small samples. In 2018 Tenth International Conference on Advanced Computational Intelligence (ICACI) (pp. 449–454). IEEE.
Mueller, M., Smith, N., Ghanem, B. (2016, October). A benchmark and simulator for uav tracking. In European conference on computer vision. Springer: Cham 445–461.
Ning, G., Zhang, Z., Huang, C., Ren, X., Wang, H., Cai, C., & He, Z. (2017, May). Spatially supervised recurrent convolutional neural networks for visual object tracking. In 2017 IEEE international symposium on circuits and systems (ISCAS) (pp. 1–4). IEEE.
Zahawi, R. A., Dandois, J. P., Holl, K. D., Nadwodny, D., Reid, J. L., & Ellis, E. C. (2015). Using lightweight unmanned aerial vehicles to monitor tropical forest recovery. Biological Conservation, 186, 287–295.
Selim, S., Sonmez, N. K., Coslu, M., & Onur, I. (2019). Semi-automatic tree detection from images of unmanned aerial vehicle using object-based image analysis method. Journal of the Indian Society of Remote Sensing, 47(2), 193–200.
Shen, Z., Liu, Z., Li, J., Jiang, Y. G., Chen, Y., & Xue, X. (2017). Dsod: Learning deeply supervised object detectors from scratch. In Proceedings of the IEEE international conference on computer vision (pp. 1919–1927).
Raoult, V., Tosetto, L., & Williamson, J. E. (2018). Drone-based high-resolution tracking of aquatic vertebrates. Drones, 2(4), 37.
Sun, W., Li, D., Jia, W., Li, P., Zhao, C., Chen, X. (2015, September). Small moving object tracking in dynamic video. In 2015 international conference on intelligent information hiding and multimedia signal processing (IIH-MSP) (pp. 239–242). IEEE.
Wenshuai, Y., Xuchu, Y., Pengqiang, Z., Jun, Z. (2008): A new framework of moving target detection and tracking for UAV video application. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, vol XXXVII, PartB 3b, pp. 609–614, Beijing.
Xu, S., Savvaris, A., He, S., Shin, H. S., Tsourdos, A. (2018, June). Real-time implementation of YOLO+ JPDA for small scale UAV multiple object tracking. In 2018 international conference on unmanned aircraft systems (ICUAS) (pp. 1336–1341). IEEE.
Xue, X., Li, Y., & Shen, Q. (2018). Unmanned aerial vehicle object tracking by correlation filter with adaptive appearance model. Sensors, 18(9), 2751.
Yang, Z., Huang, Z., Yang, Y., Yang, F., & Yin, Z. (2018, October). Accurate specified-pedestrian tracking from unmanned aerial vehicles. In 2018 IEEE 18th international conference on communication technology (ICCT) (pp. 1256–1260). IEEE.
Zaheer, Z., Usmani, A., Khan, E., Qadeer, M. A. (2016, July). Aerial surveillance system using UAV. In 2016 thirteenth international conference on wireless and optical communications networks (WOCN) (pp. 1–7). IEEE.
Zhao, X., Zhou, S., Lei, L., Deng, Z. (2018, June). Siamese network for object tracking in aerial video. In 2018 IEEE 3rd international conference on image, vision and computing (ICIVC) (pp. 519–523). IEEE.
Acknowledgements
This work was funded by International Society for Photogrammetry and Remote Sensing (ISPRS) under ISPRS Scientific Initiatives 2019.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Micheal, A.A., Vani, K., Sanjeevi, S. et al. Object Detection and Tracking with UAV Data Using Deep Learning. J Indian Soc Remote Sens 49, 463–469 (2021). https://doi.org/10.1007/s12524-020-01229-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12524-020-01229-x