Skip to main content
SpringerLink
Log in

A convolutional neural network-based flame detection method in video sequence

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Computer vision-based fire detection is one of the crucial tasks in modern surveillance system. In recent years, the convolutional neural network (CNN) has become an active topic because of its high accuracy recognition rate in a wide range of applications. How to reliably and effectively solve the problems of flame detection, however, has still been a challenging problem in practice. In this paper, we proposed a novel flame detection algorithm based on CNN in real time by processing the video data generated by an ordinary camera monitoring a scene. Firstly, to improve the efficiency of recognition, a candidate target area extraction algorithm is proposed for dealing with the suspected flame area. Secondly, the extracted feature maps of candidate areas are classified by the designed deep neural network model based on CNN. Finally, the corresponding alarm signal is obtained by the classification results. The experimental results show that the proposed method can effectively identify fire and achieve higher alarm rate in the homemade database. The proposed method can effectively realize the real-time performance of fire warning in practice.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Kong, S.G., Jin, D., Li, S., Kim, H.: Fast fire flame detection in surveillance video using logistic regression and temporal smoothing. Fire Saf. J. 79, 37–43 (2016)

    Article  Google Scholar 

  2. Töreyin, B.U., Dedeoğlu, Y., Güdükbay, U., Cetin, A.E.: Computer vision based method for real-time fire and flame detection. Pattern Recogn. Lett. 27(1), 49–58 (2006)

    Article  Google Scholar 

  3. Muhammad, K., Ahmad, J., Baik, S.W.: Early fire detection using convolutional neural networks during surveillance for effective disaster management. Neurocomputing 288(2), 30–42 (2017)

    Article  Google Scholar 

  4. Jiu, Y.Z.B.: Fire loss in the china during 2017 (2018). http://www.chinajyzb.com.cn/. Accessed Jan 2018

  5. Çetin, A.E., Dimitropoulos, K., Gouverneur, B., Grammalidis, N., Günay, O., Habiboǧlu, Y.H., et al.: Video fire detection—review. Digit. Signal Proc. 23(6), 1827–1843 (2013)

    Article  Google Scholar 

  6. Mengxin, L., Xu, W., Xu, K., Fan, J., Hou, D.: Review of fire detection technologies based on video image. J. Theor. Appl. Inf. Technol. 49(2), 700–707 (2013)

    Google Scholar 

  7. Gunay, O., Toreyin, B.U., Kose, K., Cetin, A.E.: Entropy-functional-based online adaptive decision fusion framework with application to wildfire detection in video. IEEE Trans. Image Process. Publ. IEEE Signal Process. Soc. 21(5), 2853 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  8. Jenifer, P.: Effective visual fire detection in video sequences using probabilistic approach. Proceeding of International Conference on Emerging Trends in Electrical and Computer Technology (ICETECT), Madurai, 870–875 (2011)

  9. Chen, L.H., Huang, W.C.: Fire detection using spatial-temporal analysis. In: Lecture Notes in Engineering & Computer Science, vol. 2206, no. 1 (2013)

  10. Kuo, J.Y., Lai, T.Y., Fanjiang, Y.Y., Huang, F.C., Liao, Y.H.: A behavior-based flame detection method for a real-time video surveillance system. J. Chin. Inst. Eng. 38(7), 947–958 (2015)

    Article  Google Scholar 

  11. Toulouse, T., Rossi, L., Celik, T., Akhloufi, M.: Automatic fire pixel detection using image processing: a comparative analysis of rule-based and machine learning-based methods. SIViP 10(4), 647–654 (2016)

    Article  Google Scholar 

  12. Zhang, Z., Shen, T., Zou, J.: An improved probabilistic approach for fire detection in videos. Fire Technol. 50(3), 745–752 (2014)

    Article  Google Scholar 

  13. Han, X.F., Jin, J.S., Wang, M.J., Jiang, W., Gao, L., Xiao, L.P.: Video fire detection based on gaussian mixture model and multi-color features. SIViP 11(5), 1–7 (2017)

    Google Scholar 

  14. Rong, J., Zhou, D., Yao, W., Gao, W., Chen, J., Wang, J.: Fire flame detection based on gica and target tracking. Opt. Laser Technol. 47(4), 283–291 (2013)

    Article  Google Scholar 

  15. Wang, D.C., Cui, X., Park, E., Jin, C., Kim, H.: Adaptive flame detection using randomness testing and robust features. Fire Saf. J. 55(328), 116–125 (2013)

    Article  Google Scholar 

  16. Liu, Z.G., Yang, Y., Ji, X.H.: Flame detection algorithm based on a saliency detection technique and the uniform local binary pattern in the YCbCr color space. SIViP 2, 1–8 (2015)

    Google Scholar 

  17. Liu, Z.G., Yang, Y., Ji, X.H.: Flame detection algorithm based on a saliency detection technique and the uniform local binary pattern in the YCbCr color space. SIViP 10(2), 277–284 (2016)

    Article  Google Scholar 

  18. Zhu, X., Li, X., Zhang, S., Ju, C., Wu, X.: Robust joint graph sparse coding for unsupervised spectral feature selection. IEEE Trans. Neural Netw. Learn. Syst. 28(6), 1263–1275 (2017)

    Article  MathSciNet  Google Scholar 

  19. Zhu, X., Li, X., Zhang, S.: Block-row sparse multiview multilabel learning for image classification. IEEE Trans. Cybern. 46(2), 450 (2016)

    Article  Google Scholar 

  20. Zhang, D., Han, S., Zhao, J., Zhang, Z., Qu, C., Ke, Y., et al.: Image based forest fire detection using dynamic characteristics with artificial neural networks. In: International Joint Conference on Artificial Intelligence, pp. 290–293. IEEE (2009)

  21. Kolesov, I., Karasev, P., Tannenbaum, A., Haber, E.: Fire and smoke detection in video with optimal mass transport based optical flow and neural networks. In: IEEE International Conference on Image Processing, vol. 119, pp. 761–764. IEEE (2010)

  22. Maksymiv, O., Rak, T., Peleshko, D.: Real-time fire detection method combining AdaBoost, LBP and convolutional neural network in video sequence. In: Experience of Designing and Application of Cad Systems in Microelectronics, pp. 351–353. IEEE (2017)

  23. Sharma, J., Granmo, O.C., Goodwin, M., Fidje, J.T.: Deep convolutional neural networks for fire detection in images. International Conference on Engineering Applications of Neural Networks, pp 183–193 (2017)

  24. Guo, W., Yan, F., Han, N.: Wildfire smoke detection using dynamic features and neural network. Int. J. Digit. Content Technol. Appl. 6(11), 61–68 (2012)

    Article  Google Scholar 

  25. Guo, Q., Dai, J., Wang, J.: Study on fire detection model based on fuzzy neural network. In: International Workshop on Intelligent Systems and Applications, pp. 1–4. IEEE (2010)

  26. Frizzi, S., Kaabi, R., Bouchouicha, M., Ginoux, J.M., Moreau, E., Fnaiech, F.: Convolutional neural network for video fire and smoke detection. In: Industrial Electronics Society, IECON 2016-, Conference of the IEEE, pp. 877–882. IEEE (2016)

  27. Zhang, Q., Xu, J., Xu, L., Guo, H.: Deep Convolutional Neural Networks for Forest Fire Detection. International Forum on Management, Education and Information Technology Application, pp 568–575 (2016)

  28. Zhang, S., Cai, Y., Xie, M.: Cascade selective window for fast and accurate object detection. J. Electr. Eng. Technol. 10(3), 1227–1232 (2015)

    Article  Google Scholar 

  29. Prati, A., Gualdi, G., Cucchiara, R.: Multistage particle windows for fast and accurate object detection. IEEE Trans. Pattern Anal. Mach. Intell. 34(8), 1589–1604 (2012)

    Article  Google Scholar 

  30. Yu, C., Mei, Z., Zhang, X.: A real-time video fire flame and smoke detection algorithm. Procedia Eng. 62, 891–898 (2013)

    Article  Google Scholar 

  31. Zhu, X., Zhang, L., Huang, Z.: A sparse embedding and least variance encoding approach to hashing. IEEE Trans. Image Process. Publ. IEEE Signal Process. Soc. 23(9), 3737–3750 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  32. Laptev, D., Savinov, N., Buhmann, J.M., Pollefeys, M.: Ti-pooling: transformation-invariant pooling for feature learning in convolutional neural networks. IEEE Conference on Computer Vision and Pattern Recognition, pp. 289–297 (2016)

  33. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In conference on Neural Information Processing Systems, 4, pp. 1106–1114 (2012)

  34. Du, S.Y., Liu, Z.G.: A comparative study of different color spaces in computer-vision-based flame detection. Multim. Tools Appl. 75(17), 10291–10310 (2016)

    Article  Google Scholar 

  35. Foo, S.Y.: A rule-based machine vision system for fire detection in aircraft dry bays and engine compartments. Knowl. Based Syst. 9(8), 531–540 (1996)

    Article  Google Scholar 

  36. Wang, J., Yu, W.H., Han, T.: Fire detection based on infrared video image. J. Shanghai Jiaotong Univ. 42(12), 1979–1982 (2008)

    Google Scholar 

  37. Li, L., Wang, Y., Li, C.: Design of a dual-spectrum flame detector used in coal mine. Foreign Electron. Meas. Technol. 33(9), 46–49 (2014)

    Google Scholar 

  38. Huang, D., Huang, S.C., Zhao, W., Liu, J.C.: Detection and recognition algorithm for missile tail flame based on feature spectral restoration. Laser & Infrared 47(12), 1505–1509 (2017)

    Google Scholar 

  39. Liu, X.J.: Fire detection technology based on infrared image processing. Appl. Mech. Mater. 347–350, 3426–3430 (2013)

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank their colleagues for their support of this work. The detailed comments from the anonymous reviewers were gratefully acknowledged. This work was supported by China Postdoctoral Science Foundation (2018M630222), and Project of Scientific Operating Expenses from Ministry of Education of China (2017PT19).

Author information

Author notes

  1. Zhen Zhong and Minjuan Wang have contributed equally to this work.

Authors and Affiliations

  1. College of Information and Electrical Engineering, China Agricultural University, Beijing, 100083, China

    Zhen Zhong, Minjuan Wang & Wanlin Gao

  2. Key Laboratory of Agricultural Informatization Standardization, Ministry of Agriculture, Beijing, 100083, China

    Zhen Zhong, Minjuan Wang & Wanlin Gao

  3. Tianjin Isecure Technology Company Limited, Tianjin, China

    Yukun Shi

Authors
  1. Zhen Zhong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Minjuan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yukun Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wanlin Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wanlin Gao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhong, Z., Wang, M., Shi, Y. et al. A convolutional neural network-based flame detection method in video sequence. SIViP 12, 1619–1627 (2018). https://doi.org/10.1007/s11760-018-1319-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-018-1319-4

Keywords

Search

Navigation