Journal of Drive and Control (드라이브 ㆍ 컨트롤)

The Korean Society for Fluid Power and Construction Equipment (유공압건설기계학회)
권호 표지
DOI QR코드

DOI QR Code

Development of Human Detection Technology with Heterogeneous Sensors for use at Disaster Sites

재난 현장에서 이종 센서를 활용한 인명 탐지 기술 개발

  • Seo, Myoung Kook (Smart Engineering Lab. Korea Construction Equipment Technology Institute) ;
  • Yoon, Bok Joong (Smart Engineering Lab. Korea Construction Equipment Technology Institute) ;
  • Shin, Hee Young (Smart Engineering Lab. Korea Construction Equipment Technology Institute) ;
  • Lee, Kyong Jun (Smart Engineering Lab. Korea Construction Equipment Technology Institute)
  • Received : 2020.06.15
  • Accepted : 2020.07.10
  • Published : 2020.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, a special purpose machine with two manipulators and quadruped crawler system has been developed for rapid life-saving and initial restoration work at disaster sites. This special purpose machine provides the driver with various environmental recognition functions for accurate and rapid task determination. In particular, the human detection technology assists the driver in poor working conditions such as low-light, dust, water vapor, fog, rain, etc. to prevent secondary human accidents when moving and working. In this study, a human detection module is developed to be mounted on a special purpose machine. A thermal sensor and CCD camera were used to detect victims and nearby workers in response to the difficult environmental conditions present at disaster sites. The performance of various AI-based life detection algorithm were verified and then applied to the task of detecting various objects with different postures and exposure conditions. In addition, image visibility improvement technology was applied to further improve the accuracy of human detection.

Keywords

References

  1. M. K. Seo et al., "Environment Recognition Technology in Disaster Site", Journal of Drive and Control, Vol.13, No.4, pp.69-73, 2016.
  2. J. Y. Lee, B. R. Son and J. G. Kim, "Fire rescue system: using motion sensor", Proceedings of KICS Summer Conference 2009, pp.1007-1008, 2009.
  3. S. G, Lee and K. M. Kim, "Human Body Detection Sensor Prototype Design for Fire Suppression Using Drones", Proceedings Conference on Korea Information and Communication Engineering, Vol.23, No.2, pp.418-421, 2019.
  4. S. M. Yang and J. K. Choe, "A Study on Improvement of Human Sensing System Reliability Using Thermal Image", Journal of Korean Institute of Information Technology, Vol.18, No.1, pp.35-40, 2020. https://doi.org/10.14801/jkiit.2020.18.1.35
  5. M. K. Seo et al., "Development of Life Detection Techniques Using Heterogeneous Sensors", Proceedings of KSPE 2017 Autumn Conference, pp.851-852, 2017.
  6. A. N. Ali et al., "Life Signs Detector Using a Drone in Disaster Zones", Remote Sensing, Vol.11, pp.2441, 2019. https://doi.org/10.3390/rs11202441
  7. I. K. Marina, K. Mate and P. Miran, "Human Detection in Thermal Imaging Using YOLO", Proceedings of 2019 5th International Conference on Computer and Technology Applications, pp.20-24, 2019.
  8. J. Redmon et al., "You Only Look Once: Unified, Real-Time Object Detection", Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.779-788, 2016.
  9. Z. Mbaitiga, S. Fuji and S. Minori, "Rapid Human Body Detection in Disaster Sites Using Image Processing from Unmanned Aerial Vehicle (UAV) Cameras", Proceedings of 2018 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), pp.230-235, 2018.
  10. S. H. Kim et al., "A Study on an Obstacle Recognition and Contact Protection System for Excavator", Proceedings of the Korea Automatic Control Conference, pp.1379-1382, 2000.
  11. M. K. Seo and B. J. Yoon, "Development of Air Cooled Module for Protecting Environmental Awareness Sensor in a High-Temperature Environment", Proceedings of the KSME IT Convergence Division Spring Conference, pp.49-50, 2019.
  12. K. J. Lee, B. Y. Yoon and M. K. Seo, "Numerical Analysis of Heat and Flow Characteristics around the Sensor Protective Device (II)", Proceedings of KSPE 2018 Autumn Conference, pp.317, 2018.
  13. Z. Zhang, "A Flexible New Technique for Camera Calibration", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.22, pp.1330-1334, 2000. https://doi.org/10.1109/34.888718
  14. N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection", Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), pp.886-893, 2005.
  15. W. Liu et al., "SSD: Single Shot MultiBox Detector", Proceedings of European Conference on Computer Vision 2016, pp.21-37, 2016.
  16. Z. Cao et al., "Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields", Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.291-7299, 2017.
  17. S. K. Bhatia et al., Advances in Computer Communication and Computational Sciences, Proceedings of IC4S 2017, Springer Nature Singapore Pte Ltd., Singapore, pp.301-302, 2017.
  18. K. He, J. Sun and X. Tang, "Single Image Haze Removal Using Dark Channel Prior", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.33, pp.2341-2353, 2011. https://doi.org/10.1109/TPAMI.2010.168
  19. J. S. Cho, "Design of Attachments for Dual Arm of Disaster-Responding Special Function Machinery by TRIZ", Journal of Drive and Control, Vol.15, No.3, pp.29-35, 2018. https://doi.org/10.7839/KSFC.2018.15.3.029