Knowledge Network Node

Multi-Spectral Image Semantic Segmentation Based on Supervised Feature FusionChinese Full Text

KANG Mengmeng;YANG Hao;GU Xiaojing;GU Xingsheng;Key Laboratory of Advanced Control and Optimization for Chemical Processes, Ministry of Education, East China University of Science and Technology;China Academy of Civil Aviation Science and Technology;

Abstract: Visible imaging is easily affected by illumination at night or in bad weather conditions, which reduces the performance of semantic segmentation system. The above problem can be alleviated by simultaneously using visible cameras and thermal Infrared Ray(IR) sensors. Although there are some jobs involved in the semantic segmentation of RGB-IR images, few of them attempted to improve the segmentation results by enhancing the discriminability of the fusion feature. Therefore, this paper proposes a novel framework of multi-spectral image semantic segmentation based on the process of supervised feature fusion. Firstly, the independent feature fusion modules constitute a whole fusion branch in the semantic segmentation network so that the fusion of high-level features can guide the fusion of lower-level features. Secondly, the segmentation supervision signal is directly applied to the end of the fusion branch to improve the discriminability of the fusion feature and the convergence speed of the network.Finally, in order to improve the segmentation of small objects, a dice loss instead of the cycle loss is specially introduced into the fusion branch to achieve a hybrid supervision of training process. It is shown via the experimental results on two multi-spectral datasets that, compared with other multi-spectral semantic segmentation methods, the proposed method can achieve better segmentation results and have more favorable for small objects segmentation.
  • DOI:

    10.14135/j.cnki.1006-3080.20191216002

  • Series:

    (B) Chemistry/ Metallurgy/ Environment/ Mine Industry; (C) Architecture/ Energy/ Traffic/ Electromechanics, etc; (I) Electronic Technology & Information Science

  • Subject:

    Vehicle Industry; Computer Software and Application of Computer

  • Classification Code:

    TP391.41;U463.6

  • Mobile Reading
    Read on your phone instantly
    Step 1

    Scan QR Codes

    "Mobile CNKI-CNKI Express" App

    Step 2

    Open“CNKI Express”

    and click the scan icon in the upper left corner of the homepage.

    Step 3

    Scan QR Codes

    Read this article on your phone.

  • CAJ Download
  • PDF Download

Download the mobile appuse the app to scan this coderead the article.

Tips: Please download CAJViewer to view CAJ format full text.

Download: 162 Page: 233-240 Pagecount: 8 Size: 1479K

Related Literature
  • Similar Article
  • Reader Recommendation
  • Associated Author