Co-localization of fluorescent signals using deep learning with Manders overlapping coefficient

Yimeng Dou; Yi-Hua Tsai; Chih-Chieh Liu; Brad A. Hobson; Pamela J. Lein

doi:10.1117/12.2580650

15 February 2021 Co-localization of fluorescent signals using deep learning with Manders overlapping coefficient

Yimeng Dou, Yi-Hua Tsai, Chih-Chieh Liu, Brad A. Hobson, Pamela J. Lein

Proceedings Volume 11596, Medical Imaging 2021: Image Processing; 115963C (2021) https://doi.org/10.1117/12.2580650
Event: SPIE Medical Imaging, 2021, Online Only

Conference Poster

Abstract

Object-based co-localization of uorescent signals allows the assessment of interactions between two (or more) biological entities using spatial information. It relies on object identification with high accuracy to separate uorescent signals from the background. Object detectors using convolutional neural networks (CNN) with annotated training samples could facilitate the process by detecting and counting fluorescent-labeled cells from uorescence photomicrographs. However, datasets containing segmented annotations of colocalized cells are generally not available, and creating a new dataset with delineated masks is label-intensive. Also, the colocalization coefficient is often not used as a component during training with the CNN model. Yet, it may aid with localizing and detecting objects during training and testing. In this work, we propose to address these issues by using a quantification coefficient for co-localization called Manders overlapping coefficient (MOC)¹ as a single-layer branch in a CNN. Fully convolutional one-state (FCOS)² with a Resnet101 backbone served as the network to evaluate the effectiveness of the novel branch to assist with bounding box prediction. Training data were sourced from lab curated uorescence images of neurons from the rat hippocampus, piriform cortex, somatosensory cortex, and amygdala. Results suggest that using modified FCOS with MOC outperformed the original FCOS model for accuracy in detecting uorescence signals by 1.1% in mean average precision (mAP). The model could be downloaded from https://github.com/Alphafrey946/Colocalization-MOC.

Conference Presentation

Citation Download Citation

Yimeng Dou, Yi-Hua Tsai, Chih-Chieh Liu, Brad A. Hobson, and Pamela J. Lein "Co-localization of fluorescent signals using deep learning with Manders overlapping coefficient", Proc. SPIE 11596, Medical Imaging 2021: Image Processing, 115963C (15 February 2021); https://doi.org/10.1117/12.2580650

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available