Jing Ke
ABSTRACT
Machine learning approaches have received sufficient attention in tumor detection in histopathology, and the very recent researches show their potential in extraction of molecular information for biomarker prediction. However, as we can only obtain label information of the whole slide, the patch-wise prediction classification results are simply summarized to reach the final diagnosis in previous work. In this paper, we develop a novel framework to precisely predict biomarker from hematoxylin and eosin (H&E) stained histology slides, where microsatellite instability (MSI) status in colorectal cancer is used as a case study. We develop a patch-wise binary classifier to detect tumor tissue as biomarker is tightly associated with tumor tissues. To obtain a precise predication of MSI status, a noise-robust convolutional neural network is trained by relabeling patch-wise output iteratively and feed back as input information. We employ a distillation framework for the dataset relabeling task. We also design a mathematical algorithm to sort out representative patches towards the final MSI status prediction. The model is evaluated by a large patient cohort from The Cancer Genome Atlas (TCGA), and tested on the state-of-the-art deep learning device NVIDIA GPU TeslaTM V100. The experimental results demonstrate the improved reliability in MSI prediction from histology images.
- Baudhuin, L. M., Burgart, L. J., et al. 2005. Use of microsatellite instability and immunohistochemistry testing for the identification of individuals at risk for Lynch syndrome. Familial cancer, 4(3), 255--265.Google Scholar
- Bejnordi, B. E., Veta, M., et al. 2017. Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. Jama, 318(22), 2199--2210.Google ScholarCross Ref
- Buecher, B., Cacheux, et al. 2013. Role of microsatellite instability in the management of colorectal cancers. Digestive and Liver Disease, 45(6), 441--449.Google ScholarCross Ref
- Coudray, N., Ocampo, P. S., et al. 2018. Classification and mutation prediction from non--small cell lung cancer histopathology images using deep learning. Nature medicine, 24(10), 1559--1567.Google Scholar
- Cruz-Roa, A., Gilmore, et al. 2018. High-throughput adaptive sampling for whole-slide histopathology image analysis (HASHI) via convolutional neural networks: Application to invasive breast cancer detection. PloS one, 13(5).Google Scholar
- Golden, J. A. 2017. Deep learning algorithms for detection of lymph node metastases from breast cancer: helping artificial intelligence be seen. Jama, 318(22), 2184--2186.Google ScholarCross Ref
- Kather, J. N., Halama, N., et al. 2018. Genomics and emerging biomarkers for immunotherapy of colorectal cancer. In Seminars in cancer biology (Vol. 52, pp. 189--197). Academic Press.Google Scholar
- Kather, J. N., Krisam, J., Charoentong, P., et al. 2019. Predicting survival from colorectal cancer histology slides using deep learning: A retrospective multicenter study. PLoS medicine, 16(1).Google Scholar
- Kather, J. N., Pearson, A. T., et al. 2019. Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer. Nature medicine, 25(7), 1054--1056.Google Scholar
- Korbar, B., Olofson, A. M., et al. 2017. Deep learning for classification of colorectal polyps on whole-slide images. Journal of pathology informatics, 8.Google ScholarCross Ref
- Kulkarni, P. M., Robinson, E. J., et al. 2019. Deep learning based on standard H&E images of primary melanoma tumors identifies patients at risk for visceral recurrence and death. Clinical Cancer Research, clincanres-1495.Google Scholar
- Li, Y., Ping, W. 2018. Cancer metastasis detection with neural conditional random field. arXiv preprint arXiv:1806.07064.Google Scholar
- Martino, L., Luengo, D., et al. 2018. Independent random sampling methods (Vol. 68). Springer.Google Scholar
- Nalisnik, M., Amgad, et al. 2017. Interactive phenotyping of large-scale histology imaging data with HistomicsML. Scientific reports, 7(1), 1--12.Google Scholar
- Popat, S., Hubner, R., et al. 2005. Systematic review of microsatellite instability and colorectal cancer prognosis. Journal of clinical oncology, 23(3), 609--618.Google ScholarCross Ref
- Zhang, L., Lu, L., et al. 2017. DeepPap: deep convolutional networks for cervical cell classification. IEEE journal of biomedical and health informatics, 21(6), 1633--1643.Google Scholar
- Dong, B., Hou, J., et al. 2019. Distillation ≈ Early Stopping? Harvesting Dark Knowledge Utilizing Anisotropic Information Retrieval For Overparameterized Neural Network. arXiv preprint arXiv:1910.01255.Google Scholar
- Sukhbaatar, S., Fergus, R. 2014. Learning from noisy labels with deep neural networks. arXiv preprint arXiv:1406.2080, 2(3), 4.Google Scholar
- Yang X, Yang J, Yan J, et al. 2019. Scrdet: Towards more robust detection for small, cluttered and rotated objects. Proceedings of the IEEE International Conference on Computer Vision. 8232--8241.Google Scholar
- Yan J, Zhu M, Liu H, et al. 2010. Visual saliency detection via sparsity pursuit. IEEE Signal Processing Letters, 17(8), 739--742.Google ScholarCross Ref
Index Terms
- A Prediction Model of Microsatellite Status from Histology Images
Recommendations
An approach to the prediction of breast cancer response to neoadjuvant chemotherapy based on tumor habitats in DCE-MRI images
AbstractFor patients diagnosed with breast cancer who are undergoing neoadjuvant chemotherapy, predicting the response of the tumor to treatment is critical, as it enables the initiation of new therapies and improves patient care. In this context, ...
Highlights- An automatic method for breast tumor segmentation is presented.
- A computational method for classifying tumor malignancy is presented.
- This work proposes an automatic method for generating tumor habitats.
- An automatic method for ...
End-to-End Deep Learning for Detecting Metastatic Breast Cancer in Axillary Lymph Node from Digital Pathology Images
Intelligent Data Engineering and Automated Learning – IDEAL 2021AbstractMetastatic breast cancer is one of the attributed leading causes of women deaths worldwide. Accurate diagnosis to the spread of breast cancer to axillary lymph nodes (ALNs) is done by breast pathologist, utilizing the microscope to inspect and ...
Lung Cancer Classification and Detection Using Convolutional Neural Networks
ICEMIS'20: Proceedings of the 6th International Conference on Engineering & MIS 2020The immense growth of technology has led to a booming development in the medical science research field. One of the major focuses of researchers is cancer detection in different organs like brain, breast, lung, etc. Lung cancer has a higher cause of ...
Comments