Zhouheng Ge
ABSTRACT
Maritime accidents kill thousands of lives every year because of the difficulty in rescuing. Usually, the weather conditions at sea are very complicated, especially at midnight. The images captured by the monitor often suffer from low visibility under this circumstance, which gives rescuers a great challenge to seek survivors. Existing image enhancement methods are not suitable for the offshore environment. We propose an image enhancement model to restore the image from the low-light condition to solve this problem. We found that if we transform an image into a logarithmic image, it can provide more details in darkness, and we decide to make better use of this information because the survivors’ bodies may be hidden in darkness. We build networks based on previous Retinex-based network researches and use the logarithmic image as the original dataset. The De-Net decomposes the image into the reflectance map and illumination map for further adjustment. The recovered logarithmic image will turn back to the output image after the I-Net and R-Net. Experiments have been implemented on synthetic and realistic low-light images to verify the effectiveness of our method. Experimental results have illustrated that it is widely applicable to maritime low-light images.
- S. M. Pizer, E. P. Amburn, J. D. Austin, R. Cromartie, A. Geselowitz, T. Greer, B. T. H. Romeny, J. B. Zimmerman, and K. Zuiderveld. 1987. Adaptive histogram equalization and its variations. Computer Vision Graphics & Image Processing, 39(3):355–368.Google Scholar
Digital Library
- E. H. Land and J. J. McCann. 1971. Lightness and Retinex theory. J. Opt. Soc. Am., 61(1):1–11.Google ScholarCross Ref
- E. H. Land. 1977. The retinex theory of color vision. Scientific American, 237(6):108.Google ScholarCross Ref
- D. J. Jobson, Z. Rahman, and G. A. Woodell. 1997. Properties and performance of a center/surround retinex. IEEE Transactions on Image Processing 6, 3 (1997), 451–62.Google ScholarDigital Library
- D. J. Jobson, Z. Rahman, and G. A. Woodell. 1997. A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Transactions on Image Processing, 6(7):965–76.Google ScholarDigital Library
- Frankle, Jonathan and McCann, John. 1980. Method and Apparatus for Lightness Imaging. USPatent #4,384,336.Google Scholar
- X. Fu, D. Zeng, Y. Huang, X. Zhang, and X. Ding. 2016. A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation. In IEEE Conference on Computer Vision and Pattern Recognition. 2782–2790.Google Scholar
- K. G. Lore, A. Akintayo, and S. Sarkar. 2017. LLNet: A deep autoencoder approach to natural low-light image enhancement. Pattern Recognition 61 (2017), 650–662.Google ScholarDigital Library
- L. Shen, Z. Yue, F. Feng, Q. Chen, S. Liu, and J. Ma. 2017. MSR-net:Low-light Image Enhancement Using Deep Convolutional Network. (11 2017), arXiv.Google Scholar
- Y. Fang, C. Zhang, W. Yang, J. Liu, and Z. Guo. 2018. Blind visual quality assessment for image super-resolution by convolutional neural network. Multimedia Tools and Applications, pages 1–18.Google Scholar
- W. Yang, J. Feng, J. Yang, F. Zhao, J. Liu, Z. Guo, and S. Yan. 2017. Deep edge guided recurrent residual learning for image superresolution. IEEE Transactions on Image Processing, 26(12):5895–5907.Google ScholarDigital Library
- W. Yang, J. Feng, G. Xie, J. Liu, Z. Guo, and S. Yan. 2018. Video super-resolution based on spatial-temporal recurrent residual networks. Computer Vision and Image Understanding, 168:79–92.Google ScholarCross Ref
- W. Yang, S. Xia, J. Liu, and Z. Guo. 2018. Reference guided deep super-resolution via manifold localized external compensation. IEEE Transactions on Circuits and Systems for Video Technology.Google Scholar
- C. Dong, C. L. Chen, K. He, and X. Tang. 2016. Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 38, 2 (2016), 295–307.Google ScholarDigital Library
- J. Xie, L. Xu, E. Chen, J. Xie, and L. Xu. 2012. Image denoising and inpainting with deep neural networks. In NeurIPS. 341–349.Google Scholar
- K. Zhang, W. Zuo, Y. Chen, D. Meng, and L. Zhang. 2016. Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising. IEEE Transactions on Image Processing 26, 7 (2017), 3142–3155.Google ScholarDigital Library
- C. Wei, W. Wang, W. Yang, and J. Liu. 2018. Deep Retinex Decomposition for Low-Light Enhancement. In British Machine Vision Conference.Google Scholar
- H. D. Cheng and X. J. Shi. 2004. A simple and effective histogram equalization approach to image enhancement. Digital Signal Processing 14, 2 (2004), 158–170.Google ScholarCross Ref
- E. Pisano, S. Zong, B. Hemminger, M. Deluca, R. Johnston, K. Muller, M. Braeuning, and S. Pizer. 1998. Contrast Limited Adaptive Histogram Equalization image processing to improve the detection of simulated spiculations in dense mammograms. Journal of Digital Imaging 11, 4 (1998), 193–200.Google ScholarCross Ref
- C. Lee, C. Lee, and C. S. Kim. 2013. Contrast enhancement based on layered difference representation of 2D histograms. IEEE Transactions on Image Processing 22, 12 (2013), 5372–5384.Google ScholarDigital Library
- M. Li, J. Liu, W. Yang, X. Sun, and Z. Guo. 2018. Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model. IEEE Transactions on Image Processing 27, 6 (2018), 2828–2841.Google ScholarCross Ref
- Y. Zhang, J. Zhang and X. Guo. Kindling the Darkness: A Practical Low-light Image Enhancer. 27th ACM International Conference on Multimedia, October 21–25, 2019, Nice, France, 1632-1640.Google ScholarDigital Library
- O. Ronneberger, P. Fischer, and T. Brox. 2015. U-Net: Convolutional Networks for Biomedical Image Segmentation. In MICCAI. 234–241.Google Scholar
- X. Guo, Y. Li, and H. Ling. 2017. LIME: Low-light Image Enhancement via Illumination Map Estimation. IEEE Transactions on Image Processing 26, 2 (2017), 982–993Google ScholarDigital Library
- Y. Lu, R. W. Liu, F. Chen, and L. Xie. 2019. Learning a Deep Convolutional Network for Speckle Noise Reduction in Underwater Sonar Images. 11th International Conference on Machine Learning and Computing.Google Scholar
- Y. Guo, Y. Lu, R. W. Liu, M. Yang, and K. T. Chui. 2020. Low-Light Image Enhancement with Regularized Illumination Optimization and Deep Noise Suppression. IEEE Access, PP(99):1-1.Google Scholar
- Y. Guo, Y. Lu, M. Yang, and R. W. Liu. 2020. Low-light Image Enhancement with Deep Blind Denoising. ICMLC 2020: 12th International Conference on Machine Learning and Computing.Google Scholar
Index Terms
- Logarithmic Retinex Decomposition-Aided Convolutional Neural Networks for Low-Light Image Enhancement
Recommendations
Low-light Image Enhancement with Deep Blind Denoising
ICMLC '20: Proceedings of the 2020 12th International Conference on Machine Learning and ComputingVisual processing technology based on the high-quality image has been widely applied to maritime supervision. However, maritime accidents easily occur in a low-light environment. The images captured by the monitor often suffer from low visibility and ...
A Low-light Image Enhancement Method Balancing Brightness Boosting and Noise Smoothing
CSAI '22: Proceedings of the 2022 6th International Conference on Computer Science and Artificial IntelligenceImages captured in low-light or uneven lighting environments need to use low-light image enhancement techniques to boost brightness and contrast for high-quality improved results. Some existing low-light image enhancement methods over-enhance the image ...
Low Illumination Color Image Enhancement Based on Improved Retinex Theory
EITCE '20: Proceedings of the 2020 4th International Conference on Electronic Information Technology and Computer EngineeringIn view of the defects of the classical Retinex image enhancement algorithm, such as poor texture detail retention, halo and over enhancement, and abrupt tone, this paper proposes a low illumination color image enhancement algorithm based on Gabor ...
Comments