Neham Jain
ABSTRACT
Recovery of true color from underwater images is an ill-posed problem. This is because the wide-band attenuation coefficients for the RGB color channels depend on object range, reflectance, etc. which are difficult to model. Also, there is backscattering due to suspended particles in water. Thus, most existing deep-learning based color restoration methods, which are trained on synthetic underwater datasets, do not perform well on real underwater data. This can be attributed to the fact that synthetic data cannot accurately represent real conditions. To address this issue, we use an image to image translation network to bridge the gap between the synthetic and real domains by translating images from synthetic underwater domain to real underwater domain. Using this multimodal domain adaptation technique, we create a dataset that can capture a diverse array of underwater conditions. We then train a simple but effective CNN based network on our domain adapted dataset to perform color restoration. Code and pre-trained models can be accessed at https://github.com/nehamjain10/TRUDGCR
Supplemental Material
Available for Download
- A. Shahrizan A. Ghani and N. Ashidi M. Isa. 2015. Enhancement of low quality underwater image through integrated global and local contrast correction. Applied Soft Computing 37 (2015).Google Scholar
- D. Akkaynak and T. Treibitz. 2018. A revised underwater image formation model. In IEEE CVPR.Google Scholar
- D. Akkaynak and T. Treibitz. 2019. Sea-thru: A method for removing water from underwater images. In IEEE CVPR.Google Scholar
- C. O. Ancuti, C. Ancuti, C. De Vleeschouwer, and P. Bekaert. 2018. Color Balance and Fusion for Underwater Image Enhancement. IEEE Transactions on Image Processing 27, 1 (2018).Google ScholarCross Ref
- Dana Berman, Deborah Levy, Shai Avidan, and Tali Treibitz. 2020. Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset. IEEE Transactions on Pattern Analysis and Machine Intelligence (2020).Google ScholarCross Ref
- P. Charbonnier, L. Blanc-Feraud, G. Aubert, and M. Barlaud. 1994. Two deterministic half-quadratic regularization algorithms for computed imaging. In IEEE ICIP, Vol. 2.Google Scholar
- C. Fabbri, M. J. Islam, and J. Sattar. 2018. Enhancing Underwater Imagery Using Generative Adversarial Networks. In IEEE ICRA.Google Scholar
- Xueyang Fu, Peixian Zhuang, Yue Huang, Yinghao Liao, Xiao-Ping Zhang, and Xinghao Ding. 2014. A retinex-based enhancing approach for single underwater image. In 2014 IEEE International Conference on Image Processing (ICIP). 4572–4576. https://doi.org/10.1109/ICIP.2014.7025927Google ScholarCross Ref
- Zhenqi Fu, Huangxing Lin, Yan Yang, Shu Chai, Liyan Sun, Yue Huang, and Xinghao Ding. 2022. Unsupervised Underwater Image Restoration: From a Homology Perspective. Proceedings of the AAAI Conference on Artificial Intelligence 36, 1 (Jun. 2022), 643–651. https://doi.org/10.1609/aaai.v36i1.19944Google ScholarCross Ref
- Adrian Galdran, David Pardo, Artzai Picón, and Aitor Alvarez-Gila. 2015. Automatic Red-Channel underwater image restoration. Journal of Visual Communication and Image Representation 26 (2015), 132–145. https://doi.org/10.1016/j.jvcir.2014.11.006Google ScholarDigital Library
- J. Han, M. Shoeiby, T. Malthus, E. Botha, J. Anstee, S. Anwar, R. Wei, L. Petersson, and M. A. Armin. 2021. Single Underwater Image Restoration by Contrastive Learning. In IEEE International Geoscience and Remote Sensing Symposium (IGARSS).Google ScholarCross Ref
- Muhammad Suzuri Hitam, Ezmahamrul Afreen Awalludin, Wan Nural Jawahir Hj Wan Yussof, and Zainuddin Bachok. 2013. Mixture contrast limited adaptive histogram equalization for underwater image enhancement. In 2013 International Conference on Computer Applications Technology (ICCAT). 1–5. https://doi.org/10.1109/ICCAT.2013.6522017Google ScholarCross Ref
- Xun Huang and Serge Belongie. 2017. Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization. In ICCV.Google Scholar
- X. Huang, M. Y. Liu, S. Belongie, and J. Kautz. 2018. Multimodal unsupervised image-to-image translation. In ECCV.Google Scholar
- M. J. Islam, Y. Xia, and J. Sattar. 2020. Fast underwater image enhancement for improved visual perception. IEEE Robotics and Automation Letters 5, 2 (2020).Google ScholarCross Ref
- J. Johnson, A. Alahi, and L. Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In ECCV.Google Scholar
- C. Li, S. Anwar, J. Hou, R. Cong, C. Guo, and W. Ren. 2021. Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding. IEEE Transactions on Image Processing 30 (2021).Google Scholar
- C. Li, S. Anwar, and F. Porikli. 2020. Underwater scene prior inspired deep underwater image and video enhancement. Pattern Recognition 98(2020).Google Scholar
- C. Li, C. Guo, W. Ren, R. Cong, J. Hou, S. Kwong, and D. Tao. 2019. An underwater image enhancement benchmark dataset and beyond. IEEE Transactions on Image Processing 29 (2019).Google Scholar
- C. Li, C. Guo, W. Ren, R. Cong, J. Hou, S. Kwong, and D. Tao. 2020. An Underwater Image Enhancement Benchmark Dataset and Beyond. IEEE Transactions on Image Processing 29 (2020).Google Scholar
- C. Li, J. Guo, S. Chen, Y. Tang, Y. Pang, and J. Wang. 2016. Underwater image restoration based on minimum information loss principle and optical properties of underwater imaging. In IEEE ICIP.Google Scholar
- C. Y. Li, J. C. Guo, R. M. Cong, Y. W. Pang, and B. Wang. 2016. Underwater Image Enhancement by Dehazing With Minimum Information Loss and Histogram Distribution Prior. IEEE Transactions on Image Processing 25, 12 (2016).Google ScholarDigital Library
- Risheng Liu, Xin Fan, Ming Zhu, Minjun Hou, and Zhongxuan Luo. 2020. Real-World Underwater Enhancement: Challenges, Benchmarks, and Solutions Under Natural Light. IEEE Trans. Cir. and Sys. for Video Technol. 30, 12 (dec 2020), 4861–4875. https://doi.org/10.1109/TCSVT.2019.2963772Google ScholarDigital Library
- P. M Uplavikar, Z. Wu, and Z. Wang. 2019. All-in-One Underwater Image Enhancement Using Domain-Adversarial Learning. In IEEE CVPR Workshops.Google Scholar
- P. Kohli N. Silberman, D. Hoiem and R. Fergus. 2012. Indoor Segmentation and Support Inference from RGBD Images. In ECCV.Google Scholar
- K. Panetta, C. Gao, and S. Agaian. 2015. Human-visual-system-inspired underwater image quality measures. IEEE Journal of Oceanic Engineering 41, 3 (2015).Google Scholar
- Y. T. Peng, K. Cao, and P. C. Cosman. 2018. Generalization of the Dark Channel Prior for Single Image Restoration. IEEE Transactions on Image Processing 27 (2018).Google ScholarCross Ref
- Y. T. Peng and P. C. Cosman. 2017. Underwater Image Restoration Based on Image Blurriness and Light Absorption. IEEE Transactions on Image Processing 26, 4 (2017).Google ScholarDigital Library
- O. Ronneberger, P. Fischer, and T. Brox. 2015. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015.Google Scholar
- P. K. Sharma, I. Bisht, and A. Sur. 2021. Wavelength-based Attributed Deep Neural Network for Underwater Image Restoration. arXiv preprint arXiv:2106.07910(2021).Google Scholar
- Zhou Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4 (2004), 600–612. https://doi.org/10.1109/TIP.2003.819861Google ScholarDigital Library
- S. Woo, J. Park, J. Y. Lee, and I. S. Kweon. 2018. CBAM: Convolutional Block Attention Module. In ECCV 2018, V. Ferrari, M. Hebert, C. Sminchisescu, and Y. Weiss (Eds.).Google Scholar
- M. Yang and A. Sowmya. 2015. An underwater color image quality evaluation metric. IEEE Transactions on Image Processing 24, 12 (2015).Google ScholarDigital Library
- S. W. Zamir, A. Arora, S. Khan, M. Hayat, F. S. Khan, M. H. Yang, and L. Shao. 2021. Multi-Stage Progressive Image Restoration. In CVPR.Google Scholar
Index Terms
- Towards Realistic Underwater Dataset Generation and Color Restoration✱
Recommendations
Automatic Red-Channel underwater image restoration
New methodology to estimate the depth map in an underwater degraded scene.Novel method to handle the presence of artificial illumination in underwater images.Performance evaluation on images with different illumination and color predominancies. ...
Underwater image enhancement by color correction and color constancy via Retinex for detail preserving
AbstractIn underwater, light attenuation causes non-uniform illumination that degrades underwater image. To enhance the degraded image, we propose an underwater image enhancement method that includes color correction, color constancy, multi-...
Graphical abstractDisplay Omitted
Highlights- The formulation of color correction compensates the red and blue channels by masking.
Review on underwater image restoration and enhancement algorithms
ICIMCS '15: Proceedings of the 7th International Conference on Internet Multimedia Computing and ServiceThe serious degradation of underwater image is the result of light scattering by particles, and light absorption causes the color attenuation. Thus, the task of underwater enhancement is improving the visibility and restoring the color by removing ...
Comments