Document Type : Applied Article

Authors

RIV Lab., Department of Computer Engineering, Faculty of Engineering, Bu-Ali Sina University, Hamedan, Iran

Abstract

One of the challenges in digital image processing that we face today is the presence of haze in images. This challenge is particularly prominent in imaging areas with humid and rainy weather compared to other locations. Examples of AI-based systems that can be impacted by this type of challenge include smart traffic control cameras, autonomous vehicles, and Video Assistant Referee (VAR) systems in football stadiums, security and surveillance cameras, and more. Therefore, this paper aims to propose a method that can mitigate this problem using Self-Supervised Learning (SSL) and deep learning. To this end, a Convolutional Autoencoder Network (CAN) with Convolutional Block Attention Module (CBAM) was proposed to reduce haze from images. The advantage of the proposed method is using fewer layers and filters compared to other models introduced by previous researchers in this field and using more important convolutional channels and important image regions using CBAM. Experiments in this paper reveal that overusing large or numerous convolutional filters to generate diverse features can reduce a model's ability to dehaze images effectively. Thus, the number of filters should be carefully limited. On the other hand, a combined loss function was used to train the proposed architecture. The proposed model was trained and tested using NH-haze dataset and the Realistic Single Image Dehazing (RESIDE) dataset. To evaluate our method, we used structural similarity index measure (SSIM) and peak signal-to-noise ratio (PSNR). The test results of the proposed architecture showed that it has higher performance compared to the state-of-the-art in the field.

Keywords

Main Subjects

[1] B. S. Chaitanya, S. Mukherjee. "Single image dehazing using improved cycleGAN." Journal of Visual Communication and Image Representation, Vol. 74, pp. 103014, 2021.
 
[2] S. Zhang, X. Zhang, S. Wan, W. Ren, L. Zhao, L. Shen. "Generative adversarial and self-supervised dehazing network", IEEE Transactions on Industrial Informatics, Vol. 20, no. 3, pp. 4187-4197, March 2024.
 
[3] G. D’Angelo, F. Palmieri. "Network traffic classification using deep convolutional recurrent autoencoder neural networks for spatial–temporal features extraction", Journal of Network and Computer Applications, Vol. 173, pp. 102890, Jan. 2021.
 
[4] C. Y. Jeong, K. Moon, M. Kim. "An end-to-end deep learning approach for real-time single image dehazing", Journal of Real-Time Image Processing, Vol. 20, pp. 12, 2023.
 
[5] R. R. Choudhary, K. K. Jisnu, G. Meena. "Image dehazing using deep learning techniques", Procedia Computer Science, Vol. 167, pp. 1110-1119, 2020.
 
 
[6] C. A. Hartanto, L. Rahadianti. "Single image dehazing using deep learning", JOIV: International Journal on Informatics Visualization, Vol. 5, pp. 76-82, 2021.
 
[7] F. A. Dharejo, Y. Zhou, F. Deeba, M. A. Jatoi, M. A. Khan, G. A. Mallah, X. Wang. "A deep hybrid neural network for single image dehazing via wavelet transform", Optik, Vol.231, pp. 166462, 2021.
 
[8]S. Li, Q. Yuan, Y. Zhang, B. Lv, F. Wei. "Image dehazing algorithm based on deep learning coupled local and global features", Applied Sciences, Vol.  12, pp. 8552, 2022.
 
[9] G. H. Babu, V. K. Odugu, N. Venkatram, B. Satish, K. Revathi, B. J. Rao. "Development and performance evaluation of enhanced image dehazing method using deep learning networks", Journal of Visual Communication and Image Representation, Vol. 97, pp. 103976, 2023.
 
[10] M. Shakeri, M. H. Dezfoulian, H. Khotanlou. "Density-based histogram partitioning and local equalization for contrast enhancement of images". Journal of AI and Data Mining, Vol. 6, pp. 1–12, 2018.
 
[11] C. Wang, Z. Li, J. Wu, H. Fan, G. Xiao, H. Zhang. "Deep residual haze network for image dehazing and deraining", IEEE Access, Vol. 8, pp. 9488-9500, 2020.
 
[12] G. H. Babu, N. Venkatram. "ABF de-hazing algorithm based on deep learning CNN for single I-Haze detection", Advances in Engineering Software, Vol. 175, pp. 103341, 2023.
 
[13] C. Hodges, M. Bennamoun, H. Rahmani. "Single image dehazing using deep neural networks", Pattern Recognition Letters, Vol. 128, pp. 70–77, 2019.
 
[14] S. Yin, X. Yang, Y. Wang, Y. H. Yang. "Visual attention dehazing network with multi-level features refinement and fusion", Pattern Recognition, Vol. 118, pp 108021, 2021.
 
[15] S. Yin, Y. Wang, Y. H. Yang. "A novel image-dehazing network with a parallel attention block", Pattern Recognition, Vol. 102, pp. 107255, 2020.
 
[16] P. K. Balla, A. Kumar, R. Pandey. "A 4-channelled hazy image input generation and deep learning-based single image dehazing", Journal of Visual Communication and Image Representation,   Vol. 100, pp. 104099, 2024.
 
[17] K. Hu, F. Wu, Z. Zhan, J. Luo, H. Pu. "High-low level task combination for object detection in foggy weather conditions", Journal of Visual Communication and Image Representation, Vol. 98, pp 104042, 2024.
 
[18] C. H. Yeh, C. H. Huang, L. W. Kang, M. H. Lin. "Single image dehazing via deep learning-based image restoration", in Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Nov 2018, pp. 1609–1615.
 
[19] W. Ren, J. Pan, H. Zhang, X. Cao, M. H. Yang. "Single image dehazing via multi-scale convolutional neural networks with holistic edges", International Journal of Computer Vision, Vol. 128, pp. 240–259, 2020,
 
[20] Y. Zhang. "A better autoencoder for image: Convolutional autoencoder", ICONIP17-DCEC, Mar 2018. Available online: http://users.cecs.anu.edu.au/Tom.Gedeon/conf/ABCs2018/paper/ABCs2018_paper_58.pdf (accessed on 23 March 2017), 2018.
 
[21] S. Woo, J. Park, J. Y. Lee, I. S. Kweon. "CBAM: Convolutional block attention module", in Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 3–19.
 
[22] L. Chen, H. Zhang, J. Xiao, L. Nie, J. Shao, W. Liu, T. S. Chua. "SCA-CNN: Spatial and channel-wise attention in convolutional networks for image captioning", in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 5659–5667.
 
[23] C. O. Ancuti, C. Ancuti, R. Timofte. "NH-HAZE: An image dehazing benchmark with non-homogeneous hazy and haze-free images", in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020, pp. 444–445.
 
[24] B. Li, W. Ren, D. Fu, D. Tao, D. Feng, W. Zeng, Z. Wang. "Benchmarking single-image dehazing and beyond", IEEE Transactions on Image Processing, Vol. 28, pp. 492–505, 2018.
 
[25] C. Guo, Q. Yan, S. Anwar, R. Cong, W. Ren, C. Li. "Image dehazing transformer with transmission-aware 3D position embedding", in  Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Jun 2022, pp. 5812–5820.
 
[26] X. Qin, Z. Wang, Y. Bai, X. Xie, H. Jia. "FFA-Net: Feature fusion attention network for single image dehazing", in Proceedings of the AAAI Conference on Artificial Intelligence. 2020, pp. 11908–11915.
 
[27] X. Liu, Y. Ma, Z. Shi, J. Chen. "GridDehazeNet: Attention-based multi-scale network for image dehazing", in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Oct 2019, pp. 7313–7322.
 
[28] H. Dong, J. Pan, L. Xiang, Z. Hu, X. Zhang, F. Wang, M.-H. Yang. "Multi-scale boosted dehazing network with dense feature fusion", in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Jun 2020, pp. 157–2167.
 
[29] Q. Yi, J. Li, F. Fang, A. Jiang, G. Zhang. "Efficient and accurate multi-scale topological network for single image dehazing", IEEE Transactions on Multimedia, Vol. 24, pp. 3114–3128, 2022.
 
[30] H. Bai, J. Pan, X. Xiang, J. Tang. "Self-guided image dehazing using progressive feature fusion", IEEE Transactions on Image Processing, Vol. 31, pp. 1217–1229, 2022.
 
[31] Z. Chen, Z. He, Z.-M. Lu. "DEA-net: Single image dehazing based on detail-enhanced convolution and content-guided attention", arXiv: 2301.04805, 2023.
 
[32] K. He, J. Sun, X. Tang. "Single image haze removal using dark channel prior", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 33, pp. 2341–2353, 2010
 
[33] H. Wu, Y. Qu, S. Lin, J. Zhou, R. Qiao, Z. Zhang, Y. Xie, L. Ma. "Contrastive learning for compact single image dehazing", in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 10551–10560.
 
[34] R. Q. Wu, Z. P. Duan, C. L. Guo, Z. Chai, C. Li. "Ridcp: Revitalizing real image dehazing via high-quality codebook priors", in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 22282–22291.
 
[35] H. Yu, N. Zheng, M. Zhou, J. Huang, Z. Xiao, F. Zhao. "Frequency and spatial dual guidance for image dehazing", in European Conference on Computer Vision, 2022, pp. 181–198.
 
[36] H. Yu, J. Huang, K. Zheng, M. Zhou, F. Zhao. "High-quality image dehazing with diffusion model", arXiv: 2308.11949, 2023.