Document Type : Original/Review Paper

Authors

1 Department of Computer Engineering, ST.C., Islamic Azad University, Tehran, Iran,

2 Department of Computer Engineering, ST.C., Islamic Azad University, Tehran, Iran

3 Department of Applied Mathematics, ST.C., Islamic Azad University, Tehran, Iran,

Abstract

This paper introduces a novel approach to enhance the quality of images captured under low-light conditions. The method optimizes the parameters of the established Li method by employing the evolutionary Particle Swarm Optimization (PSO) algorithm. A key contribution of this research is the formulation of a comprehensive loss function for the PSO algorithm, derived from the integration of entropy loss, edge pixel loss, and average desired image brightness loss. The objective of this optimization process is to determine the optimal parameter set for the base method, thereby improving the preservation of image structure, increasing brightness while maintaining edge details, and ensuring the overall brightness of the resulting image remains within a desirable range. An iterative optimization strategy is employed to address the resulting optimization problem. The performance of the proposed method is evaluated through quantitative and qualitative analyses on the SICE dataset and benchmarked against several state-of-the-art low-light image enhancement techniques. Quantitative evaluation, utilizing metrics such as PSNR, SSIM, PIQE, NIQE, BRISQUE, and NIMA, demonstrates that the proposed parameter tuning of the base method, guided by the PSO algorithm and our comprehensive loss function, achieves competitive or superior performance in preserving image structure and details, generating images with natural visual quality, and suppressing noise in comparison to numerous existing methods. This research highlights the efficacy of the evolutionary PSO algorithm in identifying optimal configurations for a physical model-based method aimed at enhancing the quality of low-light imagery.

Keywords

Main Subjects

[1]  M. A. Al Wadud, M. H. Kabir, M. A. A. Dewan, and O. Chae, "A dynamic histogram equalization for image contrast enhancement," IEEE transactions on consumer electronics, Vol. 53, pp. 593-600, 2007.
[2] H. Rastegar, H. Khotanlou, "Image Dehazing Using a Convolutional Autoencoder Network with Integrated Convolutional Block Attention," Journal of AI and Data Mining, Vol. 13, pp. 393-405, 2025. ‏
[3] K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "Image denoising by sparse 3-D transform-domain collaborative filtering,"    IEEE Transactions on Image Processing, Vol. 16, pp. 2080-2095, 2007.
[4] K. G. Lore, A. Akintayo, and S. Sarkar, "LLNet: A deep autoencoder approach to natural low-light image enhancement," Pattern Recognition, Vol. 61, pp. 650-662, 2017.
[5] T. Wang, K. Zhang, T. Shen, W. Luo, B. Stenger, and T. Lu, "Ultra-High-Definition Low-Light Image Enhancement: A Benchmark and Transformer-Based Method," in Proceedings of the 37th AAAI Conference on Artificial Intelligence, 2023, pp. 2654-2662.
[6] C. Guo et al., "Zero-reference deep curve estimation for low-light image enhancement," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2020, pp. 1780-1789.
[7] A. Mi, W. Luo, Y. Qiao, and Z. Huo, "Rethinking Zero-DCE for Low-Light Image Enhancement," Neural Processing Letters, Vol. 56.2, pp. 93, 2024.
[8] X. Gao, K. Zhao, L. Han, and J. Luo, "BézierCE: Low-Light Image Enhancement via Zero-Reference Bézier Curve Estimation," Sensors, Vol. 23.23, pp. 9593, 2023.
[9] E. H. Land, "The retinex theory of color vision," Scientific american, Vol. 237.6, pp. 108-129, 1977.
[10] D. J. Jobson, Z. U. Rahman, and G. A. Woodell, "Properties and performance of a center/surround retinex," IEEE transactions on image processing, Vol. 6.3, pp. 451-462, 1997.
[11] D. J. Jobson, Z. U. Rahman, and G. A. Woodell, "A multiscale retinex for bridging the gap between color images and the human observation of scenes," IEEE transactions on image processing, Vol. 6.7, pp. 965-976, 1997.
[12] S. Wang, J. Zheng, H. M. Hu, and B. Li, "Naturalness preserved enhancement algorithm for non-uniform illumination images," IEEE transactions on image processing, Vol. 22.9, pp. 3538-3548, 2013.
[13] X. Fu, D. Zeng, Y. Huang, Y. Liao, X. Ding, and J. Paisley, "A fusion-based enhancing method for weakly illuminated images," Signal Processing, Vol. 129, pp. 82-96, 2016.
[14] X. Guo, Y. Li, and H. Ling, "LIME: Low-light image enhancement via illumination map estimation," IEEE transactions on image processing, Vol. 26.2, pp. 982-993, 2016.
[15] X. Fu, D. Zeng, Y. Huang, X. P. Zhang, and X. Ding, "A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2016, pp. 2782-2790.
[16] J. Hai et al., "R2RNet: Low-light image enhancement via Real-low to Real-normal Network," Journal of Visual Communication and Image Representation, Vol. 90, pp. 103712, 2023.
[17] M. Li, J. Liu, W. Yang, X. Sun, and Z. Guo, "Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model," IEEE transactions on image processing, Vol. 27.6, pp. 2828-2841, 2018.
[18] E. Provenzi, D. Marini, L. De Carli, and A. Rizzi, "Mathematical definition and analysis of the Retinex algorithm," Journal of the Optical Society of America A, Vol. 22.12, pp. 2613-2621, 2005.
[19] R. Grosse, M. K. Johnson, E. H. Adelson, and W. T. Freeman, "Ground truth dataset and baseline evaluations for intrinsic image algorithms," in Proceedings of the IEEE International Conference on Computer Vision, 2009, pp. 2335-2342.
[20] Q. Chen and V. Koltun, "A simple model for intrinsic image decomposition with depth cues," in Proceedings of the IEEE International Conference on Computer Vision, 2013, pp. 241-248.
[21] P. Y. Laffont, A. Bousseau, and G. Drettakis, "Rich intrinsic image decomposition of outdoor scenes from multiple views," IEEE transactions on visualization and computer graphics, Vol. 19.2, pp. 210-224, 2012.
[22] S. Bell, K. Bala, and N. Snavely, "Intrinsic images in the wild," ACM Transactions on Graphics, Vol. 33.4, pp. 1-12, 2014.
[23] A. Meka, M. Zollhöfer, C. Richardt, and C. Theobalt, "Live intrinsic video," ACM Transactions on Graphics, Vol. 35.4, pp. 1-14, 2016.
[24] J. T. Barron and J. Malik, "Color constancy, intrinsic images, and shape estimation," in European Conference on Computer Vision. Berlin, Heidelberg, 2012,  pp. 57-70.
[25] Y. Li and M. S. Brown, "Single image layer separation using relative smoothness," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2014, pp. 2752-2759.
[26] M. Elad, "Retinex by two bilateral filters," in International conference on scale-space theories in computer vision. Berlin, Heidelberg, 2005, pp. 217-229.
[27] W. Li, B. Gu, J. Huang, and M. Wang, "Novel Retinex algorithm by interpolation and adaptive noise suppression," Journal of Central South University, Vol. 19.9, pp. 2541-2547, 2012.
[28] X. Yu, X. Luo, G. Lyu, and S. Luo, "A novel Retinex based enhancement algorithm considering noise," in IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS), 2017, pp. 649-654.
[29] Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, "Edge-preserving decompositions for multi-scale tone and detail manipulation," ACM transactions on graphics (TOG), Vol. 27.3, pp. 1-10, 2008.
[30] X. Guo, Y. Li, J. Ma, and H. Ling, "Mutually Guided Image Filtering," 25th ACM international conference on Multimedia, 2017, pp. 1283-1290.
[31] X. Fu, Y. Liao, D. Zeng, Y. Huang, X. P. Zhang, and X. Ding, "A Probabilistic Method for Image Enhancement with Simultaneous Illumination and Reflectance Estimation," IEEE Transactions on Image Processing, Vol. 24.12, pp. 4965-4977, 2015.
[32] C. Wang and Z. F. Ye, "Variational enhancement for infrared images," Journal of Infrared and Millimeter Waves, Vol. 25.4, pp. 306-310, 2006.
[33] Y. Wang, W. Yin, and J. Zeng, "Global Convergence of ADMM in Nonconvex Nonsmooth Optimization," Journal of Scientific Computing, Vol. 78.1, pp. 29-63, 2019.
[34] Y. Xu, W. Yin, Z. Wen, and Y. Zhang, "An alternating direction algorithm for matrix completion with nonnegative factors," Frontiers of Mathematics in China, Vol. 7.2, pp. 365-384, 2012.
[35] Y. Zhou, C. Shi, B. Lai, and G. Jimenez, "Contrast enhancement of medical images using a new version of the World Cup Optimization algorithm," Quantitative imaging in medicine and surgery, Vol. 9.9, pp. 1528, 2019.
[36] C. Lee, C. S. Kim, and C. Lee, "Contrast enhancement based on layered difference representation of 2D histograms," IEEE transactions on image processing, Vol. 22.12, pp. 5372-5384, 2013.
[37] Y. Zhang, J. Zhang, and X. Guo, "Kindling the darkness: A practical low-light image enhancer," in Proceedings of the 27th ACM international conference on multimedia, 2019, pp. 1632-1640.
[38] K. Ko and C. S. Kim, "IceNet for Interactive Contrast Enhancement," IEEE Access, Vol. 9, pp. 168342-168354, 2021.
[39] C. Schlick, "Quantization Techniques for Visualization of High Dynamic Range Pictures," in Photorealistic rendering techniques. Berlin, Heidelberg,  1995, pp. 7-20.
[40] J. Cai, S. Gu, and L. Zhang, "Learning a deep single image contrast enhancer from multi-exposure images," IEEE Transactions on Image Processing, Vol. 27.4, pp. 2049-2062, 2018.