Document Type : Original/Review Paper
Authors
Electrical & Computer Engineering Department, Babol Noshirvani University of Technology, Babol, Iran.
Abstract
Shadow detection provides worthwhile information for remote sensing applications, e.g. building height estimation. Shadow areas are formed in the opposite side of the sunlight radiation to tall objects, and thus, solar illumination angle is required to find probable shadow areas. In recent years, Very High Resolution (VHR) imagery provides more detailed data from objects including shadow areas. In this regard, the motivation of this paper is to propose a reliable feature, Shadow Low Gradient Direction (SLGD), to automatically determine shadow and solar illumination direction in VHR data. The proposed feature is based on inherent spatial feature of fine-resolution shadow areas. Therefore, it can facilitate shadow-based operations, especially when the solar illumination information is not available in remote sensing metadata. Shadow intensity is supposed to be dependent on two factors, including the surface material and sunlight illumination, which is analyzed by directional gradient values in low gradient magnitude areas. This feature considers the sunlight illumination and ignores the material differences. The method is fully implemented on the Google Earth Engine cloud computing platform, and is evaluated on VHR data with 0.3m resolution. Finally, SLGD performance is evaluated in determining shadow direction and compared in refining shadow maps.
Keywords
[1] M. Kakooei and Y. Baleghi, "Shadow detection in very high resolution RGB images using a special thresholding on a new spectral–spatial index," Journal of Applied Remote Sensing, Vol. 14, No. 1, p. 016503, 2020.
[2] M. Kakooei and Y. Baleghi, "Fusion of satellite, aircraft, and UAV data for automatic disaster damage assessment," International journal of remote sensing, Vol. 38, No. 8-10, pp. 2511-2534, 2017.
[3] M. Kakooei and Y. Baleghi, "Spectral Unmixing of Time Series Data to Provide Initial Object Seeds for Change Detection on Google Earth Engine," in 2019 27th Iranian Conference on Electrical Engineering (ICEE), 2019, pp. 1402-1407: IEEE.
[4] Y. Mostafa, "A review on various shadow detection and compensation techniques in remote sensing images," Canadian Journal of Remote Sensing, Vol. 43, No. 6, pp. 545-562, 2017.
[5] G. Vijayan, S. Reshma, F. Dhanya, S. Anju, G. R. Nair, and R. Aneesh, "A novel shadow removal algorithm using Niblack segmentation in satellite images," in Communication Systems and Networks (ComNet), International Conference on, 2016, pp. 184-189: IEEE.
[6] M. Kakooei and Y. Baleghi, "VHR Semantic Labeling by Random Forest Classification and Fusion of Spectral and Spatial Features on Google Earth Engine," Journal of AI and Data Mining, 2020.
[7] I. Doustfatemeh and Y. Baleghi, "Comprehensive urban area extraction from multispectral medium spatial resolution remote-sensing imagery based on a novel structural feature," International Journal of Remote Sensing, Vol. 37, No. 18, pp. 4225-4242, 2016.
[8] N. Kadhim, M. Mourshed, and M. Bray, "Shadow detection from very high resoluton satellite image using grabcut segmentation and ratio-band algorithms," 2015: International Society for Photogrammetry and Remote Sensing.
[9] M. Kakooei, Y. Baleghi, and M. Amani, "Adaptive thresholding for detecting building facades with or without openings in single-view oblique remote sensing images," Journal of Applied Remote Sensing, Vol. 15, No. 3, p. 036511, 2021.
[10] M. Kakooei and Y. Baleghi, "A two-level fusion for building irregularity detection in post-disaster VHR oblique images," Earth Science Informatics, pp. 1-19, 2020.
[11] Y. Li, P. Gong, and T. Sasagawa, "Integrated shadow removal based on photogrammetry and image analysis," International Journal of Remote Sensing, Vol. 26, No. 18, pp. 3911-3929, 2005.
[12] W. Huang and M. Bu, "Detecting shadows in high-resolution remote-sensing images of urban areas using spectral and spatial features," International Journal of Remote Sensing, Vol. 36, No. 24, pp. 6224-6244, 2015.
[13] E. Li, J. Femiani, S. Xu, X. Zhang, and P. Wonka, "Robust rooftop extraction from visible band images using higher order CRF," IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 8, pp. 4483-4495, 2015.
[14] J. Femiani, E. Li, A. Razdan, and P. Wonka, "Shadow-based rooftop segmentation in visible band images," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 8, No. 5, pp. 2063-2077, 2015.
[15] Y. Mostafa and A. Abdelhafiz, "Accurate shadow detection from high-resolution satellite images," IEEE Geoscience and Remote Sensing Letters, Vol. 14, No. 4, pp. 494-498, 2017.
[16] X. Huang and L. Zhang, "Morphological building/shadow index for building extraction from high-resolution imagery over urban areas," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 5, No. 1, pp. 161-172, 2012.
[17] C. Senaras and F. T. Y. Vural, "A self-supervised decision fusion framework for building detection," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 9, No. 5, pp. 1780-1791, 2016.
[18] A. O. Ok, "Automated detection of buildings from single VHR multispectral images using shadow information and graph cuts," ISPRS journal of photogrammetry and remote sensing, Vol. 86, pp. 21-40, 2013.
[19] H. Huang, G. Sun, J. Rong, A. Zhang, and P. Ma, "Multi-feature Combined for Building Shadow detection in GF-2 Images," in 2018 Fifth International Workshop on Earth Observation and Remote Sensing Applications (EORSA), 2018, pp. 1-4: IEEE.
[20] A. Manno-Kovács and A. O. Ok, "Building detection from monocular VHR images by integrated urban area knowledge," IEEE Geoscience and Remote Sensing Letters, Vol. 12, No. 10, pp. 2140-2144, 2015.
[21] B. Sirmacek and C. Unsalan, "Building detection from aerial images using invariant color features and shadow information," in Computer and Information Sciences, 2008. ISCIS'08. 23rd International Symposium on, 2008, pp. 1-5: IEEE.
[22] T.-T. Ngo, V. Mazet, C. Collet, and P. De Fraipont, "Shape-Based Building Detection in Visible Band Images Using Shadow Information," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 10, No. 3, pp. 920-932, 2017.
[23] A. O. Ok, C. Senaras, and B. Yuksel, "Automated detection of arbitrarily shaped buildings in complex environments from monocular VHR optical satellite imagery," IEEE Transactions on Geoscience and Remote Sensing, Vol. 51, No. 3, pp. 1701-1717, 2013.
[24] S. Xu et al., "Automatic Building Rooftop Extraction from Aerial Images via Hierarchical RGB-D Priors," IEEE Transactions on Geoscience and Remote Sensing, No. 99, pp. 1-19, 2018.
[25] S. Li, H. Tang, X. Huang, T. Mao, and X. Niu, "Automated Detection of Buildings from Heterogeneous VHR Satellite Images for Rapid Response to Natural Disasters," Remote Sensing, Vol. 9, No. 11, p. 1177, 2017.
[26] A. Rahimzadeganasl and E. Sertel, "Automatic building detection based on CIE LUV color space using very high resolution pleiades images," in Signal Processing and Communications Applications Conference (SIU), 2017 25th, 2017, pp. 1-4: IEEE.
[27] S. Basu et al., "A semiautomated probabilistic framework for tree-cover delineation from 1-m NAIP imagery using a high-performance computing architecture," IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 10, pp. 5690-5708, 2015.
[28] A. Ozdarici-Ok, "Automatic detection and delineation of citrus trees from VHR satellite imagery," International Journal of Remote Sensing, Vol. 36, No. 17, pp. 4275-4296, 2015.
[29] M. Kakooei and Y. Baleghi, "Leaf-Less-Tree feature for semantic labeling applications on Google Earth Engine," in Telecommunications (IST), 2018 9th International Symposium on, 2018: IEEE.
[30] G. Cheng, Y. Wang, S. Xu, H. Wang, S. Xiang, and C. Pan, "Automatic Road Detection and Centerline Extraction via Cascaded End-to-End Convolutional Neural Network," IEEE Transactions on Geoscience and Remote Sensing, Vol. 55, No. 6, pp. 3322-3337, 2017.
[31] Y. Bae, W.-H. Lee, Y. Choi, Y. W. Jeon, and J. B. Ra, "Automatic road extraction from remote sensing images based on a normalized second derivative map," IEEE Geoscience and remote sensing letters, Vol. 12, No. 9, pp. 1858-1862, 2015.
[32] E. Maggiori, Y. Tarabalka, G. Charpiat, and P. Alliez, "Can semantic labeling methods generalize to any city? the inria aerial image labeling benchmark," in IEEE International Symposium on Geoscience and Remote Sensing (IGARSS), 2017.
[33] N. Gorelick, M. Hancher, M. Dixon, S. Ilyushchenko, D. Thau, and R. Moore, "Google Earth Engine: Planetary-scale geospatial analysis for everyone," Remote Sensing of Environment, Vol. 202, pp. 18-27, 2017.
[34] M. Amani et al., "Google Earth Engine Cloud Computing Platform for Remote Sensing Big Data Applications: A Comprehensive Review," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020.
[35] M. Amani et al., "Application of Google Earth Engine Cloud Computing Platform, Sentinel Imagery, and Neural Networks for Crop Mapping in Canada," Remote Sensing, Vol. 12, No. 21, p. 3561, 2020.
[36] M. Amani et al., "Evaluation of the Landsat-based Canadian Wetland Inventory Map using Multiple Sources: Challenges of Large-scale Wetland Classification using Remote Sensing," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020.
[37] A. Ghorbanian, M. Kakooei, M. Amani, S. Mahdavi, A. Mohammadzadeh, and M. Hasanlou, "Improved land cover map of Iran using Sentinel imagery within Google Earth Engine and a novel automatic workflow for land cover classification using migrated training samples," ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 167, pp. 276-288, 2020.
[38] M. Kakooei, A. Nascetti, and Y. Ban, "Sentinel-1 global coverage foreshortening mask extraction: An open source implementation based on Google Earth Engine," in IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium, 2018, pp. 6836-6839: IEEE.
[39] M. Minnaert, The nature of light and colour in the open air. Courier Corporation, 2013.
[40] N. Su, Y. Zhang, S. Tian, Y. Yan, and X. Miao, "Shadow detection and removal for occluded object information recovery in urban high-resolution panchromatic satellite images," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 9, No. 6, pp. 2568-2582, 2016.
[41] C. Meis, LIGHT AND VACUUM: The Wave-Particle Nature of the Light and the Quantum Vacuum. Electromagnetic Theory and Quantum Electrodynamics Beyond the Standard Model. World Scientific, 2017.
[42] L. B. Wolff, S. K. Nayar, and M. Oren, "Improved diffuse reflection models for computer vision," International Journal of Computer Vision, Vol. 30, No. 1, pp. 55-71, 1998.
[43] W. M. Irvine, "The shadowing effect in diffuse reflection," Journal of Geophysical Research, Vol. 71, No. 12, pp. 2931-2937, 1966.
[44] V. Arévalo, J. González, and G. Ambrosio, "Shadow detection in colour high‐resolution satellite images," International Journal of Remote Sensing, Vol. 29, No. 7, pp. 1945-1963, 2008.
[45] X. Liu, Z. Hou, Z. Shi, Y. Bo, and J. Cheng, "A shadow identification method using vegetation indices derived from hyperspectral data," International Journal of Remote Sensing, Vol. 38, No. 19, pp. 5357-5373, 2017.
[46] Y. Mostafa and M. A. Abdelwahab, "Corresponding regions for shadow restoration in satellite high-resolution images," International Journal of Remote Sensing, pp. 1-15, 2018.
[47] N. Tatar, M. Saadatseresht, H. Arefi, and A. Hadavand, "a New Object-Based Framework to Detect Shodows in High-Resolution Satellite Imagery Over Urban Areas," The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 40, No. 1, p. 713, 2015.
)