Residual dual regression network for super-resolution reconstruction of remote sensing images
-
摘要: 使用人工模拟的高-低分辨率图像对易导致在对真实遥感图像超分辨率重建时模型泛化能力差,针对此问题,结合残差通道注意力网络(residual channel attention network,RCAN)的二次残差(residual in residual,RIR)模块,改进对偶回归网络(dual regression networks,DRN),提出了残差对偶回归网络(residual dual regression network,RDRN)。选取LandCover.ai和DIOR航空图像数据集的10 000张512像素x512像素图像构成样本数据集,用于训练和测试网络,并将重建结果与现有其他超分辨率网络模型的重建结果对比评价。实验结果表明,RDRN在重建质量和模型参数量方面均表现优异,能够在较低模型复杂度的情况下实现较好的超分重建效果,且对不同低分辨率遥感图像具有较好的泛化能力。Abstract: In order to solve the problem of poor model generalizing ability in real super-resolution reconstruction of remote sensing images, which is easily caused by the use of artificial high-low resolution image pairs, combined with the residual in residual (RIR) module of residual channel attention network (RCAN), dual regression network (DRN) is improved, and residual dual regression network (RDRN) is proposed. Ten thousand 512 × 512 pixel images from LandCover.ai and DIOR aerial image data sets were selected to form the sample data set for training and testing the network, and the reconstruction results were compared with those of other super-resolution network models. The experimental results show that RDRN has an excellent performance in both reconstruction quality and model parameters. It can achieve a better super segmentation reconstruction effect with lower model complexity and has good generalization ability for different low-resolution remote sensing images.
-
-
[1] 张艳, 卢宣铭, 刘国瑞, 等. 多路径特征融合的遥感图像超分辨率重建算法[J]. 遥感信息, 2021, 36(2):46-53.[1] Zhang Y, Lu X M, Liu G R, et al. Super resolution reconstruction algorithm of remote sensing image based on multi-path feature fusion[J]. Remote Sensing Information, 2021, 36(2):46-53.[2] Harris J L. Diffraction and resolving power[J]. Journal of the Optical Society of America, 1964, 54(7):931-936. [3] 苏衡, 周杰, 张志浩. 超分辨率图像重建方法综述[J]. 自动化学报, 2013, 39(8):1202-1213.[3] Su H, Zhou J, Zhang Z H. Review of super resolution image reconstruction methods[J]. Acta Automatica Sinica, 2013, 39(8):1202-1213. [4] Dong C, Loy C C, He K M, et al. Learning a deep convolutional network for image super-resolution[C]// David Fleet.Proceedings of European Conference on Computer Vision. Zurich: Computer Vision-ECCV, 2014,184-199.[5] Kim J, Lee J K, Lee K M. Accurate image super-resolution using very deep convolutional networks[C]// IEEE.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2016,1646-1654.[6] He K M, Zhang X Y, Ren S Q, et al. Deep residual learning for image recognition[C]// IEEE.Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016,770-778.[7] Kim J, Lee J K, Lee K M. Deeply-recursive convolutional network for image super-resolution[C]// IEEE.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016:1637-1645.[8] Tai Y, Yang J, Liu X. Image super-resolution via deep recursive residual network[C]// IEEE.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Honolulu:IEEE, 2017:3147-3155.[9] 刘帅, 朱亚杰, 薛磊. 一种结合稀疏表示和纹理分块的遥感影像超分辨率方法[J]. 武汉大学学报(信息科学版), 2015, 40(5):578-582.[9] Liu S, Zhu Y J, Xue L. A super resolution method for remote sensing image based on sparse representation and texture segmentation[J]. Geomatics and Information Science of Wuhan University, 2015, 40(5):578-582.[10] 吴琼, 田越, 周春平, 等. 遥感图像超分辨率研究的现状和发展[J]. 测绘科学, 2008, 33(6):66-69,15.[10] Wu Q, Tian Y, Zhou C P, et al. Current situation and development of research on super resolution of remote sensing image[J]. Surveying and Mapping Science, 2008, 33(6):66-69,15.[11] Shocher A, Cohen N, Irani M. [1] 刘钊, 于学峰. 太阳驱动地球环境变化研究进展[J]. 自然杂志, 2012, 34(3):154-156,160.[1] Liu Z, Yu X F. The progress in study of the effects of the solar variation on the earth environment[J]. Chinese Journal of Nature, 2012, 34(3):154-156,160.[2] Roberto R, Renzo R. Distributed estimation of incoming direct solar radiation over a drainage basin[J]. Journal of Hydrology, 1995, 166(3):461-478. [3] 赵康, 桂雪晨, 葛坚. 高大空间中太阳辐射对热舒适的影响及室内参数设计[J]. 太阳能学报, 2019, 40(9):2655-2662.[3] Zhao K, Gui X C, Ge J. Influence of solar radiation on thermal comfort in large spaces and corresponding design of indoor parameters[J]. Acta Energiae Solaris Sinica, 2019, 40(9):2655-2662.[4] 张欣欣, 景丽. 太阳能热水系统在建筑给排水设计中的应用[J]. 智能建筑与智慧城市, 2021(2):88-89.[4] Zhang X X, Jing L. Application of solar water heating system in the design of building water supply and drainage[J]. Intelligent Building and City Information, 2021(2):88-89.[5] 张佳飞. 多时间尺度太阳辐射估算模型[D]. 重庆: 西南大学, 2013.[5] Zhang J F. Estimation models of solar radiation at different time scales[D]. Chongqing: Xi‘nan University, 2013.[6] 吕宁. 近年来中国地表太阳辐射时空变化及影响因素分析[D]. 北京: 中国科学院地理科学与资源研究所, 2009.[6] Lyu N. Analysis of spatio-temporal variation of surface downward shortwave radiation and associated effecting factors over China in recent years[D]. Beijing: Institute of Geographic Sciences and Natural Resources Research, CAS, 2009.[7] 蔡子颖. 我国华东、中南地区地面太阳辐射变化规律及其原因分析[D]. 南京: 南京信息工程大学, 2009.[7] Cai Z Y. Analysis on the variation of surface solar radiation in East China,Central South China and its causes[D]. Nanjing: Nanjing University of Information Science and Technology, 2009.[8] 张星星, 吕宁, 姚凌, 等. ECMWF地表太阳辐射数据在我国的误差及成因分析[J]. 地球信息科学学报, 2018, 20(2):254-267. [8] Zhang X X, Lyu N, Yao L, et al. Error analysis of ECMWF surface solar radiation data in China[J]. Journal of Geo-Information Science, 2018, 20(2):254-267.[9] Zhang X T, Liang S L, Wang G X, et al. Evaluation of the reanalysis surface incident shortwave radiation products from NCEP,ECMWF,GSFC,and JMA using satellite and surface observations[J]. Remote Sensing, 2016, 8(3):225-237. [10] Wang A H, Zeng X B. Evaluation of multireanalysis products with in situ observations over the Tibetan Plateau[J]. Journal of Geophysical Research: Atmospheres, 2012, 117:D05102.[11] 陈昱文, 黄小猛, 李熠, 等. 基于ECMWF产品的站点气温预报集成学习误差订正[J]. 应用气象学报, 2020, 31(4):494-503.[11] Chen Y W, Huang X M, Li Y, et al. Ensemble learning for bias correction of station temperature forecast based on ECMWF products[J]. Journal of Applied Meteorological Science, 2020, 31(4):494-503.[12] 李净, 温松楠. 基于3种机器学习法的太阳辐射模拟研究[J]. 遥感技术与应用, 2020, 35(3):615-622.[12] Li J, Wen S N. Simulation of solar radiation based on three machine learning methods[J]. Remote Sensing Technology and Application, 2020, 35(3):615-622.[13] Benali L, Notton G, Fouilloy A, et al. Solar radiation forecasting using artificial neural network and random forest methods: Application to normal beam,horizontal diffuse and global components[J]. Renewable Energy, 2019, 132:871-884. [14] Yu W, Zhang X T, Hou N, et al. Estimation of surface downward shortwave radiation over China from AVHRR data based on four machine learning methods[J]. Solar Energy, 2019, 177:32-46. [15] 许立兵, 王安喜, 汪纯阳, 等. 基于机器学习的海洋环境预报订正方法研究[J]. 海洋通报, 2020, 39(6):695-704.[15] Xu L B, Wang A X, Wang C Y, et al. Research on correction method of marine environment prediction based on machine learning[J]. Marine Science Bulletin, 2020, 39(6):695-704.[16] 陈有龙, 宁雨珂, 唐荣年, 等. 基于时空独立的随机森林模型对海南热带气温数值预报的订正[J]. 海南大学学报(自然科学版), 2020, 38(4):356-364.[16] Chen Y L, Ning Y K, Tang R N, et al. Tropical temperature correction for numerical forecast in Hainan based on spatiotemporal independence random forest model[J]. Natural Science Journal of Hainan University, 2020, 38(4):356-364.[17] 芦华, 谢旻, 吴钲, 等. 基于机器学习的成渝地区空气质量数值预报PM2.5订正方法研究[J]. 环境科学学报, 2020, 40(12):4419-4431.[17] Lu H, Xie M, Wu Z, et al. Adjusting PM2.5 prediction of the numerical air quality forecast model based on machine learning methods in Chengyu region[J]. Acta Scientiae Circumstantiae, 2020, 40(12):4419-4431.[18] Babar B, Luppino L T, BostrOm T, et al. Random forest regression for improved mapping of solar irradiance at high latitudes[J]. Solar Energy, 2019, 198:81-92. “Zero-shot” super-resolution using deep internal learning[C]// IEEE.Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City: IEEE, 2018:3118-3126.[12] Bulat A, Yang J, Tzimiropoulos G. To learn image super-resolution,use a GAN to learn how to do image degradation first[C]// Vittorio Ferrari.Proceedings of the European Conference on Computer Vision).Munich:ECCV, 2018:185-200.[13] Yi Z L, Zhang H, Tan P, et al. DualGAN:unsupervised dual learning for image-to-image translation[C]// IEEE.Proceedings of the IEEE International Conference on Computer Vision.Venice:ICCV, 2017:2868-2876.[14] Ledig C, Theis L, Huszar F, et al. Photo-realistic single image super-resolution using a generative adversarial network[C]// IEEE.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Honolulu:IEEE, 2017:4681-4690.[15] Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition[J/OL]. https://arxiv.org/abS/1409.1556v3.[16] Yuan Y, Liu S, Zhang J, et al. Unsupervised image super-resolution using cycle-in-cycle generative adversarial networks[C]// IEEE. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops: IEEE, 2018:701-710.[17] Zhu J Y, Park T, Isola P, et al. Unpaired image-to-image translation using cycle-consistent adversarial networks[C]// IEEE.Proceedings of the IEEE International Conference on Computer Vision.Venice:IEEE, 2017:2223-2232.[18] 陈赛健, 朱远平. 基于生成对抗网络的文本图像联合超分辨率与去模糊方法[J]. 计算机应用, 2020, 40(3):859-864.[18] Chen S J, Zhu Y P. Text image joint super resolution and deblurring method based on generative countermeasure network[J]. Computer Applications, 2020, 40(3):859-864.[19] 李欣, 韦宏卫, 张洪群. 结合深度学习的单幅遥感图像超分辨率重建[J]. 中国图象图形学报, 2018, 23(2):209-218.[19] Li X, Wei H W, Zhang H Q. Super resolution reconstruction of single remote sensing image combined with deep learning[J]. Chinese Journal of Image Graphics, 2018, 23(2):209-218.[20] Guo Y, Chen J, Wang J, et al. Closed-loop matters:Dual regression networks for single image super-resolution[C]// IEEE.IEEE Conference on Computer Vision and Pattern Recognition.Seattle:CVPR, 2020:5407-5416.[21] Zhang Y, Li K, Li K, et al. Image super-resolution using very deep residual channel attention networks[C]// Vittorio Ferrari.Proceedings of the European Conference on Computer Vision.Munich:ECCV, 2018:286-301.[22] Fu J, Liu J, Tian H, et al. Dual attention network for scene segmentation[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Long Beach: IEEE, 2019:3141-3149.[23] Yu Z, Qiang Y. An overview of multi-task learning[J]. National Science Review, 2018, 5(1):30-43. [24] 周飞燕, 金林鹏, 董军. 卷积神经网络研究综述[J]. 计算机学报, 2017, 40(6):1229-1251.[24] Zhou F Y, Jin L P, Dong J. Review of convolutional neural networks[J]. Chinese Journal of Computers, 2017, 40(6):1229-1251.[25] 张顺, 龚怡宏, 王进军. 深度卷积神经网络的发展及其在计算机视觉领域的应用[J]. 计算机学报, 2019, 42(3):453-482.[25] Zhang S, Gong Y H, Wang J J. Development of deep convolutional neural network and its application in computer vision[J]. Chinese Journal of Computers, 2019, 42(3):453-482.[26] Boguszewski A, Batorski D, Ziemba-Jankowska N, et al. LandCover. ai:Dataset for automatic mapping of buildings,woodlands,water and roads from aerial imagery[C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Nashville:IEEE, 2021:1102-1110.[27] Li K, Wan G, Cheng G, et al. Object detection in optical remote sensing images:A survey and a new benchmark[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2020, 159:296-307. [28] Wan M, Yazid, et al. A review of image quality assessment (IQA):SNR,GCF,AD,NAE,PSNR,ME[J]. Journal of Advanced Research in Computing and Applications. 2017, 7(1):1-7.
-
计量
- 文章访问数: 911
- PDF下载数: 34
- 施引文献: 0