| 引用本文: | 李海燕,晁艳静,李海江,等.并行生成卷积网络图像修复算法.[J].国防科技大学学报,2023,45(3):127-135.[点击复制] |
| LI Haiyan,CHAO Yanjing,LI Haijiang,et al.Algorithm on image restoration of parallel generation convolution network[J].Journal of National University of Defense Technology,2023,45(3):127-135[点击复制] |
|
| |
|
|
| 本文已被：浏览 4653次 下载 2670次 |
| 并行生成卷积网络图像修复算法 |
| 李海燕1,晁艳静1,李海江2,郭磊1,李红松1 |
|
(1. 云南大学 信息学院, 云南 昆明 650504;2. 云南交通投资建设集团有限公司(云南交投), 云南 昆明 650228)
|
| 摘要: |
| 为解决修复纹理精细、背景复杂图像中大面积不连续语义缺失时存在的边缘伪影和语义不连续的缺陷,提出一种并行生成卷积的残差连接图像修复算法。将残缺图像输入一个两列平行卷积的结构修复网络得到两个具有不同感受野大小的图像分量,通过共享解码合并两个图像分量并计算输出的L2损失优化网络。将结构修复网络的输出送入包含残差连接与注意力机制的细节修复网络,融合上下文信息,改善修复细节能力。使用全局与局部鉴别器和预训练视觉几何组网络计算损失,对修复网络进行整体判别优化,增强修复结果的整体与局部一致性。在国际公认数据库上验证提出算法的性能,实验结果表明:提出算法可以有效修复复杂背景且包含精细纹理的大面积不规则缺失区域,提升图像细节、语义和结构的真实性与完整性,其峰值信噪比和结构相似度优于经典的对比算法。 |
| 关键词: 图像修复 并行生成卷积 残差连接 注意力机制 门控卷积 |
| DOI：10.11887/j.cn.202303015 |
| 投稿日期：2021-06-29 |
| 基金项目:国家自然科学基金资助项目(62066046,81771928)；云南省基础研究计划重点资助项目(202101AS070031) |
|
| Algorithm on image restoration of parallel generation convolution network |
| LI Haiyan1, CHAO Yanjing1, LI Haijiang2, GUO Lei1, LI Hongsong1 |
|
(1. School of Information Science and Engineering, Yunnan University, Kunming 650504, China;2. Yunnan Communications Investment and Construction Group Co., Ltd., Kunming 650228, China)
|
| Abstract: |
| In order to solve the defects of edge artifacts and semantic discontinuity when inpainting large and irregular distortions in an image with fine texture and complex background, a residual connection image restoration algorithm based on parallel generation convolution was proposed. The damaged image was inputted into a two-column parallel convolutional structure inpainting network to obtain two image components with different sizes of reception fields. The two image components were combined by the shared decoding and the L2 loss of the output was calculated to optimize the network. The output of the coarse network was sent into the fine inpainting network which contained the residual connection and the attention mechanism to fuse context information and improve the ability of repairing fine details. The global and local discriminators and visual geometry group net were used to calculate the loss and to optimize the overall discrimination network and enhance the global and local consistency of the inpainting result. The performance of the proposed algorithm was validated on internationally recognized databases, and experimental results show that the proposed algorithm can effectively repair large and irregular missing areas under complex background and fine texture, improve the authenticity and integrity of image details, semantics and structure. Its peak signal-to-noise ratio and structural similarity are superior to the state-of-the-art. |
| Keywords: image inpainting parallel generation convolution residual connection attention mechanism gated convolution |
|
|
|
|
|
