Semantic image inpainting with dense and dilated deep convolutional autoencoder adversarial network

Kun Ren; Chunqi Fan; Lisha Meng; Long Huang

doi:10.1117/12.2538756

18 November 2019 Semantic image inpainting with dense and dilated deep convolutional autoencoder adversarial network

Kun Ren, Chunqi Fan, Lisha Meng, Long Huang

Proceedings Volume 11187, Optoelectronic Imaging and Multimedia Technology VI; 1118712 (2019) https://doi.org/10.1117/12.2538756
Event: SPIE/COS Photonics Asia, 2019, Hangzhou, China

Abstract

The developments of generative adversarial networks (GANs) make it possible to fill missing regions in broken images with convincing details. However, many existing approaches fail to keep the inpainted content and structures consistent with their surroundings. In this paper, we propose a GAN-based inpainting model which can restore the semantic damaged images visually reasonable and coherent. In our model, the generative network has an autoencoder frame and the discriminator network is a CNN classifier. Different from the classic autoencoder, we design a novel bottleneck layer in the middle of the autoencoder which is comprised of four dense-net blocks and each block contains vanilla convolution layers and dilated convolution layers. The kernels of dilated convolution are spread out and result in an effective enlargement of the receptive field. Thus the model can capture more widely semantic information to ensure the consistency of inpainted images. Furthermore, the multiplex of different level’s features in each dense-net block can help the model understand the whole image better to produce a convincing image. We evaluate our model over the public datasets CelebA and Stanford Cars with random position masks of different ratios. The effectiveness of our model is verified by qualitative and quantitative experiments.

Citation Download Citation

Kun Ren, Chunqi Fan, Lisha Meng, and Long Huang "Semantic image inpainting with dense and dilated deep convolutional autoencoder adversarial network", Proc. SPIE 11187, Optoelectronic Imaging and Multimedia Technology VI, 1118712 (18 November 2019); https://doi.org/10.1117/12.2538756

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available