Technical Program

Paper Detail

Paper IDD-3-3.3
Paper Title Image Inpainting using Weighted Mask Convolution
Authors Jiwoo Kang, Seongmin Lee, Suwoong Heo, Sanghoon Lee, Yonsei University, Korea (South)
Session D-3-3: Image and video processing based on deep learning
TimeThursday, 10 December, 17:30 - 19:30
Presentation Time:Thursday, 10 December, 18:00 - 18:15 Check your Time Zone
All times are in New Zealand Time (UTC +13)
Topic Image, Video, and Multimedia (IVM): Special Session: Image and video processing based on deep learning
Abstract Despite of many efforts for handling various holes, it has been not sufficiently resolved and the instability and normalization issues exists due to the presence of the invalid pixels. We proposed the weighted convolution that balances the valid and invalid pixels throughout the networks to help the network efficiently cope with various hole shapes. In our convolution layer, the mask is utilized to store the validity of the features by using the real-valued mask. A weighted scheme for the normalization layers is also proposed to adaptively operate along with the weighted convolution. By balancing upon the invalid pixels caused by the holes and zero-paddings, the network can be trained more robust to the hole shapes. The experimental results verified that our method achieved improvements over the state-of-the-art inpainting methods.