The Journal of China Universities of Posts and Telecommunications ›› 2022, Vol. 29 ›› Issue (5): 83-91.doi: 10.19682/j.cnki.1005-8885.2022.0005

Previous Articles     Next Articles

TSR: algorithm of image hole-filling based on three-step repairing

Li Fucheng, Deng Junyong, Zhu Yun, Luo Jiaying, Ren Han   

  • Received:2021-05-31 Revised:2021-09-16 Online:2022-10-31 Published:2022-10-28

Abstract:

In order to solve the hole-filling mismatch problem in virtual view synthesis, a three-step repairing (TSR) algorithm was proposed. Firstly, the image with marked holes is decomposed by the non-subsampled shear wave transform ( NSST), which will generate high-/ low-frequency sub-images with different resolutions. Then the improved Criminisi algorithm was used to repair the texture information in the high-frequency sub-images, while the improved curvature driven diffusion (CDD) algorithm was used to repair the low-frequency sub-images with the image structure information. Finally, the repaired parts of high-frequency and low-frequency sub-images are synthesized to obtain the final image through inverse NSST. Experiments show that the peak signal-to-noise ratio (PSNR) of the TSR algorithm is improved by an average of 2 - 3 dB and 1 - 2 dB compared with the Criminisi algorithm and the nearest neighbor interpolation (NNI) algorithm, respectively.

Key words: virtual view point synthesis| hole-filling| three-step repairing (TSR)| Criminisi algorithm| curvature driven diffusions (CDD) algorithm