Dual-Way Guided Depth Image Inpainting with RGBD Image Pairs

  • Hua Yuan
  • , Yuanyuan Zhou
  • , Yun Sheng*
  • , Guixu Zhang
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Raw depth images acquired by low-cost range imaging sensors, such as Kinect v1 and Kinect v2, usually contain invalid regions without depth information and suffer from noise. Although many approaches are proposed to address the problems, the robustness of these approaches still needs enhancement. This paper introduces a dual-way guided inpainting method with RGBD image pairs to restore the missing depth values of invalid regions and to eliminate noise caused by acquisition apparatus. By leveraging the structural difference between the colour and depth images, the colour image is first segmented with watershed segmentation and then merged under the guidance of the simultaneously captured depth image, followed by inpainting the depth image guided by the merged colour image using Radial Basis Functions (RBFs). The proposed framework of the dual-way guided approach with the RBFs is new for depth image inpainting and outperforms the existing state-of-the-art approaches in the experimental evaluations.

Original languageEnglish
Title of host publicationMultiMedia Modeling - 24th International Conference, MMM 2018, Proceedings
EditorsKlaus Schoeffmann, Moncef Gabbouj, Noel E. O'Connor, Ahmed Elgammal, Thanarat H. Chalidabhongse, Supavadee Aramvith, Chong Wah Ngo, Yo-Sung Ho
PublisherSpringer Verlag
Pages178-189
Number of pages12
ISBN (Print)9783319736020
DOIs
StatePublished - 2018
Event24th International Conference on MultiMedia Modeling, MMM 2018 - Bangkok, Thailand
Duration: 5 Feb 20187 Feb 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10704 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference24th International Conference on MultiMedia Modeling, MMM 2018
Country/TerritoryThailand
CityBangkok
Period5/02/187/02/18

Keywords

  • Depth image inpainting
  • Guided filtering
  • Image processing
  • Multimedia sensor
  • RBF

Fingerprint

Dive into the research topics of 'Dual-Way Guided Depth Image Inpainting with RGBD Image Pairs'. Together they form a unique fingerprint.

Cite this