IMPROVED VIEW SYNTHESIS BY MOTION WARPING AND TEMPORAL HOLE FILLING

Andrei Purica (1, 2) , Elie Gabriel Mora (1, 2) , Beatrice Pesquet-Popescu (1, 2) , Marco Cagnazzo (1, 2) , Bogdan Ionescu (3)

1 MM - Multimédia
2 TSI - Département Traitement du Signal et des Images
3 UPB - University Politehnica of Bucharest [Romania]

View synthesis received increasing attention over the last years, as it offers a wide range of practical applications like Free Viewpoint Television, 3D video, video gaming, etc. The main issues in view synthesis are the filling of disoccluded areas and the warping of real views. In this paper we propose a new hole filling method, it uses temporal correlations in the real views to extract information on disoccluded areas from different time instants in the synthetic view. We also propose a sub-pixel warping technique that takes into account depth and can be used for both the warping of the real view as well as for motion compensation. Our method is proved to bring gains of up to 0.31dB in average over several multiview test sequences.

Keywords: view synthesis; multiview video; hole filling; depth-image-based-rendering

Domains: Multimedia [cs.MM]

Andrei Purica, Elie Gabriel Mora, Beatrice Pesquet-Popescu, Marco Cagnazzo, Bogdan Ionescu. IMPROVED VIEW SYNTHESIS BY MOTION WARPING AND TEMPORAL HOLE FILLING. International Conference on Acoustics, Speech and Signal Processing, Apr 2015, Brisbane, Australia. ⟨hal-01223704⟩