Automatic Generation of Interactive 3D Characters and Scenes for Virtual Reality from a Single-Viewpoint 360-Degree Video - CAO et robotique (CAOR) Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Automatic Generation of Interactive 3D Characters and Scenes for Virtual Reality from a Single-Viewpoint 360-Degree Video

Alexis Paljic

Résumé

This work addresses the problem of using real-world data captured from a single viewpoint by a low-cost 360-degree camera to create an immersive and interactive virtual reality scene. We combine different existing state-of-the-art data enhancement methods based on pre-trained deep learning models to quickly and automatically obtain 3D scenes with animated character models from a 360-degree video. We provide details on our implementation and insight on how to adapt existing methods to 360-degree inputs. We also present the results of a user study assessing the extent to which virtual agents generated by this process are perceived as present and engaging.
Fichier principal
Vignette du fichier
deDinechinPaljic2019Automatic.pdf (9.7 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02114141 , version 1 (29-04-2019)
hal-02114141 , version 2 (27-02-2020)

Identifiants

Citer

Grégoire Dupont de Dinechin, Alexis Paljic. Automatic Generation of Interactive 3D Characters and Scenes for Virtual Reality from a Single-Viewpoint 360-Degree Video. 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Mar 2019, Osaka, Japan. ⟨10.1109/vr.2019.8797969⟩. ⟨hal-02114141v2⟩
133 Consultations
212 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More