Skip to Main content Skip to Navigation
Conference papers

Beat gesture prediction using prosodic features

Abstract : In this work we present a machine learning approach to gesture prediction using prosodic features. We use conditional random fields to predict the presence of beat gestures using the following prosodic features: pitch, pitch-derivatives, intensity and absence or presence of syllable nuclei. These features are calculated over overlapping sliding windows big enough to average out the high frequency variations associated with pitch and intensity at the syllable level. We found that the results improve remarkably when the classification is treated as a multi-class problem as opposed to a binary problem with the two classes: presence and absence of gesture.
Complete list of metadata
Contributor : Admin Télécom Paristech Connect in order to contact the contributor
Submitted on : Monday, July 24, 2017 - 10:52:58 AM
Last modification on : Tuesday, November 16, 2021 - 5:19:49 AM


  • HAL Id : hal-01567617, version 1


Varun Jain, Chloé Clavel, Catherine Pelachaud. Beat gesture prediction using prosodic features. 3rd International Workshop on Virtual Social Interaction (VSI 2017), Jul 2017, Bielefeld, Germany. ⟨hal-01567617⟩



Record views