Beat gesture prediction using prosodic features

Abstract :

In this work we present a machine learning approach to gesture prediction using prosodic features. We use conditional random fields to predict the presence of beat gestures using the following prosodic features: pitch, pitch-derivatives, intensity and absence or presence of syllable nuclei. These features are calculated over overlapping sliding windows big enough to average out the high frequency variations associated with pitch and intensity at the syllable level. We found that the results improve remarkably when the classification is treated as a multi-class problem as opposed to a binary problem with the two classes: presence and absence of gesture.

Complete list of metadatas

https://hal-imt.archives-ouvertes.fr/hal-01567617
Contributor : Admin Télécom Paristech <>
Submitted on : Monday, July 24, 2017 - 10:52:58 AM
Last modification on : Wednesday, November 27, 2019 - 11:24:10 AM

Identifiers

  • HAL Id : hal-01567617, version 1

Citation

Varun Jain, Chloé Clavel, Catherine Pelachaud. Beat gesture prediction using prosodic features. 3rd International Workshop on Virtual Social Interaction (VSI 2017), Jul 2017, Bielefeld, Germany. ⟨hal-01567617⟩

Share

Metrics

Record views

195