Interactive Multimodal System Characterization in the Internet of Things Context

Fabrice Poirier (1, 2) , Anthony Foulonneau (1) , Jérémy Lacoche (1) , Thierry Duval (2, 3)

1 Orange Labs [Cesson-Sévigné]
2 Lab-STICC_INUIT - Equipe Immersive Natural User Interaction team
3 IMT Atlantique - INFO - Département Informatique

The internet of things (IoT) is a chance to provide users with pervasive environments in which they can interact naturally with the environment. Multimodal interaction is the domain that provides this naturalness by using different senses to interact. However, the IoT context requires a specific process to create such multimodal systems. In this article, we investigate the process of creating multimodal systems with connected devices as interaction mediums, and provide an analysis of the existing tools to complete this process. We discuss tools that could be designed to support the creation process when the existing ones are not sufficient.

Keywords: Multimodal Interaction; Tools; Internet of Things

Domains: Computer Science [cs]; Human-Computer Interaction [cs.HC]; Computer Science [cs]; Graphics [cs.GR]; Computer Science [cs]; Ubiquitous Computing; Computer Science [cs]; Mobile Computing

Fabrice Poirier, Anthony Foulonneau, Jérémy Lacoche, Thierry Duval. Interactive Multimodal System Characterization in the Internet of Things Context. HUCAPP 2022, Feb 2022, Conférence Virtuelle en ligne, France. ⟨hal-03451478⟩