DESIGNING THE BALANCE BETWEEN SOUND AND TOUCH: METHODS FOR MULTIMODAL COMPOSITION - Ecole Normale Supérieure paris-Saclay Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

DESIGNING THE BALANCE BETWEEN SOUND AND TOUCH: METHODS FOR MULTIMODAL COMPOSITION

Roland Cahen
  • Fonction : Auteur
  • PersonId : 1006373

Résumé

In this paper, we discuss key research questions generatedfrom a collaborative workshop, during which our aim wasto explore the potential of a wearable device to producenovel audio-haptic sensory experiences. The main inten-tion of this research is to enable users with any type ofhearing profile to appreciate a body-centered listening ex-perience. The multimodal harness, developed by the co-authors, integrates nine voice coil actuators into a wear-able structure, stimulating both the auditory and tactilesenses via extra-tympanic sound conduction and vibrotac-tile stimulation of the skin on the upper body (spine, clavi-cles, ribs). We need to create our own interfaces in order tojudge its capacity to elicit three modes of vibratory soundperception: auditory, tactile and bi-modal. To this end,we used the Max environment to make several prelimi-nary authoring tools, whose compositional features allowus to explore three main themes of sensory composition:multimodal music listening experiences, spatialization ofaudio-haptic signals on the body, and sensory equaliza-tion. Feedback from trial sessions, along with currentconstraints due to the wearable and interface design, giveus direction for our future work: iterate to improve thesensory experience of the multimodal harness, and applythese tools experimentally in order to contribute to multi-sensory processing resear
Fichier principal
Vignette du fichier
RichardsCahenMisdariis-SMCSubmission (1).pdf (13.06 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04048075 , version 1 (27-03-2023)

Identifiants

  • HAL Id : hal-04048075 , version 1

Citer

Claire Richards, Roland Cahen, Nicolas Misdariis. DESIGNING THE BALANCE BETWEEN SOUND AND TOUCH: METHODS FOR MULTIMODAL COMPOSITION. 19th Sound and Music Computing Conference (SMC 2022), Jun 2022, Saint-Etienne, France. pp.426-433. ⟨hal-04048075⟩
39 Consultations
15 Téléchargements

Partager

Gmail Facebook X LinkedIn More