open access publication

Article, 2023

Design and Evaluation of a Multisensory Concert for Cochlear Implant Users

ARTS, Volume 12, 4, 10.3390/arts12040149

Contributors

Paisa, Razvan 0000-0002-3801-3793 (Corresponding author) [1] [2] Cavdir, Doga [3] Ganis, Francesco [2] Williams, Peter [2] Percy-Smith, Lone M. [4] [5] Serafin, Stefania 0000-0001-6971-1132 [2]

Affiliations

  1. [1] AC Meyers Vaenge 15, DK-2450 Copenhagen, Denmark
  2. [NORA names: Denmark; Europe, EU; Nordic; OECD];
  3. [2] Aalborg Univ, Multisensory Experience Lab, DK-2450 Copenhagen, Denmark
  4. [NORA names: AAU Aalborg University; University; Denmark; Europe, EU; Nordic; OECD];
  5. [3] Stanford Univ, Ctr Comp Res Mus & Acoust, Stanford, CA 94305 USA
  6. [NORA names: United States; America, North; OECD];
  7. [4] Rigshosp, Ctr Hearing & Balance, DK-2100 Copenhagen, Denmark
  8. [NORA names: Capital Region of Denmark; Hospital; Denmark; Europe, EU; Nordic; OECD];
  9. [5] Rigshosp, Ctr Hearing & Balance, DK-2100 Copenhagen, Denmark
  10. [NORA names: KU University of Copenhagen; University; Denmark; Europe, EU; Nordic; OECD]

Abstract

This article describes the design, implementation, and evaluation of vibrotactile concert furniture, aiming to improve the live music experience of people with hearing loss using hearing technology such as cochlear implants (CI). The system was the result of a series of participatory design sessions involving CI users with different hearing assistive setups (bi-implant, bimodal, and monoimplant), and it was evaluated in a concert scenario (drums, bass, and female vocals) at the Royal Danish Academy of Music. The project aimed to improve the music appreciation for CI users by providing a multisensory concert designed with CI challenges in mind, but not excluding normal-hearing individuals or individuals with other forms of hearing aids from participating in the event. The evaluation was based on (video-recorded) observations and postexperience semistructured interviews; the data were analyzed using event analysis and meaning condensation. The results indicate that tactile augmentation provides a pleasant experience for CI users. However, concertgoers with residual hearing reported being overwhelmed if the tactile stimulation amplitude exceeds a certain threshold. Furthermore, devices that highlight instrument segregation are preferred over ones that present a tactile mixdown of multiple auditory streams.

Keywords

audio-tactile mapping, cochlear implant music, live concerts, multisensory music, vibrotactile augmentation, vibrotactile music

Data Provider: Clarivate