open access publication

Article, 2023

Modeling the effect of linguistic predictability on speech intelligibility prediction

JASA EXPRESS LETTERS, Volume 3, 3, 10.1121/10.0017648

Contributors

Edraki, Amin (Corresponding author) [1] Chan, Wai-Yip [1] Fogerty, Daniel [2] [3] Jensen, Jesper 0000-0003-1478-622X [4] [5]

Affiliations

  1. [1] Queens Univ, Dept Elect & Comp Engn, Kingston, ON K7L 3N6, Canada
  2. [NORA names: Canada; America, North; OECD];
  3. [2] Univ Illinois, Dept Speech & Hearing Sci, Champaign, IL 61820 USA
  4. [NORA names: United States; America, North; OECD];
  5. [3] Univ Illinois, Dept Speech & Hearing Sci, Champaign, IL 61820 USA
  6. [NORA names: United States; America, North; OECD];
  7. [4] Aalborg Univ, Dept Elect Syst, DK-9220 Aalborg, Denmark
  8. [NORA names: AAU Aalborg University; University; Denmark; Europe, EU; Nordic; OECD];
  9. [5] Demant AS, DK-2765 Smorum, Denmark
  10. [NORA names: Other Companies; Private Research; Denmark; Europe, EU; Nordic; OECD]

Abstract

Many existing speech intelligibility prediction (SIP) algorithms can only account for acoustic factors affecting speech intelligibility and cannot predict intelligibility across corpora with different linguistic predictability. To address this, a linguistic component was added to five existing SIP algorithms by estimating linguistic corpus predictability using a pre-trained language model. The results showed improved SIP performance in terms of correlation and prediction error over a mixture of four datasets, each with a different English open-set corpus.

Data Provider: Clarivate