open access publication

Review, 2024

Emotion recognition and artificial intelligence: A systematic review (2014-2023) and research recommendations

INFORMATION FUSION, ISSN 1566-2535, 1566-2535, Volume 102, 10.1016/j.inffus.2023.102019

Contributors

Khare, Smith K. (Corresponding author) [1] Blanes-Vidal, Victoria 0000-0002-9269-4526 [1] Nadimi, Esmaeil S. [1] Acharya, Rajendra 0000-0002-2714-0068 [2]

Affiliations

  1. [1] Univ Southern Denmark, Maersk Mc Kinney Moller Inst, Fac Engn, Appl & Data Sci Unit, Odense, Denmark
  2. [NORA names: SDU University of Southern Denmark; University; Denmark; Europe, EU; Nordic; OECD];
  3. [2] Univ Southern Queensland, Sch Math Phys & Comp, Springfield, Qld, Australia
  4. [NORA names: Australia; Oceania; OECD]

Abstract

Emotion recognition is the ability to precisely infer human emotions from numerous sources and modalities using questionnaires, physical signals, and physiological signals. Recently, emotion recognition has gained attention because of its diverse application areas, like affective computing, healthcare, human-robot interactions, and market research. This paper provides a comprehensive and systematic review of emotion recognition techniques of the current decade. The paper includes emotion recognition using physical and physiological signals. Physical signals involve speech and facial expression, while physiological signals include electroencephalogram, electrocardiogram, galvanic skin response, and eye tracking. The paper provides an introduction to various emotion models, stimuli used for emotion elicitation, and the background of existing automated emotion recognition systems. This paper covers comprehensive searching and scanning of wellknown datasets followed by design criteria for review. After a thorough analysis and discussion, we selected 142 journal articles using PRISMA guidelines. The review provides a detailed analysis of existing studies and available datasets of emotion recognition. Our review analysis also presented potential challenges in the existing literature and directions for future research.

Keywords

Artificial intelligence, Deep learning, Electrocardiogram, Electroencephalogram, Emotion recognition, Eye tracking, Facial images, Galvanic skin response, Machine learning, Speech

Data Provider: Clarivate