Abstract
We present a flexible human–robot interaction architecture that incorporates emotions and moods to provide a natural experience for humans. To determine the emotional state of the user, information representing eye gaze and facial expression is combined with other contextual information such as whether the user is asking questions or has been quiet for some time. Subsequently, an appropriate robot behaviour is selected from a multi-path scenario. This architecture can be easily adapted to interactions with non-embodied robots such as avatars on a mobile device or a PC. We present the outcome of evaluating an implementation of our proposed architecture as a whole, and also of its modules for detecting emotions and questions. Results are promising and provide a basis for further development.
Keywords
- Human--computer interaction
- multi-platform
- intelligent system architecture
- multimodal system
- humanoid robot
Cite this article
@article{cai-5317,
author = {Mateusz Jarosz and Piotr Nawrocki and Bartłomiej Śnieżyński and Bipin Indurkhya},
title = {Multi-Platform Intelligent System for Multimodal Human-Computer Interaction},
journal = {Computing and Informatics},
volume = {40},
number = {1},
pages = {83--103},
year = {2021},
issn = {1335-9150},
doi = {10.31577/cai_2021_1_83}
}
TY - JOUR AU - Mateusz Jarosz AU - Piotr Nawrocki AU - Bartłomiej Śnieżyński AU - Bipin Indurkhya TI - Multi-Platform Intelligent System for Multimodal Human-Computer Interaction JO - Computing and Informatics VL - 40 IS - 1 SP - 83 EP - 103 PY - 2021 SN - 1335-9150 DO - 10.31577/cai_2021_1_83 UR - https://doi.org/10.31577/cai_2021_1_83 KW - Human--computer interaction KW - multi-platform KW - intelligent system architecture KW - multimodal system KW - humanoid robot ER -
Jarosz, M., Nawrocki, P., Śnieżyński, B., & Indurkhya, B. (2021). Multi-Platform Intelligent System for Multimodal Human-Computer Interaction. Computing and Informatics, 40(1), 83–103. https://doi.org/10.31577/cai_2021_1_83