Paper ID | B-3-1.1 |
Paper Title |
Prediction of Social Maladaptation using Emotional Entrainment of Disgust during Comprehensive Psychiatric Interviews |
Authors |
Kenji Yokotani, Tokushima University, Japan; Gen Takagi, Tohoku Fukushi University, Japan; Kobun Wakashima, Tohoku University, Japan |
Session |
B-3-1: Information Processing for Understanding Human Attentional and Affective States |
Time | Thursday, 10 December, 12:30 - 14:00 |
Presentation Time: | Thursday, 10 December, 12:30 - 12:45 Check your Time Zone |
|
All times are in New Zealand Time (UTC +13) |
Topic |
Biomedical Signal Processing and Systems (BioSiPS): Special Session: Information Processing for Understanding Human Attentional and Affective States |
Abstract |
Previous speech entrainment studies have shown disagreement in their findings: One group emphasized that acoustic entrainment predicts social adaptation, whereas another group emphasized that it predicts social maladaptation. Our study aims to resolve the disagreement from the perspective of emotional entrainment: the entrainment of positive emotions predicts social adaptation, whereas the entrainment of negative emotions predicts social maladaptation. Using a machine-learned sentiment classifier, we estimated the probability of anger, disgust, fear, happiness, neutrality, and sadness in speech. The corpus consisted of dialogues recorded from 29 comprehensive mental health interviews. The Jensen–Shannon divergence was also calculated to estimate the (dis)entrainment. Results showed that the entrainment of happiness significantly demonstrated the rapport of the participants with their therapist. In contrast, their entrainment of disgust significantly demonstrated their social maladaptation. Our study observed social maladaptation to be contrastingly related to positive and negative emotional entrainment. Classification of speech from an emotional perspective could enrich the study of entrainment and facilitate the analysis of emotional communication. |