Detecting User Engagement in Everyday Conversations

dc.creatorYu, Chen
dc.creatorAoki, Paul M.
dc.creatorWoodruff, Allison
dc.date2004-10-13
dc.date.accessioned2026-07-07T03:21:52Z
dc.date.available2026-07-07T03:21:52Z
dc.descriptionThis paper presents a novel application of speech emotion recognition: estimation of the level of conversational engagement between users of a voice communication system. We begin by using machine learning techniques, such as the support vector machine (SVM), to classify users' emotions as expressed in individual utterances. However, this alone fails to model the temporal and interactive aspects of conversational engagement. We therefore propose the use of a multilevel structure based on coupled hidden Markov models (HMM) to estimate engagement levels in continuous natural speech. The first level is comprised of SVM-based classifiers that recognize emotional states, which could be (e.g.) discrete emotion types or arousal/valence levels. A high-level HMM then uses these emotional states as input, estimating users' engagement in conversation by decoding the internal states of the HMM. We report experimental results obtained by applying our algorithms to the LDC Emotional Prosody and CallFriend speech corpora.
dc.description4 pages (A4), 1 figure (EPS)
dc.identifierhttps://arxiv.org/abs/cs/0410027
dc.identifierhttp://arxiv.org/abs/cs/0410027
dc.identifierProc. 8th Int'l Conf. on Spoken Language Processing (ICSLP) (Vol. 2), Jeju Island, Republic of Korea, Oct. 2004, 1329-1332. ISCA.
dc.identifier.urihttp://salesiana.dossiersoluciones.com/handle/123456789/32370
dc.subjectSound
dc.subjectComputation and Language
dc.subjectHuman-Computer Interaction
dc.subjectI.5.4; I.2.7; H.5.2; H.4.3
dc.titleDetecting User Engagement in Everyday Conversations
dc.typetext

Files

Collections