Number of the records: 1  

Implementing acoustic-prosodic entrainment in a conversational avatar

  1. TitleImplementing acoustic-prosodic entrainment in a conversational avatar
    Author Levitan Rivka
    Co-authors Beňuš Štefan 1972- SAVINFO - Ústav informatiky SAV    SCOPUS    RID    RID    ORCID

    Gálvez Ramiro H.

    Gravano Agustín

    Savoretti Florencia

    Trnka Marián 1971- SAVINFO - Ústav informatiky SAV    SCOPUS    RID    ORCID

    Weise Andreas

    Hirschberg Julia

    Source document Proceedings of the Annual Conference of the International Speech Communication Association. Vol. 1-5 (2016), p. 1166-1170
    Languageeng - English
    CountryUS - United States of America
    Document kindrozpis článkov z periodík (rzb)
    CitationsSZÉKELY, Éva - MENDELSON, Joseph - GUSTAFSON, Joakim. Synthesising uncertainty: The interplay of vocal effort and hesitation disfluencies. In Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. ISSN 2308457X, 2017-01-01, 2017-August, pp. 804-808.
    RAHIMI, Zahra - KUMAR, Anish - LITMAN, Diane - PALETZ, Susannah - YU, Mingzhi. Entrainment in multi-party spoken dialogues at multiple linguistic levels. In Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. ISSN 2308457X, 2017-01-01, 2017-August, pp. 1696-1700.
    KOTTI, M. - PAPANGELIS, A. - STYLIANOU, Y. Will this dialogue be unsuccessful? Prediction using audio features. In ICTIR' 17 Workshop on Search-Oriented Conversational AI (SCAI’ 2017). ISBN 978-1-4503-4490-6, 2017, 6 p.
    YAMAMOTO, Kenta - INOUE, Koji - NAKAMURA, Shizuka - TAKANASHI, Katsuya - KAWAHARA, Tatsuya. Dialogue Behavior Control Model for Expressing a Character of Humanoid Robots. In 2018 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC). ISSN 2309-9402, 2018, vol., no., pp. 1732-1737.
    LUBOLD, Nichola - WALKER, Erin - PON-BARRY, Heather - OGAN, Amy. Automated pitch convergence improves learning in a social, teachable robot for middle school mathematics. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). ISSN 03029743, 2018-01-01, 10947 LNAI, pp. 282-296.
    RAVEH, Eran - STEINER, Ingmar - GESSINGER, Iona - MOEBIUS, Bernd. Studying Mutual Phonetic Influence with a Web-Based Spoken Dialogue System. In SPEECH AND COMPUTER (SPECOM 2018). ISSN 0302-9743, 2018, vol. 11096, no., pp. 552-562.
    MASTRIANI, Maria Camilla - PETRONE, Caterina - BERTRAND, Roxane - OCHS, Magalie. Role of prosody on the perception of the “oui”/”yes” feedback in medical context. In Proceedings of the International Conference on Speech Prosody. ISSN 23332042, 2018-01-01, 2018-June, pp. 512-516.
    YAMAMOTO, K. - INOUE, K. - NAKAMURA, S. - TAKANASHI, K. - KAWAHARA, T. A dialogue behavior control model for expressing a characters of humanoid robots. In J-Stage. ISSN 1346-0714, 2018, vol. 33, no. 5, 9 p.
    YAMAMOTO, K. - INOUE, K. - NAKAMURA, S. - TAKANASHI, K. - KAWAHARA, T. Controlling dialogue for character expression of an autonomous android. In Information Processing Society of Japan. ISSN 18826660, 2018, pp. 407-408.
    BORRIE, Stephanie A. - BARRETT, Tyson S. - WILLI, Megan M. - BERISHA, Visar. Syncing Up for a Good Conversation: A Clinically Meaningful Methodology for Capturing Conversational Entrainment in the Speech Domain. In JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH. ISSN 1092-4388, 2019, vol. 62, no. 2, pp. 283-296.
    LUBOLD, Nichola - WALKER, Erin - PON-BARRY, Heather - OGAN, Amy. Comfort with Robots Influences Rapport with a Social, Entraining Teachable Robot. In ARTIFICIAL INTELLIGENCE IN EDUCATION (AIED 2019), PT I. ISSN 0302-9743, 2019, vol. 11625, no., pp. 231-243.
    KORY-WESTLUND, Jacqueline M. - BREAZEAL, Cynthia. Exploring the Effects of a Social Robot's Speech Entrainment and Backstory on Young Children's Emotion, Rapport, Relationship, and Learning. In FRONTIERS IN ROBOTICS AND AI. ISSN 2296-9144, 2019, vol. 6, no., pp.
    HOEGEN, Rens - ANEJA, Deepali - MCDUFF, Daniel - CZERWINSKI, Mary. An End-to-End Conversational Style Matching Agent. In PROCEEDINGS OF THE 19TH ACM INTERNATIONAL CONFERENCE ON INTELLIGENT VIRTUAL AGENTS (IVA' 19), 2019, vol., no., pp. 111-118.
    RAHIMI, Zahra - LITMAN, Diane - PALETZ, Susannah. Acoustic-prosodic entrainment in multi-party spoken dialogues: Does simple averaging extend existing pair measures properly? In Lecture Notes in Electrical Engineering. ISSN 18761100, 2019-01-01, 510, pp. 169-177.
    RAVEH, Eran - SIEGERT, Ingo - STEINER, Ingmar - GESSINGER, Iona - MÖBIUS, Bernd. Three's a crowd? Effects of a second human on vocal accommodation with a voice assistant. In Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. ISSN 2308457X, 2019-01-01, 2019-September, pp. 4005-4009.
    GESSINGER, I. - MÖBIUS, B. - FAKHAR, N. - RAVEH, E. - STEINER, I. A wizard-of-oz experiment to study phonetic accommodation in human-computer interaction. In International Congress of Phonetic Sciences (ICPhS). ISBN 978-0-646-80069-1, 2019, pp. 1475-1479.
    RAVEH, E. - STEINER, I. - SIEGERT, I. - GESSINGER, I. - MÖBIUS, B. Comparing phonetic changes in computer-directed and human-directed speech. In 30. Konferenz Elektronische Sprachsignalverarbeitung (ESSV 2019). ISBN-13 978-3959081573, 2019, pp. 42-49.
    ANEJA, D. - HOEGEN, R. - McDUFF, D. - CZERWINSKI, M. Designing style matching conversational agents. In CHI 2019 Workshop. 2019, pp. 1-8. https://arxiv.org/abs/1910.07514.
    LUBOLD, Nichola - WALKER, Erin - PON-BARRY, Heather. Effects of adapting to user pitch on rapport perception, behavior, and state with a social robotic learning companion. In USER MODELING AND USER-ADAPTED INTERACTION. ISSN 0924-1868, 2020, vol., no., pp.
    OKAMOTO, Mayuko - SAKTI, Sakriani - NAKAMURA, Satoshi. Towards Speech Entrainment: Considering ASR Information in Speaking Rate Variation of TTS Waveform Generation. In PROCEEDINGS OF 2020 23RD CONFERENCE OF THE ORIENTAL COCOSDA INTERNATIONAL COMMITTEE FOR THE CO-ORDINATION AND STANDARDISATION OF SPEECH DATABASES AND ASSESSMENT TECHNIQUES (ORIENTAL-COCOSDA 2020). ISSN 2163-3479, 2020, vol., no., pp. 139-144.
    KACHKOVSKAIA, Tatiana - CHUKAEVA, Tatiana - EVDOKIMOVA, Vera - KHOLIAVIN, Pavel - KOCHAROV, Daniil - KRIAKINA, Natalia - MAMUSHINA, Anna - MENSHIKOVA, Alla - ZIMINA, Svetlana. SibLing Corpus of Russian Dialogue Speech Designed for Research on Speech Entrainment. In PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 2020, vol., no., pp. 6556-6561.
    GESSINGER, Iona - MÖBIUS, Bernd - ANDREEVA, Bistra - RAVEH, Eran - STEINER, Ingmar. Phonetic accommodation of L2 German speakers to the virtual language learning tutor Mirabella. In Proceedings of Interspeech 2020. 2020, pp. 4118-4122.
    FUSCONE, Simone - FAVRE, Benoit - PRÉVOT, Laurent. Neural representations of dialogical history for improving upcoming turn acoustic parameters prediction. In Proceedings of Interspeech 2020. 2020, pp. 4203-4207.
    WEISS, Benjamin. Talker quality in human and machine interaction: Modeling the listener’s perspective in passive and interactive scenarios. In T-Labs Series in Telecommunication Services, 2020-01-01, pp. 1-147. ISSN 21922810.
    GESSINGER, Iona - MOEBIUS, Bernd - LE MAGUER, Sebastien - RAVEH, Eran - STEINER, Ingmar. Phonetic accommodation in interaction with a virtual language learning tutor: A Wizard-of-Oz study. In JOURNAL OF PHONETICS. ISSN 0095-4470, 2021, vol. 86, no., pp.
    KACHKOVSKAIA, Tatiana - MAMUSHINA, Anna D. Phonetic manifestations of communication accommodation in dialogue. In VOPROSY YAZYKOZNANIYA. ISSN 0373-658X, 2021, vol., no. 2, pp. 123-141.
    DOMINGUEZ, Monica - FARRUS, Mireia - WANNER, Leo. The Information Structure-prosody interface in text-to-speech technologies. An empirical perspective. In CORPUS LINGUISTICS AND LINGUISTIC THEORY. ISSN 1613-7027, 2021, vol., no., pp. Dostupné na: https://doi.org/10.1515/cllt-2020-0008.
    FUSCONE, Simone - FAVRE, Benoit - PREVOT, Laurent. COMPARING MONOLOGICAL AND DIALOGICAL NEURAL REPRESENTATIONS OF DIALOGUE HISTORY FOR PREDICTING THE ACOUSTIC PARAMETERS OF AN UPCOMING CONVERSATIONAL TURN. In LINGUE E LINGUAGGIO. ISSN 1720-9331, 2021, vol. 20, no. 2, pp. 259-288.
    GESSINGER, Iona - RAVEH, Eran - STEINER, Ingmar - MOEBIUS, Bernd. Phonetic accommodation to natural and synthetic voices: Behavior of groups and individuals in speech shadowing. In SPEECH COMMUNICATION. ISSN 0167-6393, 2021, vol. 127, no., pp. 43-63. Dostupné na: https://doi.org/10.1016/j.specom.2020.12.004.
    ANEJA, Deepali - HOEGEN, Rens. Understanding conversational and expressive style in a multimodal embodied conversational agent. In Conference on Human Factors in Computing Systems Proceedings, 2021-05-06, pp.
    YAMAZAKI, Yoshihiro - CHIBA, Yuya - NOSE, Takashi - ITO, Akinori. Neural spoken-response generation using prosodic and linguistic context for conversational systems. In Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. ISSN 2308457X, 2021-01-01, 5, pp. 3731-3735. Dostupné na: https://doi.org/10.21437/Interspeech.2021-381.
    TSFASMAN, Maria - SARAVANAN, Avinash - VINER, Dekel - GOSLINGA, Daan - DE WOLF, Sarah - RAMAN, Chirag - JONKER, Catholijn M. - OERTEL, Catharine. Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction. In MuCAI 2021 Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021, 2021-11-17, pp. 13-18. Dostupné na: https://doi.org/10.1145/3475959.3485394.
    HE, Yingxu - LIAO, Lizi - ZHANG, Zheng - CHUA, Tat Seng. Towards Enriching Responses with Crowd-sourced Knowledge for Task-oriented Dialogue. In MuCAI 2021 Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI, co-located with ACM MM 2021, 2021-11-17, pp. 3-11. Dostupné na: https://doi.org/10.1145/3475959.3485392.
    PATEL, Shivani P. - COLE, Jennifer - LAU, Joseph C. Y. - FRAGNITO, Gabrielle - LOSH, Molly. Verbal entrainment in autism spectrum disorder and first-degree relatives. In SCIENTIFIC REPORTS, 2022, vol. 12, no. 1, pp. ISSN 2045-2322. Dostupné na: https://doi.org/10.1038/s41598-022-12945-4.
    CALVO-BARAJAS, Natalia - CASTELLANO, Ginevra. I have an idea! . Enhancing Children s Verbal Creativity through Repeated Interactions with a Virtual Robot. In IVA 2022 Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents, 2022-09-06, pp. Dostupné na: https://doi.org/10.1145/3514197.3549690.
    CIHAN, Helin - WU, Yunhan - PEÑA, Paola - EDWARDS, Justin - COWAN, Benjamin. Bilingual by default: Voice Assistants and the role of code-switching in creating a bilingual user experience. In ACM International Conference Proceeding Series, 2022-07-26, pp. Dostupné na: https://doi.org/10.1145/3543829.3544511.
    PHUKON, Mridumoni - SHRIVASTAVA, Abhishek - BALENTINE, Bruce. Can VUI Turn-Taking Entrain User Behaviours?: Voice User Interfaces that Disallow Overlapping Speech Present Turn-Taking Challenges. In ACM International Conference Proceeding Series, 2022-11-09, pp. 42-56. Dostupné na: https://doi.org/10.1145/3570211.3570215.
    KORY-WESTLUND, J.M. - WON PARK, H. - GROVER, I. - BREAZEAL, C. Long-term interaction with relational SIAs. In The Handbook on Socially Interactive Agents: 20 years of Research on Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics Volume 2: Interactivity, Platforms, Application. 2022, pp. 195-260. doi: 10.1145/3563659.3563667.
    CHEN, Run - KIM, Seokhwan - PAPANGELIS, Alexandros - HIRSCHBERG, Julia - LIU, Yang - HAKKANI-TUR, Dilek. Identifying Entrainment in Task-Oriented Conversations. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing Proceedings, 2023-01-01, 2023-June, pp. ISSN 15206149. Dostupné na: https://doi.org/10.1109/ICASSP49357.2023.10095543.
    PHUKON, Mridumoni - SHRIVASTAVA, Abhishek. Effect of Speech Entrainment in Human-Computer Conversation: A Review. In INTELLIGENT HUMAN COMPUTER INTERACTION, IHCI 2023, PT I, 2024, vol. 14531, no., pp. 32-43. ISSN 0302-9743. Dostupné na: https://doi.org/10.1007/978-3-031-53827-8_4.
    DOWDING, Stewart - GUTWIN, Carl - COCKBURN, Andy. User speech rates and preferences for system speech rates. In INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2024, vol. 184, no., pp. ISSN 1071-5819. Dostupné na: https://doi.org/10.1016/j.ijhcs.2024.103222.
    CategoryADMB - Scientific papers in foreign non-impacted journals registered in Web of Sciences or Scopus
    Category of document (from 2022)V3 - Vedecký výstup publikačnej činnosti z časopisu
    Type of documentčlánok
    Year2016
    Registered inWOS
    Registered inSCOPUS
    DOI 10.21437/Interspeech.2016-985
    article

    article

    File nameAccessSizeDownloadedTypeLicense
    Implementing acoustic-prosodic entrainment in a conversational avatar.pdfavailable774.7 KB7Publisher's version
    rokCCIFIF Q (best)JCR Av Jour IF PercSJRSJR Q (best)CiteScore
    N
    rok vydaniarok metrikyIFIF Q (best)SJRSJR Q (best)
    201620150.437
Number of the records: 1  

  This site uses cookies to make them easier to browse. Learn more about how we use cookies.