Publication detail

Enhancing multilingual recognition of emotion in speech by language identification

SAGHA, H. MATĚJKA, P. GAVRYUOKOVA, M. POVOLNÝ, F. MARCHI, E. SCHULLER, B.

Original Title

Enhancing multilingual recognition of emotion in speech by language identification

Type

conference paper

Language

English

Original Abstract

We investigate, for the first time, if applying model selectionbased on automatic language identification (LID) can improvemultilingual recognition of emotion in speech. Six emotionalspeech corpora from three language families (Germanic, Romance,Sino-Tibetan) are evaluated. The emotions are representedby the quadrants in the arousal/valence plane, i. e., positive/negative arousal/valence. Four selection approaches forchoosing an optimal training set depending on the current languageare compared: within the same language family, acrosslanguage family, use of all available corpora, and selectionbased on the automatic LID. We found that, on average, theproposed LID approach for selecting training corpora is superiorto using all the available corpora when the spoken languageis not known.

Keywords

multilingual emotion recognition, language identification,language families

Authors

SAGHA, H.; MATĚJKA, P.; GAVRYUOKOVA, M.; POVOLNÝ, F.; MARCHI, E.; SCHULLER, B.

Released

8. 9. 2016

Publisher

International Speech Communication Association

Location

San Francisco

ISBN

1990-9772

Periodical

Proceedings of Interspeech

Number

9

State

French Republic

Pages from

2949

Pages to

2953

Pages count

5

URL

https://www.isca-speech.org/archive/Interspeech_2016/pdfs/0333.PDF

BibTex

@inproceedings{BUT163404,
  author="SAGHA, H. and MATĚJKA, P. and GAVRYUOKOVA, M. and POVOLNÝ, F. and MARCHI, E. and SCHULLER, B.",
  title="Enhancing multilingual recognition of emotion in speech by language identification",
  booktitle="17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION - Proceedings (INTERSPEECH 2016)",
  year="2016",
  journal="Proceedings of Interspeech",
  number="9",
  pages="2949--2953",
  publisher="International Speech Communication Association",
  address="San Francisco",
  doi="10.21437/Interspeech.2016-333",
  issn="1990-9772",
  url="https://www.isca-speech.org/archive/Interspeech_2016/pdfs/0333.PDF"
}

Documents

sagha_interspeech2016_0333.pdf