Publication detail

Extracting Situation Frames from non-English Speech: Evaluation Framework and Pilot Results

MALANDRAKIS, N. GLEMBEK, O. NARAYANAN, S.

Original Title

Extracting Situation Frames from non-English Speech: Evaluation Framework and Pilot Results

Type

conference paper

Language

English

Original Abstract

This paper describes the first evaluation framework for the extraction of Situation Frames - structures describing humanitarian assistance needs - from non-English speech audio, conducted for the DARPA LORELEI (Low Resource Languages for Emergent Incidents) program. Participants in LORELEI had to process audio from a variety of sources, in non-English languages, and extract the information required to populate Situation Frames describing whether any need is mentioned, the type of need present and where the need exists. The evaluation was conducted over a period of 10 days and attracted submissions from 6 teams, each team spanning multiple organizations. Performance was evaluated using precision-recall curves. The results are encouraging, with most teams showing some capability to detect the type of situation discussed, but more work will be required to connect needs to specific locations.

Keywords

speech recognition, speech analysis, performance evaluation, natural language processing

Authors

MALANDRAKIS, N.; GLEMBEK, O.; NARAYANAN, S.

Released

20. 8. 2017

Publisher

International Speech Communication Association

Location

Stockholm

ISBN

1990-9772

Periodical

Proceedings of Interspeech

Year of study

2017

Number

8

State

French Republic

Pages from

2123

Pages to

2127

Pages count

5

URL

https://www.semanticscholar.org/paper/Extracting-Situation-Frames-from-Non-English-and-Malandrakis-Glembek/047ebaf46d648fea9e5c2c64873c629f7fd53a00

BibTex

@inproceedings{BUT163392,
  author="Nikolaos {Malandrakis} and Ondřej {Glembek} and Shrikanth {Narayanan}",
  title="Extracting Situation Frames from non-English Speech: Evaluation Framework and Pilot Results",
  booktitle="Proceedings of Interspeech 2017",
  year="2017",
  journal="Proceedings of Interspeech",
  volume="2017",
  number="8",
  pages="2123--2127",
  publisher="International Speech Communication Association",
  address="Stockholm",
  doi="10.21437/Interspeech.2017-226",
  issn="1990-9772",
  url="https://www.semanticscholar.org/paper/Extracting-Situation-Frames-from-Non-English-and-Malandrakis-Glembek/047ebaf46d648fea9e5c2c64873c629f7fd53a00"
}

Documents

malandrakis_is2017_0226.pdf