Publication detail

Out-of-Vocabulary Words Detection with Attention and CTC Alignments in an End-to-End ASR System

EGOROVA, E. VYDANA, H. BURGET, L. ČERNOCKÝ, J.

Original Title

Out-of-Vocabulary Words Detection with Attention and CTC Alignments in an End-to-End ASR System

Type

conference paper

Language

English

Original Abstract

This work explores the effectiveness of detecting positions of out-of-vocabulary words (OOVs) in a decoded utterance using attention weights and CTC per-frame outputs of an end-to-end system predicting word sequences. We show that the end-to-end approach can be effective for the task of OOV detection. CTC alignments are shown to provide better temporal information about the positions of OOV words than attention, and therefore are more suitable for the task. The detected positions of OOV occurrences are utilized for the recurrent OOV recovery task in which probabilistic representations of the pronunciations of the detected OOVs are clustered in order to find repeating words. Improved detection results are shown to correlate with better performance of the recovery of recurrent OOVs.

Keywords

Speech recognition, Out-of-vocabulary, OOV, Attention, CTC, End-to-end

Authors

EGOROVA, E.; VYDANA, H.; BURGET, L.; ČERNOCKÝ, J.

Released

30. 8. 2021

Publisher

International Speech Communication Association

Location

Brno

ISBN

1990-9772

Periodical

Proceedings of Interspeech

Year of study

2021

Number

8

State

French Republic

Pages from

2901

Pages to

2905

Pages count

5

URL

https://www.isca-speech.org/archive/interspeech_2021/egorova21_interspeech.html

BibTex

@inproceedings{BUT175843,
  author="Ekaterina {Egorova} and Hari Krishna {Vydana} and Lukáš {Burget} and Jan {Černocký}",
  title="Out-of-Vocabulary Words Detection with Attention and CTC Alignments in an End-to-End ASR System",
  booktitle="Proceedings Interspeech 2021",
  year="2021",
  journal="Proceedings of Interspeech",
  volume="2021",
  number="8",
  pages="2901--2905",
  publisher="International Speech Communication Association",
  address="Brno",
  doi="10.21437/Interspeech.2021-1756",
  issn="1990-9772",
  url="https://www.isca-speech.org/archive/interspeech_2021/egorova21_interspeech.html"
}

Documents

egorova21_interspeech.pdf