Detail publikace

Speech production under stress for machine learning: multimodal dataset of 79 cases and 8 signals

PEŠÁN, J. JUŘÍK, V. RŮŽIČKOVÁ, A. SVOBODA, V. JANOUŠEK, O. NĚMCOVÁ, A. BOJANOVSKÁ, H. ALDABAGHOVÁ, J. KYSLÍK, F. VODIČKOVÁ, K. SODOMOVÁ, A. BARTYS, P. CHUDÝ, P. ČERNOCKÝ, J.

Originální název

Speech production under stress for machine learning: multimodal dataset of 79 cases and 8 signals

Typ

článek v časopise ve Web of Science, Jimp

Jazyk

angličtina

Originální abstrakt

Early identification of cognitive or physical overload is critical in fields where human decision making matters when preventing threats to safety and property. Pilots, drivers, surgeons, and operators of nuclear plants are among those affected by this challenge, as acute stress can impair their cognition. In this context, the significance of paralinguistic automatic speech processing increases for early stress detection. The intensity, intonation, and cadence of an utterance are examples of paralinguistic traits that determine the meaning of a sentence and are often lost in the verbatim transcript. To address this issue, tools are being developed to recognize paralinguistic traits effectively. However, a data bottleneck still exists in the training of paralinguistic speech traits, and the lack of high-quality reference data for the training of artificial systems persists. Regarding this, we present an original empirical dataset collected using the BESST experimental protocol for capturing speech signals under induced stress. With this data, our aim is to promote the development of pre-emptive intervention systems based on stress estimation from speech.

Klíčová slova

speech, stress, machine learning

Autoři

PEŠÁN, J.; JUŘÍK, V.; RŮŽIČKOVÁ, A.; SVOBODA, V.; JANOUŠEK, O.; NĚMCOVÁ, A.; BOJANOVSKÁ, H.; ALDABAGHOVÁ, J.; KYSLÍK, F.; VODIČKOVÁ, K.; SODOMOVÁ, A.; BARTYS, P.; CHUDÝ, P.; ČERNOCKÝ, J.

Vydáno

12. 11. 2024

ISSN

2052-4463

Periodikum

Scientific data

Ročník

11

Číslo

1

Stát

Spojené království Velké Británie a Severního Irska

Strany od

1

Strany do

9

Strany počet

9

URL

https://www.nature.com/articles/s41597-024-03991-w

BibTex

@article{BUT193434,
  author="Jan {Pešán} and Vojtěch {Juřík} and Alexandra {Růžičková} and Vojtěch {Svoboda} and Oto {Janoušek} and Andrea {Němcová} and Hana {Bojanovská} and Jasmína {Aldabaghová} and Filip {Kyslík} and Kateřina {Vodičková} and Adéla {Sodomová} and Patrik {Bartys} and Peter {Chudý} and Jan {Černocký}",
  title="Speech production under stress for machine learning: multimodal dataset of 79 cases and 8 signals",
  journal="Scientific data",
  year="2024",
  volume="11",
  number="1",
  pages="1--9",
  doi="10.1038/s41597-024-03991-w",
  issn="2052-4463",
  url="https://www.nature.com/articles/s41597-024-03991-w"
}

Dokumenty

pesan_sci data_2024_s41597-024-03991-w.pdf