Přístupnostní navigace
E-application
Search Search Close
Publication detail
FAJČÍK, M. DOČEKAL, M. JON, J. SMRŽ, P.
Original Title
BUT-FIT at SemEval-2020 Task 5: Automatic detection of counterfactual statements with deep pre-trained language representation models
Type
conference paper
Language
English
Original Abstract
This paper describes BUT-FITs submission at SemEval-2020 Task 5: Modelling Causal Reasoning in Language: Detecting Counterfactuals. The challenge focused on detecting whether a given statement contains a counterfactual (Subtask 1) and extracting both antecedent and consequent parts of the counterfactual from the text (Subtask 2). We experimented with various state-of-the-art language representation models (LRMs). We found RoBERTa LRM to perform the best in both subtasks. We achieved the first place in both exact match and F1 for Subtask 2 and ranked second for Subtask 1.
Keywords
counterfactual, counterfactual reasoning, BERT, RoBERTa, ALBERT, causal reasoning, what-if, semeval, classification, extraction
Authors
FAJČÍK, M.; DOČEKAL, M.; JON, J.; SMRŽ, P.
Released
16. 12. 2020
Publisher
Association for Computational Linguistics
Location
Barcelona (online)
ISBN
978-1-952148-31-6
Book
Proceedings of the Fourteenth Workshop on Semantic Evaluation
Pages from
437
Pages to
444
Pages count
8
URL
https://www.aclweb.org/anthology/2020.semeval-1.53/
BibTex
@inproceedings{BUT168151, author="Martin {Fajčík} and Martin {Dočekal} and Josef {Jon} and Pavel {Smrž}", title="BUT-FIT at SemEval-2020 Task 5: Automatic detection of counterfactual statements with deep pre-trained language representation models", booktitle="Proceedings of the Fourteenth Workshop on Semantic Evaluation", year="2020", pages="437--444", publisher="Association for Computational Linguistics", address="Barcelona (online)", isbn="978-1-952148-31-6", url="https://www.aclweb.org/anthology/2020.semeval-1.53/" }