Publication detail

CSE database: extended annotations and new recommendations for ECG software testing

SMÍŠEK, R. MARŠÁNOVÁ, L. NĚMCOVÁ, A. VÍTEK, M. KOZUMPLÍK, J. NOVÁKOVÁ, M.

Original Title

CSE database: extended annotations and new recommendations for ECG software testing

Type

journal article in Web of Science

Language

English

Original Abstract

Nowadays, cardiovascular diseases represent the most common cause of death in western countries. Among various examination techniques, electrocardiography (ECG) is still a highly valuable tool used for the diagnosis of many cardiovascular disorders. In order to diagnose a person based on ECG, cardiologists can use automatic diagnostic algorithms. Research in this area is still necessary. In order to compare various algorithms correctly, it is necessary to test them on standard annotated databases, such as the Common Standards for Quantitative Electrocardiography (CSE) database. According to Scopus, the CSE database is the second most cited standard database. There were two main objectives in this work. First, new diagnoses were added to the CSE database, which extended its original annotations. Second, new recommendations for diagnostic software quality estimation were established. The ECG recordings were diagnosed by five new cardiologists independently, and in total, 59 different diagnoses were found. Such a large number of diagnoses is unique, even in terms of standard databases. Based on the cardiologists’ diagnoses, a four-round consensus (4R consensus) was established. Such a 4R consensus means a correct final diagnosis, which should ideally be the output of any tested classification software. The accuracy of the cardiologists’ diagnoses compared with the 4R consensus was the basis for the establishment of accuracy recommendations. The accuracy was determined in terms of sensitivity = 79.20– 86.81%, positive predictive value = 79.10–87.11%, and the Jaccard coefficient = 72.21–81.14%, respectively. Within these ranges, the accuracy of the software is comparable with the accuracy of cardiologists. The accuracy quantification of the correct classification is unique. Diagnostic software developers can objectively evaluate the success of their algorithm and promote its further development. The annotations and recommendations proposed in this work will allow for faster development and testing of classification software. As a result, this might facilitate cardiologists’ work and lead to faster diagnoses and earlier treatment.

Keywords

ECG, CSE database, Annotation of ECG record, ECG classification, Recommendations, Software testing

Authors

SMÍŠEK, R.; MARŠÁNOVÁ, L.; NĚMCOVÁ, A.; VÍTEK, M.; KOZUMPLÍK, J.; NOVÁKOVÁ, M.

Released

31. 12. 2016

Publisher

Springer

ISBN

0140-0118

Periodical

Medical and Biological Engineering and Computing

Year of study

54

Number

12

State

Federal Republic of Germany

Pages from

1

Pages to

10

Pages count

10

URL

BibTex

@article{BUT131057,
  author="Radovan {Smíšek} and Lucie {Šaclová} and Andrea {Němcová} and Martin {Vítek} and Jiří {Kozumplík} and Marie {Nováková}",
  title="CSE database: extended annotations and new recommendations for ECG software testing",
  journal="Medical and Biological Engineering and Computing",
  year="2016",
  volume="54",
  number="12",
  pages="1--10",
  doi="10.1007/s11517-016-1607-5",
  issn="0140-0118",
  url="http://link.springer.com/article/10.1007/s11517-016-1607-5"
}