Detail publikace

DeepPlayer: An open-source SignalPlant plugin for deep learning inference

PLEŠINGER, F. NEJEDLÝ, P. KOŠČOVÁ, Z. ROHR, M. VIŠČOR, I. SMÍŠEK, R. IVORA, A. LEINVEBER, P. ČURILA, K. HOOG ANTINK, C.

Originální název

DeepPlayer: An open-source SignalPlant plugin for deep learning inference

Typ

článek v časopise ve Web of Science, Jimp

Jazyk

angličtina

Originální abstrakt

Background and Objective Machine learning has become a powerful tool in several computation domains. The most progressive way of machine learning, deep learning, has already surpassed several algorithms designed by human experts. It also applies to the field of biomedical signal processing. However, while many experts produce deep learning models, there is no software platform for signal processing, allowing the convenient use of pre-trained deep learning models and evaluating them using any inspected signal. This may also hinder understanding, interpretation, and explanation of results. For these reasons, we designed DeepPlayer. It is a plugin for the free signal processing software SignalPlant. The plugin allows loading deep learning models saved in the Open Neural Network Exchange (ONNX) file format and evaluating them on any given signal. Methods The DeepPlayer plugin and its graphical user interface were designed in C# programming language and the .NET framework. We used the inference library OnnxRuntime, which supports graphics card acceleration. The inference is executed in asynchronous tasks for a live preview and evaluation of the signals. Model outputs can be exported back to SignalPlant for further processing, such as peak detection or thresholding. Results We developed the DeepPlayer plugin to evaluate deep learning models in SignalPlant. The plugin keeps with SignalPlant's interactive work with signals, such as live preview or easy selection of associated signals. The plugin can load classification or regression models and allows standard pre-processing and post-processing methods. We prepared several deep learning models to test the plugin. Additionally, we provide a tutorial training script that outputs an ONNX format model with correctly set metadata information. These, and the source code of the DeepPlayer plugin, are publicly accessible via GitHub and Google Colab service. Conclusion The DeepPlayer plugin allows running deep learning models easily and interactively. Therefore, experts and non-AI experts alike can explore and apply deep learning models for (biomedical) signal processing. Its ease of use and interactivity might also contribute to a better understanding and acceptance of AI methods in biomedicine.

Klíčová slova

artificial intelligence; deep learning; signal processing; SignalPlant; software

Autoři

PLEŠINGER, F.; NEJEDLÝ, P.; KOŠČOVÁ, Z.; ROHR, M.; VIŠČOR, I.; SMÍŠEK, R.; IVORA, A.; LEINVEBER, P.; ČURILA, K.; HOOG ANTINK, C.

Vydáno

4. 10. 2022

Nakladatel

Wiley

Místo

HOBOKEN

ISSN

0038-0644

Periodikum

SOFTWARE-PRACTICE & EXPERIENCE

Číslo

October

Stát

Spojené království Velké Británie a Severního Irska

Strany od

1

Strany do

10

Strany počet

10

URL

https://onlinelibrary.wiley.com/doi/epdf/10.1002/spe.3159

BibTex

@article{BUT179994,
  author="Filip {Plešinger} and Petr {Nejedlý} and Zuzana {Koščová} and Maurice {Rohr} and Ivo {Viščor} and Radovan {Smíšek} and Adam {Ivora} and Pavel {Leinveber} and Karol {Čurila} and Christoph {Hoog Antink}",
  title="DeepPlayer: An open-source SignalPlant plugin for deep learning inference",
  journal="SOFTWARE-PRACTICE & EXPERIENCE",
  year="2022",
  number="October",
  pages="1--10",
  doi="10.1002/spe.3159",
  issn="0038-0644",
  url="https://onlinelibrary.wiley.com/doi/epdf/10.1002/spe.3159"
}