Detail publikace

DEMIS: Electron Microscopy Image Stitching using Deep Learning Features and Global Optimisation

ŠILLING, P. ŠPANĚL, M.

Originální název

DEMIS: Electron Microscopy Image Stitching using Deep Learning Features and Global Optimisation

Typ

článek ve sborníku mimo WoS a Scopus

Jazyk

angličtina

Originální abstrakt

Accurate stitching of overlapping image tiles is essential for reconstructing large-scale Electron Microscopy (EM) images during Whole Slide Imaging. Current stitching approaches rely on handcrafted features and translation-only global alignment based on Minimum Spanning Tree (MST) construction. This results in suboptimal global alignment since it neglects rotational errors and works only with transformations estimated from pairwise feature matches, discarding valuable information tied to individual features. Moreover, handcrafted features may have trouble with repetitive textures. Motivated by the limitations of current methods and recent advancements in deep learning, we propose DEMIS, a novel EM image stitching method. DEMIS uses Local Feature TRansformer (LoFTR) for image matching, and optimises translational and rotational parameters directly at the level of individual features. For evaluation and training, we create EM424, a synthetic dataset generated by splitting high-resolution EM images into arrays of overlapping image tiles. Furthermore, to enable evaluation on unannotated real-world data, we design a no-reference stitching quality metric based on optical flow. Experiments that use the new metric show that DEMIS can improve the average results from 32.11 to 2.28 compared to current stitching techniques (a 1408% improvement).

Klíčová slova

Electron Microscopy, Whole Slide Imaging, Image Stitching, Neural Networks

Autoři

ŠILLING, P.; ŠPANĚL, M.

Vydáno

28. 2. 2025

Nakladatel

Institute for Systems and Technologies of Information, Control and Communication

Místo

Porto

ISBN

978-989-758-731-3

Kniha

Proceedings of the 18th International Joint Conference on Biomedical Engineering Systems and Technologies - BIOIMAGING

Strany od

255

Strany do

256

Strany počet

11

URL

https://www.scitepress.org/publishedPapers/2025/133149/pdf/index.html

BibTex

@inproceedings{BUT193985,
  author="Petr {Šilling} and Michal {Španěl}",
  title="DEMIS: Electron Microscopy Image Stitching using Deep Learning Features and Global Optimisation",
  booktitle="Proceedings of the 18th International Joint Conference on Biomedical Engineering Systems and Technologies - BIOIMAGING",
  year="2025",
  pages="255--256",
  publisher="Institute for Systems and Technologies of Information, Control and Communication",
  address="Porto",
  doi="10.5220/0013314900003911",
  isbn="978-989-758-731-3",
  url="https://www.scitepress.org/publishedPapers/2025/133149/pdf/index.html"
}