Publication detail

Artificial Intelligence-based Surveillance System for Railway Crossing Traffic

SIKORA, P. MALINA, L. KIAC, M. MARTINÁSEK, Z. ŘÍHA, K. PŘINOSIL, J. JIŘÍK, L. SRIVASTAVA, G.

Original Title

Artificial Intelligence-based Surveillance System for Railway Crossing Traffic

Type

journal article in Web of Science

Language

English

Original Abstract

The application of Artificial Intelligence (AI) based techniques has strong potential to improve safety and efficiency in data-driven Intelligent Transportation Systems (ITS) as well as in the emerging Internet of Vehicles (IoV) services. This paper deals with the practical implementation of deep learning methods for increasing safety and security in a specific ITS scenario: railway crossings. This research work presents our proposed system called Artificial Intelligence-based Surveillance System for Railway Crossing Traffic (AISS4RCT) that is based on a combination of detection and classification methods focusing on various image processing inputs: vehicle presence, pedestrian presence, vehicle trajectory tracking, railway barriers at railway crossings, railway warnings, and light signaling systems. The designed system uses cameras that are suitably positioned to capture an entire crossing area at a given railway crossing. By employing GPU accelerated image processing techniques and deep neural networks, the system autonomously detects risky and dangerous situations at railway crossing in real-time. In addition, camera modules send data to a central server for further processing as well as notification to interested parties (police, emergency services, railway operators). Furthermore, the system architecture employs privacy-by-design and security-by-design best practices in order to secure all communication interfaces, protect personal data, and to increase personal privacy, i.e., pedestrians, drivers. Finally, we present field-based results of detection methods, and using the YOLO tiny model method we achieve average recall 89%. The results indicate that our system is efficient for evaluating the occurrence of objects and situations, and it’s practicality for use in railway crossings.

Keywords

Artificial intelligence, image processing, intelligent transportation system, object detection, railway crossing barrier, safety, security, traffic light

Authors

SIKORA, P.; MALINA, L.; KIAC, M.; MARTINÁSEK, Z.; ŘÍHA, K.; PŘINOSIL, J.; JIŘÍK, L.; SRIVASTAVA, G.

Released

16. 10. 2020

Publisher

IEEE Sensors journal

ISBN

1530-437X

Periodical

IEEE SENSORS JOURNAL

Number

2020

State

United States of America

Pages from

15515

Pages to

15526

Pages count

12

URL

https://ieeexplore.ieee.org/document/9226453

BibTex

@article{BUT165646,
  author="Pavel {Sikora} and Lukáš {Malina} and Martin {Kiac} and Zdeněk {Martinásek} and Kamil {Říha} and Jiří {Přinosil} and Leoš {Jiřík} and Gautam {Srivastava}",
  title="Artificial Intelligence-based Surveillance System for Railway Crossing Traffic",
  journal="IEEE SENSORS JOURNAL",
  year="2020",
  volume="0",
  number="2020",
  pages="15515--15526",
  doi="10.1109/JSEN.2020.3031861",
  issn="1530-437X",
  url="https://ieeexplore.ieee.org/document/9226453"
}