Publication detail

Performance Evaluation of Objective Quality Assessment Methods for Omnidirectional Images Under Emerging Compressions

ŠIMKA, M. POLÁK, L. NOVOTNÝ, M. KUFA, J. FLIEGEL, K.

Original Title

Performance Evaluation of Objective Quality Assessment Methods for Omnidirectional Images Under Emerging Compressions

Type

journal article in Web of Science

Language

English

Original Abstract

This paper presents a unique study of objective and subjective image quality assessment (IQA) of 360 degrees images, distorted by emerging and legacy compressions - AV1 Image File Format (AVIF), Joint Photographic Experts Group (JPEG), High Efficiency Image File Format (HEIC), JPEG XL from the cross-lab experiments carried out by two universities. The performance evaluation of objective conventional IQA methods relied on statistical data analysis employing not only traditional approaches with correlation coefficients but also advanced techniques such as Receiver Operating Characteristic (ROC) analysis, which offers several statistical advantages. The comprehensive statistical examination presented, utilizing an outcome from the subjective experiment with 66 observers, confirmed that the performance of specific IQA metrics depends not only on the image features but also on the applied image compression algorithm. Overall, the study examined nine IQA objective metrics. For instance, when evaluating distortion caused by the AVIF and HEIC codecs, the Multi-Scale Structural Similarity (MS-SSIM) metric exhibited the best performance, while the Feature Similarity chrominance (FSIMc) metric excelled in assessing JPEG-based compressions. Additionally, detailed outcomes of the subjective experiments, including eye-tracking data, are available in a public dataset. This study provides previously unexplored insights into the performance of conventional objective metrics for 360 degrees images degraded by emerging image codecs. The presented results suggest suitable metrics for specific application scenarios (codecs) and, along with the dataset, lay the groundwork for further research on new objective quality assessment methods for omnidirectional images under emerging compressions.

Keywords

Image coding; Measurement; Visualization; Quality assessment; Codecs; Transform coding; Image quality; Observers; Image color analysis; Distortion; Omnidirectional image (360 degrees); 360-degree content; virtual reality; objective quality assessment; subjective test; perceptual image quality

Authors

ŠIMKA, M.; POLÁK, L.; NOVOTNÝ, M.; KUFA, J.; FLIEGEL, K.

Released

11. 10. 2024

Publisher

IEEE

Location

PISCATAWAY

ISBN

2169-3536

Periodical

IEEE Access

Year of study

12

Number

10

State

United States of America

Pages from

150419

Pages to

150429

Pages count

11

URL

https://ieeexplore.ieee.org/document/10714248

Full text in the Digital Library

http://hdl.handle.net/11012/249746

BibTex

@article{BUT190075,
  author="Marek {Šimka} and Ladislav {Polák} and Martin {Novotný} and Jan {Kufa} and Karel {Fliegel}",
  title="Performance Evaluation of Objective Quality Assessment Methods for Omnidirectional Images Under Emerging Compressions",
  journal="IEEE Access",
  year="2024",
  volume="12",
  number="10",
  pages="150419--150429",
  doi="10.1109/ACCESS.2024.3478793",
  issn="2169-3536",
  url="https://ieeexplore.ieee.org/document/10714248"
}