Publication detail

Impact of screening technique on crowdsourcing QoE assessments

RIES, M. GARDLO, B. HOSSFELD, T.

Original Title

Impact of screening technique on crowdsourcing QoE assessments

Type

conference paper

Language

English

Original Abstract

Evaluation of quality as perceived by the user in his natural environment is a difficult and strenuous task. Simulation of real world conditions in the laboratory is often inefficient and expensive. Recently, crowdsourcing as novel methodology for testing Quality of Experience (QoE) at the end user side has been proposed. In this paper we discuss (a) the challenges of performing subjective assessments in the crowdsourcing domain and (b) highlight the importance of proper filtering of unreliable users from the overall results. In particular, we introduce various ways for detecting unreliable users and compare results from two similar QoE studies applying different screening techniques.

Keywords

Crowdsourcing, QoE

Authors

RIES, M.; GARDLO, B.; HOSSFELD, T.

RIV year

2012

Released

17. 4. 2012

ISBN

978-1-4673-0659-1

Book

Radioelektronika (RADIOELEKTRONIKA), 2012 22nd International Conference

Edition number

1

Pages from

1

Pages to

4

Pages count

4

BibTex

@inproceedings{BUT95029,
  author="Michal {Ries} and Bruno {Gardlo} and Tobias {Hossfeld}",
  title="Impact of screening technique on crowdsourcing QoE assessments",
  booktitle="Radioelektronika (RADIOELEKTRONIKA), 2012 22nd International Conference",
  year="2012",
  number="1",
  pages="1--4",
  isbn="978-1-4673-0659-1"
}