Regular Articles

Scene reduction for subjective image quality assessment

[+] Author Affiliations
Anna Lewandowska (Tomaszewska)

West Pomeranian University of Technology, Faculty of Computer Science and Information Systems, ul. Zolnierska 49, Szczecin 71-210, Poland

J. Electron. Imaging. 25(1), 013015 (Jan 25, 2016). doi:10.1117/1.JEI.25.1.013015
History: Received April 14, 2015; Accepted December 15, 2015
Text Size: A A A

Abstract.  Evaluation of image quality is important for many image processing systems, such as those used for acquisition, compression, restoration, enhancement, or reproduction. Its measurement is often accompanied by user studies, in which a group of observers rank or rate results of several algorithms. Such user studies, known as subjective image quality assessment experiments, can be very time consuming and do not guarantee conclusive results. This paper is intended to help design an efficient and rigorous quality assessment experiment. We propose a method of limiting the number of scenes that need to be tested, which can significantly reduce the experimental effort and still capture relevant scene-dependent effects. To achieve it, we employ a clustering technique and evaluate it on the basis of compactness and separation criteria. The correlation between the results obtained from a set of images in an initial database and the results received from reduced experiment are analyzed. Finally, we propose a procedure for reducing the initial scenes number. Four different assessment techniques were tested: single stimulus, double stimulus, forced choice, and similarity judgments. We conclude that in most cases, 9 to 12 judgments per evaluated algorithm for a large scene collection is sufficient to reduce the initial set of images.

Figures in this Article
© 2015 SPIE and IS&T

Citation

Anna Lewandowska (Tomaszewska)
"Scene reduction for subjective image quality assessment", J. Electron. Imaging. 25(1), 013015 (Jan 25, 2016). ; http://dx.doi.org/10.1117/1.JEI.25.1.013015


Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

PubMed Articles
Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.