Anchored paired comparisons

E. N. Dalal; J. C. Handley; W. Wu; J. Wang

doi:10.1117/12.766363

28 January 2008 Anchored paired comparisons

E. N. Dalal, J. C. Handley, W. Wu, J. Wang

Proceedings Volume 6808, Image Quality and System Performance V; 68080J (2008) https://doi.org/10.1117/12.766363
Event: Electronic Imaging, 2008, San Jose, California, United States

Abstract

The method of paired comparisons is often used in image quality evaluations. Psychometric scale values for quality judgments are modeled using Thurstone's Law of Comparative Judgment in which distance in a psychometric scale space is a function of the probability of preference. The transformation from psychometric space to probability is a cumulative probability distribution. The major drawback of a complete paired comparison experiment is that every treatment is compared to every other, thus the number of comparisons grows quadratically. We ameliorate this difficulty by performing paired comparisons in two stages, by precisely estimating anchors in the psychometric scale space which are spaced apart to cover the range of scale values and comparing treatments against those anchors. In this model, we employ a generalized linear model where the regression equation has a constant offset vector determined by the anchors. The result of this formulation is a straightforward statistical model easily analyzed using any modern statistics package. This enables model fitting and diagnostics. This method was applied to overall preference evaluations of color pictorial hardcopy images. The results were found to be compatible with complete paired comparison experiments, but with significantly less effort.

Citation Download Citation

E. N. Dalal, J. C. Handley, W. Wu, and J. Wang "Anchored paired comparisons", Proc. SPIE 6808, Image Quality and System Performance V, 68080J (28 January 2008); https://doi.org/10.1117/12.766363

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available