Research output

Article in Journal ()

Do Student Evaluations of University Reflect Inaccurate Beliefs or Actual Experience? A Relative Rank Model

Brown GDA, Wood AM, Ogden RS & Maltby J (2015) Do Student Evaluations of University Reflect Inaccurate Beliefs or Actual Experience? A Relative Rank Model, Journal of Behavioral Decision Making, 28 (1), pp. 14-26.

It was shown that student satisfaction ratings are influenced by context in ways that have important theoretical and practical implications. Using questions from the UK's National Student Survey, the study examined whether and how students' expressed satisfaction with issues such as feedback promptness and instructor enthusiasm depends on the context of comparison (such as possibly inaccurate beliefs about the feedback promptness or enthusiasm experienced at other universities) that is evoked. Experiment 1 found strong effects of experimentally provided comparison contextfor example, satisfaction with a given feedback time depended on the time's relative position within a context. Experiment 2 used a novel distribution-elicitation methodology to determine the prior beliefs of individual students about what happens in universities other than their own. It found that these beliefs vary widely and that students' satisfaction was predicted by how they believed their experience ranked within the distribution of others' experiences. A third study found that relative judgement principles also predicted students' intention to complain. An extended model was developed to show that purely rank-based principles of judgement can account for findings previously attributed to range effects. It was concluded that satisfaction ratings and quality of provision are different quantities, particularly when the implicit context of comparison includes beliefs about provision at other universities. Quality and satisfaction should be assessed separately, with objective measures (such as actual times to feedback), rather than subjective ratings (such as satisfaction with feedback promptness), being used to measure quality wherever practicable. (c) 2014 The Authors. Journal of Behavioral Decision Making published by John Wiley & Sons Ltd.

student satisfaction; rank-based judgement; context-dependence; NSS

AuthorsBrown Gordon D A, Wood Alex M, Ogden Ruth S, Maltby John
Publication date01/2015
Publication date online13/06/2014
Date accepted by journal07/05/2014
ISSN 0894-3257

Journal of Behavioral Decision Making: Volume 28, Issue 1 (2015)

© University of Stirling FK9 4LA Scotland UK • Telephone +44 1786 473171 • Scottish Charity No SC011159
My Portal