Journal article

Revisiting rating scale development for rater-mediated language performance assessments: Modelling construct and contextual choices made by scale developers

Ute Knoch, Bart Deygers, Apichat Khamboonruang

LANGUAGE TESTING | SAGE PUBLICATIONS LTD | Published : 2021

Abstract

Rating scale development in the field of language assessment is often considered in dichotomous ways: It is assumed to be guided either by expert intuition or by drawing on performance data. Even though quite a few authors have argued that rating scale development is rarely so easily classifiable, this dyadic view has dominated language testing research for over a decade. In this paper we refine the dominant model of rating scale development by drawing on a corpus of 36 studies identified in a systematic review. We present a model showing the different sources of scale construct in the corpus. In the discussion, we argue that rating scale designers, just like test developers more broadly, ne..

View full abstract

University of Melbourne Researchers