Journal article

Don’t Forget the Items: Item-level meta-analytic and substantive validity techniques for reexamining scale validation

Nichelle C Carpenter, Jooyeon Son, T Brad Harris, Allison L Alexander, Margaret T Horner

Organizational Research Methods | SAGE Publications | Published : 2016

Abstract

Researchers are generally advised to provide rigorous item-level construct validity evidence when they develop and introduce a new scale. However, these precise, item-level construct validation efforts are rarely reexamined as the scale is put into use by a wider audience. In the present study, we demonstrate how (a) item-level meta-analysis and (b) substantive validity analysis can be used to comprehensively evaluate construct validity evidence for the items comprising scales. This methodology enables a reexamination of whether critical item-level issues that may have been supported in the initial (often single study) scale validation process—item factor loadings and theorized measurement m..

View full abstract

University of Melbourne Researchers