Creating Test Score Bands for Assessments Involving Ratings using a Generalizability Theory Approach to Reliability Estimation

Authors

Charles Scherbaum, Baruch College, City University of New YorkFollow
Marcus Dickson, Wayne State UniversityFollow
Elliott Larson, Baruch College and Graduate Center, City University of New YorkFollow
Brian Bellenger, Personnel Board of Jefferson CountyFollow
Kenneth Yusko, University of MarylandFollow
Harold Goldstein, Baruch College, City University of New YorkFollow

DOI

https://doi.org/10.25035/pad.2018.001

Abstract

The selection of a method for estimating the reliability of ratings has considerable implications for the use of assessments in personnel selection. In particular, the accuracy of corrections to validity coefficients for unreliability and test score bands are completely dependent on the correct estimation of the reliability. In this paper, we discuss how generalizability theory can be used to estimate reliability for test score bands with assessments involving ratings. Using selection data from a municipal entity, we demonstrate the use of generalizability theory-based compare the implications of its use in test score banding compared to the traditional approach.

Recommended Citation

Scherbaum, Charles; Dickson, Marcus; Larson, Elliott; Bellenger, Brian; Yusko, Kenneth; and Goldstein, Harold (2018) "Creating Test Score Bands for Assessments Involving Ratings using a Generalizability Theory Approach to Reliability Estimation," Personnel Assessment and Decisions: Number 4 : Iss. 1 , Article 1.
DOI: https://doi.org/10.25035/pad.2018.001
Available at: https://scholarworks.bgsu.edu/pad/vol4/iss1/1

Corresponding Author Information

Charles Scherbaum

Charles.Scherbaum@baruch.cuny.edu