Meta-analysis of interrater reliability of supervisory performance ratings: effects of appraisal purpose, scale type, and range restriction
Por favor, use este identificador para citas ou ligazóns a este ítem:
http://hdl.handle.net/10347/20919
Ficheiros no ítem
Metadatos do ítem
Título: | Meta-analysis of interrater reliability of supervisory performance ratings: effects of appraisal purpose, scale type, and range restriction |
Autor/a: | Salgado Velo, Jesús Fernando Moscoso Ruibal, Silvia |
Centro/Departamento: | Universidade de Santiago de Compostela. Departamento de Ciencia Política e Socioloxía |
Palabras chave: | Reliability | Supervisory ratings | Job performance | Interrater reliability | Supervisory performance ratings | Appraisal purpose | Scale type | Range restriction | Meta-analysis | |
Data: | 2019 |
Editor: | Frontiers Media |
Cita bibliográfica: | Salgado, J. F., Moscoso, S. (2019). Meta-analysis of interrater reliability of supervisory performance ratings: effects of appraisal purpose, scale type, and range restriction. "Frontiers in Psychology", vol. 10, 2281 |
Resumo: | Objectives: This reliability generalization study aimed to estimate the mean and variance of the interrater reliability coefficients (ryy) of supervisory ratings of overall, task, contextual, and positive job performance. The moderating effect of the appraisal purpose and the scale type was examined. It was hypothesized that the ratings collected for research purposes and multi-item scales have higher ryy. It was also examined whether ryy was similar for the four performance dimensions. Method: A database consisting of 224 independent samples was created and hierarchical sub-grouping meta-analyses were conducted. Results: The appraisal purpose was a moderator of ryy for the four performance dimensions. Scale type was a moderator of ryy for overall and task performance collected for research purposes. The findings also suggest that supervisors seem to have less difficulty evaluating overall job performance than task, contextual, and positive performance. The best estimates of the observed ryy for overall job performance are 0.61 for research-collected ratings and 0.45 for administrative-collected ratings. Conclusions: (1) Appraisal purpose moderates ryy and researchers and practitioners should be aware of its effects before collecting ratings or using empirically-derived interrater reliability distributions, (2) Scale type seems to moderate ryy in the case of the ratings collected for research purposes, only, (3) overall job performance is more reliably rated than task, contextual, and positive performance. Implications for research and practice are discussed |
Versión do editor: | https://doi.org/10.3389/fpsyg.2019.02281 |
URI: | http://hdl.handle.net/10347/20919 |
DOI: | 10.3389/fpsyg.2019.02281 |
E-ISSN: | 1664-1078 |
Dereitos: | Copyright © 2019 Salgado and Moscoso. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms |
Coleccións
-
- CPA-Artigos [240]
A licenza do ítem descríbese como
Copyright © 2019 Salgado and Moscoso. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms
Copyright © 2019 Salgado and Moscoso. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms