On the comparability of SET scores: measurement invariance across programs, departments, and time

Simple item page
dc.catalogadorgjm
dc.contributor.authorValencia Acuña, Edgar Andrés
dc.date.accessioned2025-06-19T13:59:25Z
dc.date.available2025-06-19T13:59:25Z
dc.date.issued2025
dc.description.abstractComparability of student evaluation of teaching (SET) administered to different groups of students is crucial in supporting sound institutional analysis and decision-making, including personnel decisions. However, the interpretation of the same SET questionnaire may change as there are differences in beliefs about teaching and learning across disciplines, and because students change their understanding of high-performance teaching over time. This study presents substantive justification and statistical reasoning for studying the comparability of SET scores across commonly used administrative variables in institutional data analysis. As an illustration, the study presents evidence of measurement invariance to support SET scores comparability by (1) type of degree program, (2) academic department and (3) over terms using data from a graduate school of education. The results reveal no support for the strict comparability of SET scores across these institutionally relevant variables. SET comparability evaluation helps ensure effective decision-making affecting faculty and curriculum development. In addition, this analytical tool enables institutions to improve SET over time. Users and those affected by SET data utilisation should develop the skills to guarantee and inquire about SET comparability for credible interpretation of SET scores, along with fair decision-making.
dc.format.extent15 páginas
dc.fuente.origenSCOPUS
dc.identifier.doi10.1080/02602938.2025.2508754
dc.identifier.issn0260-2938
dc.identifier.scopusidSCOPUS_ID:105007421581
dc.identifier.urihttps://doi.org/10.1080/02602938.2025.2508754
dc.identifier.urihttps://repositorio.uc.cl/handle/11534/104695
dc.information.autorucFacultad de Educación; Valencia Acuña, Edgar Andrés; 0000-0002-0311-9272; 131988
dc.language.isoen
dc.nota.accesocontenido parcial
dc.publisherRoutledge
dc.revistaAssessment and Evaluation in Higher Education
dc.rightsacceso restringido
dc.subjectFaculty evaluation
dc.subjectMeasurement invariance
dc.subjectScores comparability
dc.subjectStudent evaluation of teaching
dc.subject.ddc370
dc.subject.deweyEducaciónes_ES
dc.subject.ods04 Quality education
dc.subject.odspa04 Educación de calidad
dc.titleOn the comparability of SET scores: measurement invariance across programs, departments, and time
dc.typeartículo
sipa.codpersvinculados131988
sipa.trazabilidadSCOPUS;2025-06-15
Files
Collections
Artículos de revistas