Use of the Rasch and Masters Partial Credit Model in the Assessment of Mathematical Competencies ; Uso del Modelo de Crédito Parcial de Rasch y Masters en la Evaluación de Competencias Matemáticas

Recently, the assessment of learning outcomes has improved substantially due to developments in cognitive science, in the use of digital technologies and in the application of new measurement theory, especially Item Response Theory (IRT). Usually, items in a selection exam are designed dichotomously (right or wrong) and are scored accordingly. However, items designed to be solved by constructed answers can be employed and graded with partial responses. The purpose of this study is to examine the operation of the partial credit model (PCM) developed by G. Masters, from the dichotomous Rasch Model, for this type of items (Wright & Masters, 1982). A computer administered constructed answer exam was employed: The Mathematics Basic Competencies Exam -EXCOBA Math. The exam was administered to 547 engineering students in a public Mexican university. Employing the Winsteps© 4.5.5 (Linacre, 2020), a comparison of the students’ scores is made with responses first graded dichotomously and then graded as partial credit. The results show that although scores are not equivalent, these maintain the same order indicated by a correlation near 1. It is concluded that the Rasch & Masters PCM operates efficiently and can be employed even on items with elements not necessarily are concatenated as a sequence of incremental steps, as well as, in areas other than academic performance. ; Recientemente, la evaluación del aprendizaje ha mejorado sustancialmente gracias al desarrollo de las ciencias cognitivas, al uso de las tecnologías digitales y a las nuevas teorías de la medición, como la Teoría de Respuestas al Ítem (TRI). Usualmente, los reactivos de un examen de selección se califican de manera dicotómica (aciertos o errores); sin embargo, los reactivos de respuesta construida se pueden calificar parcialmente. El propósito del presente estudio fue conocer la forma en que opera el modelo de crédito parcial (MCP) de Rasch y Masters (Wright y Masters, 1982). Para ello, se utilizó el Examen de Competencias Básicas de Matemáticas ...