Item request has been placed! ×
Item request cannot be made. ×
loading  Processing Request

Assessing Quality in Systematic Literature Reviews: A Study of Novice Rater Training

Item request has been placed! ×
Item request cannot be made. ×
loading   Processing Request
اقرأ على الانترنت اقرأ أكثر حفظ في قائمتي
  • معلومة اضافية
    • Peer Reviewed:
      Y
    • المصدر:
      11
    • Education Level:
      Higher Education
      Postsecondary Education
    • الموضوع:
      Literature Reviews; Novices; Evidence Based Practice; Evaluators; Training; Graduate Students; Rating Scales; Bias; Problem Solving; Research Skills; Skill Development; Evaluative Thinking
    • الرقم المعرف:
      10.1177/2158244020939530
    • ISSN:
      2158-2440
    • نبذة مختصرة :
      This study investigated performance variability when graduate students critically appraised original studies from a systematic review. Fourteen doctoral students from different academic programs, with no systematic review experience, received training on the Methodological Quality Questionnaire (MQQ) rating scale. Participants were mostly male (71%) and non-native English speakers (79%). Each rater was randomly assigned one original study to independently assess using the MQQ. Their scores were compared to an expert rater. Statistical analysis comprised the following: percentage of agreement (POA), Kappa coefficient, and Kendall's tau-b correlation. On the completed MQQ rating scale, 43% of the novice raters had a POA of 78% or higher with the expert rater. From this case study, a guide for improving training on methodological quality assessment was developed. Benefits include the following: (a) developing and supporting critical reasoning as well as problem-solving skills and (b) increasing research skills and competencies in the systematic review process.
    • نبذة مختصرة :
      As Provided
    • الموضوع:
      2020
    • الرقم المعرف:
      EJ1271511