Comparison of the What Works Clearinghouse Standards for Single-Case Research: Applications for Systematic Reviews

SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com

Y

12

Program Effectiveness; Standards; Evidence; Case Studies; Research Methodology; Special Education; Educational Research; Program Evaluation; Behavior Problems; Student Behavior; Autism Spectrum Disorders; Interrater Reliability

10.1177/01987429241237712

0198-7429
2163-5307

Systematic reviews of single-case experimental research (SCER) in special education often use the What Works Clearinghouse (WWC) Standards to assess the methodological rigor of studies within a given literature base. While significant changes were made between the two most recent versions of the WWC standards, no research to date has evaluated the extent to which these standards would result in different evaluation outcomes. To examine potential differences, we applied version 4.1 and 5.0 of the standards to a sample database of SCER addressing the challenging behavior of students with autism in general education settings. Systematic search, screening, and review procedures resulted in a total of 20 articles included for this review. Findings indicated a 27% change in overall ratings across the studies, with version 5.0 leading to lower ratings than version 4.1, due to factors such as a lack of assessment of procedural fidelity, therapeutic baseline trends, and insufficient data points in the first baseline phase. We discuss implications for research based on our findings and recommend future directions for SCER in the field of special education.

As Provided

2024

EJ1446945