Single-Case Synthesis Tools II: Comparing Quantitative Outcome Measures

Y

38

Institute of Education Sciences (ED)

R305D160002

Research Design; Evaluation Methods; Synthesis; Intervention; Program Effectiveness; Sensory Training; Behavior Modification; Effect Size; Meta Analysis; Outcome Measures; Comparative Analysis; Statistical Analysis

10.1016/j.ridd.2018.02.001

Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes--overlap measures (percentage non-overlapping data, improvement rate difference, and Tau) and parametric within-case effect sizes (standardized mean difference and log response ratio [increasing and decreasing])--were compared to determine if choice of synthesis method within and across classes impacts conclusions regarding effectiveness. The effectiveness of sensory-based interventions (SBI), a commonly used class of treatments for young children, was evaluated. Separately from evaluations of rigor and quality, authors evaluated behavior change between baseline and SBI conditions. SBI were unlikely to result in positive behavior change across all measures except IRD. However, subgroup analyses resulted in variable conclusions, indicating that the choice of measures for SCD meta-analyses can impact conclusions. Suggestions for using the log response ratio in SCD meta-analyses and considerations for understanding variability in SCD meta-analysis conclusions are discussed. [This is the in press version of an article published in "Research in Developmental Disabilities." For Part I, see ED599350.]

As Provided

Yes

2019

ED599351