Issues and solutions in meta-analysis of single-case design with multiple dependent variables using multilevel modeling.

MULTILEVEL models; DEPENDENT variables; RANDOM effects model; INFERENTIAL statistics; EXPERIMENTAL design

It is common to include multiple dependent variables (DVs) in single-case experimental design (SCED) meta-analyses. However, statistical issues associated with multiple DVs in the multilevel modeling approach (i.e., possible dependency of error, heterogeneous treatment effects, and heterogeneous error structures) have not been fully investigated. In this study, we first addressed various issues caused by multiple DVs and examined current modeling practice, then proposed several modeling options for handling multiple DVs and compared their impact on parameter estimates and statistical inferences by conducting both empirical and simulation studies. The results indicated that different modeling options can lead to very different conclusions about the treatment effects, variance components, and model fit. Among the presented modeling options, modeling heterogeneity in the level-1 error structure and adding DV type as moderators had a noticeably large and consistent impact on both fixed and random effects as well as model fit. Although including DV types as an additional level had a relatively small impact compared to the other options, it was still able to alter the conclusion of the statistical inferences on the treatment effects. [ABSTRACT FROM AUTHOR]

Copyright of Journal of Experimental Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)