Language bias in orthodontic systematic reviews: A meta-epidemiological study.

Publisher: Public Library of Science Country of Publication: United States NLM ID: 101285081 Publication Model: eCollection Cited Medium: Internet ISSN: 1932-6203 (Electronic) Linking ISSN: 19326203 NLM ISO Abbreviation: PLoS One

Original Publication: San Francisco, CA : Public Library of Science

Language* ; Epidemiologic Studies* ; Systematic Reviews as Topic* ; Orthodontics*; Humans ; Bias

Background: Orthodontic systematic reviews (SRs) include studies published mostly in English than non-English languages. Including only English studies in SRs may result in a language bias. This meta-epidemiological study aimed to evaluate the language bias impact on orthodontic SRs.
Data Source: SRs published in high-impact orthodontic journals between 2017 and 2021 were retrieved through an electronic search of PubMed in June 2022. Additionally, Cochrane oral health group was searched for orthodontic systematic reviews published in the same period.
Data Collection and Analysis: Study selection and data extraction were performed by two authors. Multivariable logistic regression was implemented to explore the association of including non-English studies with the SRs characteristics. For the meta-epidemiological analysis, one meta-analysis from each SRs with at least three trials, including one non-English trial was extracted. The average difference in SMD was obtained using a random-effects meta-analysis.
Results: 174 SRs were included in this study. Almost one-quarter (n = 45/174, 26%) of these SRs included at least one non-English study. The association between SRs characteristics and including non-English studies was not statistically significant except for the restriction on language: the odds of including non-English studies reduced by 89% in SRs with a language restriction (OR: 0.11, 95%CI: 0.01 0.55, P< 0.01). Out of the sample, only fourteen meta-analyses were included in the meta-epidemiological analysis. The meta-epidemiological analysis revealed that non-English studies tended to overestimate the summary SMD by approximately 0.30, but this was not statistically significant when random-effects model was employed due to substantial statistical heterogeneity (ΔSMD = -0.29, 95%CI: -0.63 to 0.05, P = 0.37). As such, the overestimation of meta-analysis results by including non-English studies was statistically non-significant.
Conclusion: Language bias has non-negligible impact on the results of orthodontic SRs. Orthodontic systematic reviews should abstain from language restrictions and use sensitivity analysis to assess the impact of language on the conclusions, as non-English studies may have a lower quality.
Competing Interests: The authors have declared that no competing interests exist.
(Copyright: © 2024 Mheissen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)

Health Info Libr J. 2008 Mar;25(1):55-61. (PMID: 18251914)
Ann Intern Med. 2018 Sep 18;169(6):385-393. (PMID: 30140933)
J Clin Epidemiol. 2018 Aug;100:103-110. (PMID: 29339215)
BMJ. 2013 Feb 12;346:f707. (PMID: 23403829)
Stat Med. 2002 Aug 30;21(16):2409-19. (PMID: 12210625)
Clin Oral Investig. 2014 May;18(4):1031-1044. (PMID: 24526347)
BMJ. 2017 Sep 21;358:j4008. (PMID: 28935701)
Orthod Craniofac Res. 2020 Feb;23(1):16-26. (PMID: 31608577)
Eur J Orthod. 2021 Mar 19;:567-575. (PMID: 33740054)
J Dent. 2018 Jul;74:90-94. (PMID: 29738788)
PLoS One. 2020 Mar 9;15(3):e0229822. (PMID: 32150596)
Lancet. 1997 Aug 2;350(9074):326-9. (PMID: 9251637)
Eur J Orthod. 2021 Oct 4;43(5):544-550. (PMID: 33723612)
Int J Technol Assess Health Care. 2012 Apr;28(2):138-44. (PMID: 22559755)
Dental Press J Orthod. 2018 Nov-Dec;23(6):40.e1-40.e10. (PMID: 30672991)
Int J Epidemiol. 2002 Feb;31(1):115-23. (PMID: 11914306)
Eur J Orthod. 2021 Oct 4;43(5):596-600. (PMID: 34331450)
Eur J Orthod. 2015 Dec;37(6):603-9. (PMID: 25667037)
J Clin Epidemiol. 2005 Aug;58(8):769-76. (PMID: 16086467)
Orthod Craniofac Res. 2021 May;24(2):165-179. (PMID: 32779352)
BMC Med Res Methodol. 2017 Apr 19;17(1):64. (PMID: 28420349)
Evid Based Med. 2017 Aug;22(4):139-142. (PMID: 28701372)
Health Technol Assess. 2003;7(41):1-90. (PMID: 14670218)
J Clin Epidemiol. 2021 Sep;137:209-217. (PMID: 33933579)
Eur J Orthod. 2021 Oct 4;43(5):551-556. (PMID: 33367640)

Date Created: 20240401 Date Completed: 20240807 Latest Revision: 20240807

20240808

PMC10984547

10.1371/journal.pone.0300881

38557691