Bad research is not all bad.

Publisher: BioMed Central Country of Publication: England NLM ID: 101263253 Publication Model: Electronic Cited Medium: Internet ISSN: 1745-6215 (Electronic) Linking ISSN: 17456215 NLM ISO Abbreviation: Trials Subsets: MEDLINE

Original Publication: [London] : BioMed Central, 2006-

Bias* ; Randomized Controlled Trials as Topic* ; Research Design*; Humans

In this commentary, we discuss a recent article in Trials that raised concerns about the number of poorly performed randomised trials in the medical literature and discuss the trials literature more widely. Although we all aim for higher methodological standards in trials, we argue that (i) the idea that 'most randomised trials are bad', which the recent article concludes is an overly simplistic representation of the situation, and (ii) the suggestion that an increased focus on methodological review during trial development (e.g. ethical boards performing some assessment of the methodologists on a trial), while well meaning, may have negative unintended consequences. We therefore propose that (a) trials should be assessed on their merits and weaknesses, including an assessment of risk of bias but placing that in a wider context; (b) we should recognise that although the methodological conduct of trials is of utmost importance, interventions that aim to improve this could have unintended consequences-such as bureaucracy-that have an overall negative effect; and (c) we should therefore generate an evidence base for policy interventions to improve conduct of trials rather than applying arbitrary rules.
(© 2023. BioMed Central Ltd., part of Springer Nature.)

Trials. 2022 Jun 27;23(1):535. (PMID: 35761345)
Lancet. 2019 Apr 6;393(10179):1453-1464. (PMID: 30765123)
Trials. 2022 Jun 2;23(1):458. (PMID: 35655288)
Clin Infect Dis. 2017 Nov 13;65(11):1773-1775. (PMID: 29020156)
BMJ. 1994 Jan 29;308(6924):283-4. (PMID: 8124111)
Addiction. 2018 May 17;:. (PMID: 29774607)
Clin Trials. 2006;3(6):496-502. (PMID: 17170032)
BMJ. 2019 Mar 13;364:l1097. (PMID: 30867145)
JAMA Netw Open. 2022 Dec 1;5(12):e2245424. (PMID: 36477481)
Clin Trials. 2017 Apr;14(2):115-123. (PMID: 28359194)
Cochrane Database Syst Rev. 2020 Oct 15;10:CD013398. (PMID: 33058136)
BMC Med Res Methodol. 2012 Aug 16;12:122. (PMID: 22898336)
Lancet Respir Med. 2018 Jan;6(1):40-50. (PMID: 29196046)
J R Stat Soc Ser A Stat Soc. 2009 Jan;172(1):21-47. (PMID: 19381328)
Hemasphere. 2020 Feb 26;4(2):e352. (PMID: 32309789)
Int J Epidemiol. 2016 Dec 1;45(6):1866-1886. (PMID: 28108528)
BMJ. 2004 Jul 31;329(7460):282-4. (PMID: 15284157)
Cochrane Database Syst Rev. 2021 Jan 20;1:CD009576. (PMID: 33469915)
Cochrane Database Syst Rev. 2020 Jun 4;6:CD012431. (PMID: 32497279)
Arch Intern Med. 2008 Feb 25;168(4):351-6. (PMID: 18299488)
Liver Int. 2021 Mar;41(3):456-463. (PMID: 33389788)
Clin Microbiol Infect. 2018 Apr;24(4):328-331. (PMID: 29326009)
N Engl J Med. 2020 Nov 19;383(21):2030-2040. (PMID: 33031652)
RMD Open. 2022 Feb;8(1):. (PMID: 35197362)
Cochrane Database Syst Rev. 2021 Feb 12;2:CD013587. (PMID: 33624299)
JAMA Pediatr. 2019 Jan 1;173(1):21-28. (PMID: 30419120)
Cochrane Database Syst Rev. 2017 Jun 06;6:CD012143. (PMID: 28585310)

United Kingdom WT_ Wellcome Trust; 222894/Z/21/Z United Kingdom WT_ Wellcome Trust

Keywords: Evidence; Policy; Trials

Date Created: 20231020 Date Completed: 20231120 Latest Revision: 20240210

20240210

PMC10588138

10.1186/s13063-023-07706-1

37864198