Noncompletion and nonpublication of trials studying rare diseases: A cross-sectional analysis

English version

Autoři: Chris A. Rees ^aff001; Natalie Pica ^aff003; Michael C. Monuteaux ^aff001; Florence T. Bourgeois ^aff001
Působiště autorů: Division of Emergency Medicine, Boston Children’s Hospital, Boston, Massachusetts, United States of America ^aff001; Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, United States of America ^aff002; Department of Pediatrics, Children’s National Medical Center, The George Washington School of Medicine & Health Science, Washington, DC, United States of America ^aff003; Pediatric Therapeutics and Regulatory Science Initiative, Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts, United States of America ^aff004
Vyšlo v časopise: Noncompletion and nonpublication of trials studying rare diseases: A cross-sectional analysis. PLoS Med 16(11): e32767. doi:10.1371/journal.pmed.1002966
Kategorie: Research Article
doi: https://doi.org/10.1371/journal.pmed.1002966

Souhrn

Background

Rare diseases affect as many as 60 million people in the United States and Europe. However, most rare diseases lack effective therapies and are in critical need of clinical research. Our objective was to determine the frequency of noncompletion and nonpublication of trials studying rare diseases.

Methods and findings

We conducted a cross-sectional analysis of randomized clinical trials studying rare diseases as defined by the Genetic and Rare Disease Information Center database that were registered in ClinicalTrials.gov between January 1, 2010, and December 31, 2012, and completed or discontinued by December 31, 2014. Our main outcome measures were the frequency of trial noncompletion and, among completed studies, frequency of trial nonpublication at 2 and 4 years following trial completion. Reasons for discontinuation were extracted from the registry, and trial sponsors were contacted for additional information, as needed. Two independent investigators performed publication searches for each trial in PubMed, EMBASE, and GoogleScholar, allowing for a minimum of 45 months between trial completion and publication. When a publication could not be identified, trial sponsors were contacted to confirm publication status. The impact of funding source on trial noncompletion was assessed with multivariable logistic regression, and the effect on time to publication was examined with Cox proportional hazards regression. Control variables included intervention type, trial phase, masking, enrollment, and study population. We analyzed 659 rare disease trials accounting for 70,305 enrolled patients. Industry was the primary funder for 327 trials (49.6%) and academic institutions for 184 trials (27.9%). There were 79 trials (12.0%) focused on pediatric populations. A total of 199 trials (30.2%) were discontinued. Lack of patient accrual (n = 64, 32.1%) and informative termination (n = 41, 20.6%) were the most common reasons for trial noncompletion. Among completed trials, 306 (66.5%) remained unpublished at 2 years and 142 (31.5%) at 4 years. In multivariable analyses, industry-funded trials were less likely to be discontinued than trials funded by healthcare centers (odds ratio [OR] 2.42; 95% confidence interval [CI] 1.34–4.39, P = 0.003). We found no significant association between funding source and time to publication. A total of 18,148 patients were enrolled in trials that were discontinued or unpublished 4 years after completion. A potential limitation of our study is that certain interventional trials for rare diseases may not have been registered in ClinicalTrials.gov, in particular Phase 0 and Phase I trials, which are not required to be registered.

Conclusions

In this study, over half of clinical trials initiated for rare diseases were either discontinued or not published 4 years after completion, resulting in large numbers of patients with rare diseases exposed to interventions that did not lead to informative findings. Concerted efforts are needed to ensure that participation of patients in rare disease trials advances scientific knowledge and treatments for rare diseases.

Klíčová slova:

Drug research and development – Government funding of science – Health care sector – Institutional funding of science – Pediatrics – Peer review – Randomized controlled trials – United States

Zdroje

1. US Department of Health and Human Services, Food and Drug Administration. Report: Complex issues in developing drugs and biological products for rare diseases and accelerating the development of therapies for pediatric rare diseases including strategic plan: accelerating the development of therapies for pediatric rare diseases. US FDA; 2014 [cited 2019 Jan 15]. Available from: https://www.fda.gov/media/89051/download.

2. Tambuyzer E. Rare diseases, orphan drugs and their regulation: Questions and misconceptions. Nat Rev Drug Discov. 2010;9: 921–9. doi: 10.1038/nrd3275 21060315

3. Global Genes. RARE Diseases: Facts and Statistics. Aliso Viejo, CA: Global Genes; 2015 [cited 2019 Jan 14]. https://globalgenes.org/rare-diseases-facts-statistics/

4. Gammie T, Lu CY, Babar ZU. Access to orphan drugs: A comprehensive review of legislations, regulations and policies in 35 countries. PLoS ONE. 2015;10: e0140002. doi: 10.1371/journal.pone.0140002 26451948

5. Dechartres A, Riveros C, Harroch M, Faber T, Ravaud P. Characteristics and Public Availability of Results of Clinical Trials on Rare Diseases Registered at Clinicaltrials.gov. JAMA Intern Med. 2016;176: 556–558. doi: 10.1001/jamainternmed.2016.0137 26954340

6. Austin CP, Cutillo CM, Lau LPL, Rath A, Julkowska D, Thomson D, et al. Future of Rare Diseases Research 2017–2027: An IRDiRC Perspective. Clin Transl Sci. 2018;11: 21–27. doi: 10.1111/cts.12500 28796445

7. Tingley K, Coyle D, Graham ID, Sikora L, Chakraborty P, Wilson K, et al. Using a meta-narrative literature review and focus groups with key stakeholders to identify perceived challenges and solutions for generating robust evidence on the effectiveness of treatments for rare diseases. Orphanet J Rare Dis. 2018;13: 104. doi: 10.1186/s13023-018-0851-1 29954425

8. Rath A, Salamon V, Peixoto S, Hivert V, Laville M, Segrestin B, et al. A systematic literature review of evidence-based clinical practice for rare diseases: What are the perceived and real barriers for improving the evidence and how can they be overcome? Trials. 2017;18: 556. doi: 10.1186/s13063-017-2287-7 29166947

9. Kesselheim AS, Myers JA, Avorn J. Characteristics of clinical trials to support approval of orphan vs nonorphan drugs for cancer. JAMA. 2011;305: 2320–2326. doi: 10.1001/jama.2011.769 21642684

10. Pica N, Bourgeois FT. Discontinuation and Nonpublication of Randomized Clinical Trials Conducted in Children. Pediatrics. 2016;138: e20160223. doi: 10.1542/peds.2016-0223 27492817

11. Chapman SJ, Shelton B, Mahmood H, Fitzgerald JE, Harrison EM, Bhangu A. Discontinuation and non-publication of surgical randomised controlled trials: observational study. BMJ. 2014;349: g6870. doi: 10.1136/bmj.g6870 25491195

12. Jones CW, Handler L, Crowell KE, Keil LG, Weaver MA, Platts-Mills TF. Non-publication of large randomized clinical trials: cross sectional analysis. BMJ. 2013;347: f6104. doi: 10.1136/bmj.f6104 24169943

13. National Institutes of Health. Genetic And Rare Diseases Information Center. US NIH; 2015 [cited 2017 Nov 1]. Available from: https://rarediseases.info.nih.gov/diseases

14. National Institutes of Health. Genetic And Rare Diseases Information Center: Find Diseases by Category. US NIH; 2015 [cited 2017 Nov 1]. Available from: https://rarediseases.info.nih.gov/diseases/categories

15. Califf RM, Zarin DA, Kramer JM, Sherman RE, Aberle LH, Tasneem A. Characteristics of Clinical Trials Registered in ClinicalTrials.gov, 2007–2010. JAMA. 2012;307: 1838–1847. doi: 10.1001/jama.2012.3424 22550198

16. Bourgeois FT, Murthy S, Pinto C, Olson KL, Ioannidis JP, Mandl KD. Pediatric Versus Adult Drug Trials for Conditions With High Pediatric Disease Burden. Pediatrics. 2012;130: 285–292. doi: 10.1542/peds.2012-0139 22826574

17. Carlisle B, Kimmelman J, Ramsay T, MacKinnon N. Unsuccessful Trial Accrual and Human Subjects Protections: An Empirical Analysis of Recently Closed Trials. Clin Trials. 2015;12: 77–83. doi: 10.1177/1740774514558307 25475878

18. Kasenda B, von Elm E, You J, Blumle A, Tomonaga Y, Saccilotto R, et al. Prevalence, characteristics, and publication of discontinued randomized trials. JAMA. 2014;311: 1045–1051. doi: 10.1001/jama.2014.1361 24618966

19. Roddick AJ, Chan FTS, Stefaniak JD, Zheng SL. Discontinuation and non-publication of clinical trials in cardiovascular medicine. Int J Cardiol. 2017;244: 309–315. doi: 10.1016/j.ijcard.2017.06.020 28622947

20. Schandelmaier S, Tomonaga Y, Bassler D, Meerpohl JJ, von Elm E, You JJ, et al. Premature Discontinuation of Pediatric Randomized Controlled Trials: A Retrospective Cohort Study. J Pediatr. 2017;184: 209–214. doi: 10.1016/j.jpeds.2017.01.071 28410086

21. Stefaniak JD, Lam TCH, Sim NE, Al-Shahi Salman R, Breen DP. Discontinuation and non-publication of neurodegenerative disease trials: a cross-sectional analysis. Eur J Neurol. 2017;24: 1071–1076. doi: 10.1111/ene.13336 28636179

22. Manzoli L, Flacco ME, D’Addario M, Capasso L, De Vito C, Marzuillo C, et al. Non-publication and delayed publication of randomized trials on vaccines: survey. BMJ. 2014;348: g3058. doi: 10.1136/bmj.g3058 24838102

23. Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM. Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis. PLoS Med. 2009;6: e1000144. doi: 10.1371/journal.pmed.1000144 19901971

24. Gordon D, Taddei-Peters W, Mascette A, Antman M, Kaufmann PG, Lauer MS. Publication of trials funded by the National Heart, Lung, and Blood Institute. N Engl J Med. 2013;369: 1926–1934. doi: 10.1056/NEJMsa1300237 24224625

25. Rüegger CM, Dawson JA, Donath SM, Owen LS, Davis PG. Nonpublication and discontinuation of randomised controlled trials in newborns. Acta Paediatr. 2017;106: 1940–1944. doi: 10.1111/apa.14062 28871629

26. Awerbach JD, Krasuski RA, Hill KD. Characteristics of pediatric pulmonary hypertension trials registered on ClinicalTrials.gov. Pulm Circ. 2017;7: 348–360. doi: 10.1177/2045893217695567 28597754

27. Strech D. Normative arguments and new solutions for the unbiased registration and publication of clinical trials. J Clin Epidemiol. 2012;65: 276–281. doi: 10.1016/j.jclinepi.2011.07.002 22014887

28. World Medical Association. WMA Declaration of Helsinki—ethical principles for medical research involving human subjects. Finland: WMA; 2013 [cited 2019 March 29]. Available from: https://www.wma.net/policies-post/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects/

29. Federal Policy for the Protection of Human Subjects ('Common Rule’), 45 C.F.R. Sect. 46. (2009). Available from: https://www.hhs.gov/ohrp/regulations-and-policy/regulations/common-rule/index.html

30. Doshi P, Dickersin K, Healy D, Vedula SS, Jefferson T. Restoring invisible and abandoned trials: A call for people to publish the findings. BMJ. 2013;346: f2865. doi: 10.1136/bmj.f2865 23766480

31. US National Library of Medicine. ClinicalTrials.gov. Available from: https://clinicaltrials.gov/ct2/search/advanced?cond=&term=&state1=&cntry1=. [cited 2017 Nov 16]

32. Cobo E, Selva-O'Callagham A, Ribera JM, Cardellach F, Dominguez R, Vilardell M. Statistical Reviewers Improve Reporting in Biomedical Articles: A Randomized Trial. PLoS ONE. 2007;2: e332. doi: 10.1371/journal.pone.0000332 17389922

33. Goodman SN, Berlin J, Fletcher SW, Fletcher RH. Manuscript quality before and after peer review and editing at Annals of Internal Medicine. Ann Intern Med. 1994;121: 11–21. doi: 10.7326/0003-4819-121-1-199407010-00003 8198342

34. The YODA Project. medRxiv. Yale University. Available from: https://yoda.yale.edu/medrxiv. [cited August 12, 2019]

35. Bourgeois FT, Hwang TJ. Improving the study of new medicines for children with rare diseases. JAMA Pediatr. 2018;172: 7–9. doi: 10.1001/jamapediatrics.2017.4012 29131900

36. Bourgeois FT, Hwang TJ. The pediatric research equity act moves into adolescence. JAMA. 2017;317: 259–260. doi: 10.1001/jama.2016.18131 28114560

37. Hwang TJ, Bourgeois FT, Franklin JM, Kesselheim AS. Impact Of The Priority Review Voucher Program On Drug Development For Rare Pediatric Diseases. Health Aff (Millwood). 2019;38: 313–319. doi: 10.1377/hlthaff.2018.05330 30715972

38. Giannuzzi V, Conte R, Landi A, Ottomano SA, Bonifazi D, Baiardi P, et al. Orphan medicinal products in Europe and United States to cover needs of patients with rare diseases: an increased common effort is to be foreseen. Orphanet J Rare Dis. 2017;12: 64. doi: 10.1186/s13023-017-0617-1 28372595

39. Bourgeois FT, Kesselheim AS. Promoting Pediatric Drug Research and Lableing—Outcomes of Legislation. N Engl J Med. 2019;381: 875–881. doi: 10.1056/NEJMhle1901265 31461599

40. Benjamin DK Jr, Smith PB, Sun MJ, Murphy MD, Avant D, Mathis L, et al. Safety and transparency of pediatric drug trials. Arch Pediatr Adolesc Med. 2009;163: 1080–1086. doi: 10.1001/archpediatrics.2009.229 19996043

41. US Department of Health and Human Services, Food and Drug Administration. Rare pediatric disease priority review vouchers, guidance for industry: draft guidance. US FDA; 2014 [cited March 30, 2019]. Available from: https://www.fda.gov/downloads/RegulatoryInformation/Guidances/UCM423325.pdf.

42. Hwang TJ, Tomasi PA, Bourgeois FT. Delays in completion and results reporting of clinical trials under the Paediatric Regulation in the European Union: A cohort study. PLoS Med. 2018;15: e1002520. doi: 10.1371/journal.pmed.1002520 29494592

43. Estellat C, Ravaud P. Lack of Head-to-head Trials and Fair Control Arms: randomized controlled trials of biologic treatment for rheumatoid arthritis. Arch Intern Med. 2012;172: 237–244. doi: 10.1001/archinternmed.2011.1209 22332155

44. Viergever RF, Ghersi D. The quality of registration of clinical trials. PLoS ONE. 2011;6: e14701. doi: 10.1371/journal.pone.0014701 21383991

45. Alturki R, Schandelmaier S, Olu KK, von Niederhausen B, Agrawal A, Frei R, et al. Premature trial discontinuation often not accurately reflected in registries: comparison of registry records with publications. J Clin Epidemiol. 2017;81: 56–63. doi: 10.1016/j.jclinepi.2016.08.011 27614277

46. Deschartes A, Riveros C, Harroch M, Faber T, Ravaud P. Characteristics and public availability of results of clinical trials on rare diseases registered at ClinicalTrials.gov. JAMA Intern Med. 2016;176: 556–8. doi: 10.1001/jamainternmed.2016.0137 26954340