Identification and assessment of ongoing trials in health technology assessment reviews
Song F J, Fry-Smith A, Davenport C, Bayliss S, Adi Y, Wilson J S, et al
Record ID 32004000837
English
Authors' objectives:
This research aims to assess the importance of ongoing trials in health technology assessment reviews (HTARs) for the National Institute for Clinical Excellence (NICE) and to provide practical recommendations for identifying ongoing trials and assessing their possible impact.
Authors' results and conclusions:
The identification of ongoing trials is a common phenomenon in reviews of health technology assessment. Twenty-three of the 32 HTARs identified one or more ongoing trials and in eight of these the information on identified ongoing trials was not considered in the evidence synthesis and research recommendations. All but one HTAR that considered the potential impact of ongoing trials adopted a narrative approach. Trial registers and grey literature are important sources of information on ongoing trials. All 32 HTARs explicitly or implicitly searched for unpublished studies, and/or ongoing trials and/or grey literature and trial registers. The assessment of six commonly used trial registers suggested that most registers provided sufficient information for reviewers to decide the relevance of identified ongoing trials. However, it is sometimes extremely difficult to know whether ongoing trials identified from different sources (registers) are the same trials or belong to the same multicentre trials. The ISRCTN (the International Standard Randomised Controlled Trial Number) is the most reliable system but it has not been widely adopted. The qualitative assessment of ongoing trials compared major features of completed and ongoing trials, providing information about the possible impact of ongoing trials in terms of relevance, validity, reliability and generalisability. Quantitative methods to assess the impact of ongoing trials include cumulative meta-analysis related methods, fail-safe N, Bayesian data monitoring, and Bayesian interim predictions. The most useful method may be the Bayesian predictive probability, which estimates predictive probabilities for any possible values of treatment effect. A case study indicated that the appropriate use of quantitative methods would strengthen findings from narrative assessment of possible impact of ongoing trials.
Authors' recommendations:
Identification of ongoing trials is common in HTARs. Searching for ongoing trials in effectiveness reviews should be more thorough and explicit. Conversely, primary researchers, in particular those working with in multicentre trials, should label ongoing trials more clearly, preferably by ISRCTN. Qualitative assessment of identified ongoing trials is crucial and informative. Available quantitative methods could be used to strengthen findings from narrative assessment, although further research and more empirical examples are required. Information from ongoing trials may contribute to syntheses of results, conclusions and recommendations for future research. Future research is suggested into the identification and assessment of ongoing trials in other systematic reviews of effectiveness of health care interventions; existing and new methods for incorporating information on ongoing trials; comparing estimated impacts with the actual results of ongoing trials; and to incorporate findings from the assessment of ongoing trials into decision models.
Authors' methods:
Overview, Survey
Details
Project Status:
Completed
URL for project:
http://www.hta.ac.uk/1359
Year Published:
2004
English language abstract:
An English language summary is available
Publication Type:
Not Assigned
Country:
England, United Kingdom
MeSH Terms
- Information Storage and Retrieval
- Research
- Technology Assessment, Biomedical
Contact
Organisation Name:
NIHR Health Technology Assessment programme
Contact Address:
NIHR Journals Library, National Institute for Health and Care Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK
Contact Name:
journals.library@nihr.ac.uk
Contact Email:
journals.library@nihr.ac.uk
Copyright:
2009 Queen's Printer and Controller of HMSO
This is a bibliographic record of a published health technology assessment from a member of INAHTA or other HTA producer. No evaluation of the quality of this assessment has been made for the HTA database.