Systems to rate the strength of scientific evidence

Agency for Healthcare Research and Quality
Record ID 32002000390
English
Authors' objectives:

Health care decisions are increasingly being made on research-based evidence, rather than on expert opinion or clinical experience alone. This report examines systematic approaches to assessing the strength of scientific evidence. Such systems allow evaluation of either individual articles or entire bodies of research on a particular subject, for use in making evidence-based health-care decisions. Identification of methods to assess health care research results is a task that Congress directed the Tel: +64 3 364 1145Research and Quality to undertake as part of the Healthcare Research and Quality Act of 1999.

Authors' results and conclusions: The authors separately analyzed systems found in the literature and those in use by the Evidence-based Practice Centers (EPCs). Five non-EPC checklists for use with systematic reviews or meta-analyses accounted for at least six of seven domains needed to be considered high-performing. For analysis of RCTs, the authors concluded that eight systems represented acceptable approaches that could be used without major modifications. Six high-performing systems were identified to evaluate observational studies. Five non-EPC checklists adequately dealt with studies of diagnostic tests. For assessment of the strength of a body of evidence, seven systems fully addressed the quality, quantity, and consistency of the evidence.
Authors' recommendations: Overall, the authors identified 19 generic systems that fully address their key quality domains for a particular type of study. The authors also identified seven systems that address all three quality domains grading the strength of a body of evidence. The authors also recommended future research areas to bridge gaps where information or empirical documentation is needed. The authors hope that these systems will prove useful to those developing clinical practice guidelines or other health-related policy advice.
Authors' methods: Review
Details
Project Status: Completed
URL for project: http://www.ahrq.gov/clinic/epcsums/strengthsum.htm
Year Published: 2002
English language abstract: An English language summary is available
Publication Type: Not Assigned
Country: United States
MeSH Terms
  • Evidence-Based Medicine
  • Research
  • Technology Assessment, Biomedical
Contact
Organisation Name: Agency for Healthcare Research and Quality
Contact Address: Center for Outcomes and Evidence Technology Assessment Program, 540 Gaither Road, Rockville, MD 20850, USA. Tel: +1 301 427 1610; Fax: +1 301 427 1639;
Contact Name: martin.erlichman@ahrq.hhs.gov
Contact Email: martin.erlichman@ahrq.hhs.gov
Copyright: Agency for Healthcare Research and Quality (AHRQ)
This is a bibliographic record of a published health technology assessment from a member of INAHTA or other HTA producer. No evaluation of the quality of this assessment has been made for the HTA database.