Authors' objectives:

Concerns have mounted about the complexities of the health care system potentially causing significant unintended adverse effects. With a major national interest in addressing patient safety issues, a wide spectrum of individuals and organizations are working toward developing methods and systems to detect, characterize, and report potentially preventable adverse events. One approach is to develop screening measures based on routinely collected administrative data, such as the patient safety indicators (PSIs) reported here. The purpose of the PSI project is to report 1) literature-based evidence on potential PSIs, 2) clinician panel review results of potential indicators, 3) empirical analyses on a subset of indicators, and 4) recommendations regarding potential PSIs.

Authors' results and conclusions: A review of previously reported measures in the literature, and of medical coding manuals, resulted in identification of over 200 ICD-9-CM codes representing potential patient safety problems. Most of these codes were grouped into clinically meaningful indicators either based on previous indicator definitions or on clinical and coding expertise. Based on literature review of the published evidence related to their validity, several potential PSIs were eliminated. Because of the limited validation literature available on PSIs and complications indicators from which many PSIs were derived, the research team conducted a clinical panel review process to assess the face validity and to guide refinements to the initial definitions of the 34 most promising PSIs. Response to a questionnaire by clinicians (i.e., physicians from a number of specialties, nurses, and pharmacists) for each indicator, augmented by coding review and initial empirical testing, provided the basis for selecting the indicators expected to be most useful for screening for potentially preventable adverse events. Twenty hospital level PSIs are recommended for implementation as the initial AHRQ PSI set (designated Accepted indicators).

Authors' recommendations: Future validation work should focus on the sensitivity and specificity of these indicators in detecting the occurrence of a complication; the extent to which failures in processes of care at the system or individual level are detected using these indicators; the relationship of these indicators with other measures of quality, such as mortality; and further explorations of bias and risk adjustment. Enhancements to administrative data are worth exploring in the context of further validation studies that utilize data from other sources. The current development and evaluation effort will best be augmented by a continuous communication loop between users of these measures, researchers interested in improving these measures, and policy makers with influence over the resources aimed at data collection and patient safety measurement.

Authors' methods: Systematic review

Project Status: Completed

URL for project: http://www.ahrq.gov/clinic/epcix.htm

Year Published: 2002

English language abstract: An English language summary is available

Publication Type: Not Assigned

Country: United States

Organisation Name: Agency for Healthcare Research and Quality

Contact Address: Center for Outcomes and Evidence Technology Assessment Program, 540 Gaither Road, Rockville, MD 20850, USA. Tel: +1 301 427 1610; Fax: +1 301 427 1639;

Contact Name: martin.erlichman@ahrq.hhs.gov

Contact Email: martin.erlichman@ahrq.hhs.gov

Copyright: Agency for Healthcare Research and Quality (AHRQ)