PubMed Health⌕ Search

Biomedical subjects

J J Allison

Publications and source records attributed to J J Allison.

14 recordsLinked to original sources

Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial.

CONTEXT: Performance feedback and benchmarking, common tools for health care improvement, are rarely studied in randomized trials. Achievable Benchmarks of Care (ABCs) are standards of excellence attained by top performers in a peer group and are easily and reproducibly calculated from existing performance data. OBJECTIVE: To evaluate the effectiveness of using achievable benchmarks to enhance typical physician performance feedback and improve care. DESIGN: Group-randomized controlled trial conducted in December 1996, with follow-up through 1998. SETTING AND PARTICIPANTS: Seventy community physicians and 2978 fee-for-service Medicare patients with diabetes mellitus who were part of the Ambulatory Care Quality Improvement Project in Alabama. INTERVENTION: Physicians were randomly assigned to receive a multimodal improvement intervention, including chart review and physician-specific feedback (comparison group; n = 35) or an identical intervention plus achievable benchmark feedback (experimental group; n = 35). MAIN OUTCOME MEASURE: Preintervention (1994-1995) to postintervention (1997-1998) changes in the proportion of patients receiving influenza vaccination; foot examination; and each of 3 blood tests measuring glucose control, cholesterol level, and triglyceride level, compared between the 2 groups. RESULTS: The proportion of patients who received influenza vaccine improved from 40% to 58% in the experimental group (P<.001) vs from 40% to 46% in the comparison group (P =.02). Odds ratios (ORs) for patients of achievable benchmark physicians vs comparison physicians who received appropriate care after the intervention, adjusted for preintervention care and nesting of patients within physicians, were 1.57 (95% confidence interval [CI], 1.26-1.96) for influenza vaccination, 1.33 (95% CI, 1.05-1.69) for foot examination, and 1.33 (95% CI, 1.04-1.69) for long-term glucose control measurement. For serum cholesterol and triglycerides, the achievable benchmark effect was statistically significant only after additional adjustment for physician characteristics (OR, 1.40 [95% CI, 1.08-1.82] and OR, 1.40 [95% CI, 1.09-1.79], respectively). CONCLUSION: Use of achievable benchmarks significantly enhances the effectiveness of physician performance feedback in the setting of a multimodal quality improvement intervention.

Aged↗

Ten-year changes in smoking among young adults: are racial differences explained by socioeconomic factors in the CARDIA study?

OBJECTIVES: This study investigated whether socioeconomic factors explain racial/ethnic differences in regular smoking initiation and cessation. METHODS: Data were derived from the CARDIA study, a cohort of 5115 healthy adults aged 18 to 30 years at baseline (1985-1986) and recruited from the populations of 4 US cities. Respondents were followed over 10 years. RESULTS: Among 3950 respondents reexamined in 1995-1996, 20% of Whites and 33% of African Americans were smokers, as compared with 25% and 32%, respectively, in 1985-1986. On average, African Americans were of lower socioeconomic status. Ten-year regular smoking initiation rates for African American women, White women, African American men, and White men were 7.1%, 3.5%, 13.2%, and 5.1%, respectively, and the corresponding cessation rates were 25%, 35.1%, 19.2%, and 31.3%. After adjustment for socioeconomic factors, most 95% confidence intervals of the odds ratios for regular smoking initiation and cessation in African Americans vs Whites included 1. CONCLUSIONS: Less beneficial 10-year changes in smoking were observed in African Americans, but socioeconomic factors explained most of the racial disparity.

Adolescent↗

Relationship of hospital teaching status with quality of care and mortality for Medicare patients with acute MI.

CONTEXT: Issues of cost and quality are gaining importance in the delivery of medical care, and whether quality of care is better in teaching vs nonteaching hospitals is an essential question in this current national debate. OBJECTIVE: To examine the association of hospital teaching status with quality of care and mortality for fee-for-service Medicare patients with acute myocardial infarction (AMI). DESIGN, SETTING, AND PATIENTS: Analysis of Cooperative Cardiovascular Project data for 114,411 Medicare patients from 4361 hospitals (22,354 patients from 439 major teaching hospitals, 22,493 patients from 455 minor teaching hospitals, and 69,564 patients from 3467 nonteaching hospitals) who had AMI between February 1994 and July 1995. MAIN OUTCOME MEASURES: Administration of reperfusion therapy on admission, aspirin during hospitalization, and beta-blockers and angiotensin-converting enzyme inhibitors at discharge for patients meeting strict inclusion criteria; mortality at 30, 60, and 90 days and 2 years after admission. RESULTS: Among major teaching, minor teaching, and nonteaching hospitals, respectively, administration rates for aspirin were 91.2%, 86.4%, and 81.4% (P<.001); for angiotensin-converting enzyme inhibitors, 63. 7%, 60.0%, and 58.0% (P<.001); for beta-blockers, 48.8%, 40.3%, and 36.4% (P<.001); and for reperfusion therapy, 55.5%, 58.9%, and 55.2% (P =.29). Differences in unadjusted 30-day, 60-day, 90-day, and 2-year mortality among hospitals were significant at P<.001 for all time periods, with a gradient of increasing mortality from major teaching to minor teaching to nonteaching hospitals. Mortality differences were attenuated by adjustment for patient characteristics and were almost eliminated by additional adjustment for receipt of therapy. CONCLUSIONS: In this study of elderly patients with AMI, admission to a teaching hospital was associated with better quality of care based on 3 of 4 quality indicators and lower mortality. JAMA. 2000;284:1256-1262

Hospital Mortality↗

Relation of race and sex to the use of reperfusion therapy in Medicare beneficiaries with acute myocardial infarction.

BACKGROUND: There are few reports describing the combined influence of the race and sex of a patient on the use of reperfusion therapy for acute myocardial infarction. METHODS: To determine the relation of race and sex to the receipt of reperfusion therapy for myocardial infarction in the United States, we reviewed the medical records of 234,769 Medicare patients with myocardial infarction. From these records we identified 26,575 white or black patients who met strict eligibility criteria for reperfusion therapy. We then performed bivariate and multivariate analyses of prevalence ratios to determine predictors of the use of reperfusion therapy in four subgroups of patients categorized according to race and sex: white men, white women, black men, and black women. RESULTS: Among eligible patients, white men received reperfusion therapy with the highest frequency (59 percent), followed by white women (56 percent), black men (50 percent), and black women (44 percent). After adjustment for differences in demographic and clinical characteristics, white women were as likely as white men to receive reperfusion therapy (prevalence ratio, 1.00; 95 percent confidence interval, 0.98 to 1.03). Likewise, black women were as likely as black men to receive reperfusion therapy (prevalence ratio, 1.00; 95 percent confidence interval, 0.89 to 1.13). However, black women were significantly less likely to receive reperfusion therapy than white men (prevalence ratio, 0.90; 95 percent confidence interval, 0.82 to 0.98), as were black men (prevalence ratio, 0.85; 95 percent confidence interval, 0.78 to 0.93). CONCLUSIONS: After adjustment for differences in clinical and demographic characteristics and clinical presentation, differences according to sex in the use of reperfusion therapy are minimal. However, blacks, regardless of sex, are significantly less likely than whites to receive this potentially lifesaving therapy.

Aged↗

The art and science of chart review.

BACKGROUND: Explicit chart review was an integral part of an ongoing national cooperative project, "Using Achievable Benchmarks of Care to Improve Quality of Care for Outpatients with Depression," conducted by a large managed care organization (MCO) and an academic medical center. Many investigators overlook the complexities involved in obtaining high-quality data. Given a scarcity of advice in the quality improvement (QI) literature on how to conduct chart review, the process of chart review was examined and specific techniques for improving data quality were proposed. METHODS: The abstraction tool was developed and tested in a prepilot phase; perhaps the greatest problem detected was abstractor assumption and interpretation. The need for a clear distinction between symptoms of depression or anxiety and physician diagnosis of major depression or anxiety disorder also became apparent. In designing the variables for the chart review module, four key aspects were considered: classification, format, definition, and presentation. For example, issues in format include use of free-text versus numeric variables, categoric variables, and medication variables (which can be especially challenging for abstraction projects). Quantitative measures of reliability and validity were used to improve and maintain the quality of chart review data. Measuring reliability and validity offers assistance with development of the chart review tool, continuous maintenance of data quality throughout the production phase of chart review, and final documentation of data quality. For projects that require ongoing abstraction of large numbers of clinical records, data quality may be monitored with control charts and the principles of statistical process control. RESULTS: The chart review module, which contained 140 variables, was built using MedQuest software, a suite of tools designed for customized data collection. The overall interrater reliability increased from 80% in the prepilot phase to greater than 96% in the final phase (which included three abstractors and 465 unique charts). The mean time per chart was calculated for each abstractor, and the maximum value was 13.7 +/- 13 minutes. CONCLUSIONS: In general, chart review is more difficult than it appears on the surface. It is also project specific, making a "cookbook" approach difficult. Many factors, such as imprecisely worded research questions, vague specification of variables, poorly designed abstraction tools, inappropriate interpretation by abstractors, and poor or missing recording of data in the chart, may compromise data quality.

Data Collection↗

Optimal reporting of health care process measures: inferential statistics as help or hindrance?

In this paper we discuss the appropriate application of inferential statistics to practice profiles and other measures of care. To accomplish our objectives, we first describe the relative merits of measuring three well-recognized domains of medical quality: structure, process, and outcome. Next, we discuss inferential statistics as used in quality improvement. We then describe several common circumstances that arise in the measurement of medical care, giving attention to the application of inferential statistics to each situation. We end with a brief discussion of statistical techniques commonly used in the measurement of quality and challenges that arise with their use.

Health Services Research↗

Achievable benchmarks of care: the ABCs of benchmarking.

Benchmarking is generally considered to be an important tool for quality improvement. Traditional approaches to benchmarking have relied on subjective identification of 'leaders in the field'. We derive an objective, reproducible and attainable Achievable Benchmark of Care (ABC) by measuring and analysing performance on process-of-care indicators. Three characteristics of the ABC that we deem essential are: (1) benchmarks represent a measurable level of excellence; (2) benchmarks are demonstrably attainable; (3) benchmarks are derived from data in an objective, reproducible and predetermined fashion. From these characteristics it follows that (4) providers with high performance are selected to define a level of excellence in a predetermined fashion, but (5) providers with high performance on small numbers of cases do not influence unduly benchmark levels. We use the 'pared mean' to operationalize the ABC. Roughly, the pared mean summarizes the performance of top-ranked providers whereby at least 10% of the patient pool across all providers is included. Bayesian estimators for adjustment of performance of providers with small sample sizes are used to rank providers. Randomized controlled trials to assess the independent effect of the ABC in quality improvement projects are under way. We have developed a methodology objectively and reproducibly to derive a level of excellent, attainable performance, based on measured performance by a group of providers. The ABC can be applied to groups of providers in communities, to institutions and departments within them, or to individual practitioners.

Bayes Theorem↗

Measurement of mammography rates for quality improvement.

To determine the best source of high-quality data related to mammography rates, a study was undertaken to compare chart audit and claims data from the Health Care Financing Administration's Ambulatory Quality Improvement Project. Because claims data captured a higher percentage of mammograms than chart audit data in this study, quality improvement projects should consider utilizing claims data only to ascertain mammography rates.

Aged↗

The art and science of searching MEDLINE to answer clinical questions. Finding the right number of articles.

The current medical environment makes information retrieval a matter of practical importance for clinicians. Many avenues present themselves to the clinician, but here we focus on MEDLINE by summarizing the current state of the art and providing an innovative approach for skill enhancement. Because new search engines appear rapidly, we focus on generic principles that can be easily adapted to various systems, even those not yet available. We propose an idealized classification system for the results of a MEDLINE search. Type A searches produce a few articles of high quality that are directly focused on the immediate question. Type B searches yield a large number of articles, some more relevant than others. Type C searches produce few or no articles, and those that are located are not germane. Providing that relevant, high-quality articles do exist, type B and C searches may often be improved with attention to search technique. Problems stem from poor recall and poor precision. The most daunting task lies in achieving the balance between too few and too many articles. By providing a theoretical framework and several practical examples, we prepare the searcher to overcome the following barriers: a) failure to begin with a well-built question; b) failure to use the Medical Subject Headings; c) failure to leverage the relationship between recall and precision; and d) failure to apply proper limits to the search. Thought and practice will increase the utility and enjoyment of searching MEDLINE.

Clinical Medicine↗

Identifying achievable benchmarks of care: concepts and methodology.

Webster's Dictionary defines a benchmark as 'something that serves as a standard by which others can be measured'. Benchmarking pervades the health care quality improvement literature, and benchmarks are usually based on subjective assessment rather than on measurements derived from data. As such, benchmarks may fail to yield an achievable level of excellence that can be replicated under specific conditions. In this paper, we provide an overview of benchmarking in health care. We then describe the evolution of our data-driven method for identifying an Achievable Benchmark of Care (ABC) on the basis of process-of-care indicators. Here, our experience leads us to postulate the following premises for sound benchmarks: (i) benchmarks should represent a level of excellence; (ii) benchmarks should be demonstrably attainable; (iii) providers with high performance should be selected from among all providers in a predefined way using reliable data; (iv) all providers with high performance levels should contribute to the benchmark level; and (v) providers with high performance levels but small numbers of cases should not unduly influence the level of the benchmark. An example of an ABC applied to the cooperative cardiovascular project leads the reader through the computation of an ABC. Finally, we consider several refinements of the original ABC concept that are in progress, e.g. how to approach the special problems posed by very small denominators. The ABC methodology has been well accepted in multiple quality improvement projects. This approach lends objectivity and reliability to benchmarks that have been a widely used, but until now, arbitrarily defined tool.

Alabama↗

Racial differences in the medical treatment of elderly Medicare patients with acute myocardial infarction.

OBJECTIVE: To compare the use of medications in African-American and Caucasian elderly Medicare patients hospitalized with acute myocardial infarction (AMI) in Alabama. DESIGN: Retrospective medical record review. SETTING: All acute care hospitals in Alabama. PATIENTS: All Medicare patients with a principal discharge diagnosis of AMI from June 1992 through February 1993. We excluded those patients less than 65 years of age and those of ethnicity other than African-American or Caucasian (N = 4,052). MEASUREMENTS: We first performed a crude analysis using all cases to compare by race the use of thrombolysis, beta-adrenergic blockade, and aspirin in the setting of AMI. In addition, we developed a multivariable model with receipt of therapy as the outcome and demographics, severity of illness, comorbidity, and algorithm-determined candidacy for therapy as covariates. The algorithms, developed as part of the Cooperative Cardiovascular Project, were designed to identify an "ideal" pool of candidates for each therapy. MAIN RESULTS: For all cases, 9.2% (95% confidence interval [CI] 6.8, 12.1) of African Americans received thrombolysis compared with 17.3% (95% CI 16.0, 18.6) of Caucasians. Approximately 16.4% of patients received beta-adrenergic blockade, and 45.1% received aspirin, both with no racial difference. By multivariate analysis, the adjusted odds ratio for African Americans receiving thrombolysis was 0.55 (95% CI 0.41, 0.76). The corresponding odds ratio was 1.25 (95% CI 0.99, 1.59) for beta-adrenergic blockade and 1.13 (95% CI 0.96, 1.37) for aspirin. African Americans presented later after the onset of chest pain, but the refusal rate of thrombolytic therapy did not differ. CONCLUSIONS: According to this analysis, Alabama physicians used beta-adrenergic blockade and aspirin equivalently in African Americans and Caucasians. African Americans received thrombolysis less often according to the crude analysis. The multivariable analysis suggests less use of thrombolytics, even after adjusting for several covariates including indication by clinical algorithm. However, the small number of African-American patients deemed ideal candidates for thrombolysis attenuates the precision of this finding.

Adrenergic beta-Antagonists↗

The association of physician attitudes about uncertainty and risk taking with resource use in a Medicare HMO.

PURPOSE: To explore the association between the attitudes of primary care physicians toward uncertainty and risk taking, as measured by a validated survey, with resource use in a Medicare HMO. DESIGN: All primary-care internists (n=20) in a large, multi-specialty clinic were surveyed to measure their attitudes about uncertainty and risk taking using three previously developed scales. Results were linked with administrative data for 792 consecutive patients in a recently created Medicare HMO. The patients' index visits occurred between April 1, 1995, and November 30, 1995. ANALYSIS: Charges stemming from several claim types (primary care and subspecialty physician, laboratory, radiology, and ambulatory procedures) in the 30 days following the index visit were summed. The physician scales were dichotomized at the median to seek unadjusted associations with charges. Generalized estimation equations were used to account for the correlation of charges resulting from patients' being nested within physicians and adjusted for physician characteristics (age, sex, years in practice) and patient characteristics (age, sex, comorbidity). MAIN RESULTS: The physician response rate was 90%. Most physicians (90%) were male. The mean age of the patients was 74 years, and 69% were female. The mean cost (+/-SD) per patient was $621.61+/-1,737.31. From the unadjusted analysis, high "anxiety due to uncertainty" was associated with higher patient charges ($197.85 vs $158.21, p=0.01). From the multivariable analysis, each standard deviation increase in "anxiety due to uncertainty" (3.5 points) corresponded to a 17% increase in mean charges (p < 0.01) and each similar increase in "reluctance to disclose uncertainty to patients" (1.92 points) corresponded to a 12% increase (p=0.03). However, increasing "reluctance to disclose mistakes to physicians" and increasing physician risk-taking propensity were associated with decreased total charges [-10% per standard deviation (1.34 points), p=0.02, and -8% per standard deviation (3.26 points), p=0.02, respectively]. CONCLUSION: Physician attitudes toward uncertainty were significantly associated with patient charges. Further investigation may improve prediction of patient-care charges, offer insight into the medical decision-making process, and perhaps clarify the relationship between cost, uncertainty, and quality of care.

Aged↗