PubMed Health⌕ Search

Biomedical subjects

Andrew D Oxman

Publications and source records attributed to Andrew D Oxman.

At least 19 recordsLinked to original sources

Systems for grading the quality of evidence and the strength of recommendations II: pilot study of a new system.

BACKGROUND: Systems that are used by different organisations to grade the quality of evidence and the strength of recommendations vary. They have different strengths and weaknesses. The GRADE Working Group has developed an approach that addresses key shortcomings in these systems. The aim of this study was to pilot test and further develop the GRADE approach to grading evidence and recommendations. METHODS: A GRADE evidence profile consists of two tables: a quality assessment and a summary of findings. Twelve evidence profiles were used in this pilot study. Each evidence profile was made based on information available in a systematic review. Seventeen people were given instructions and independently graded the level of evidence and strength of recommendation for each of the 12 evidence profiles. For each example judgements were collected, summarised and discussed in the group with the aim of improving the proposed grading system. Kappas were calculated as a measure of chance-corrected agreement for the quality of evidence for each outcome for each of the twelve evidence profiles. The seventeen judges were also asked about the ease of understanding and the sensibility of the approach. All of the judgements were recorded and disagreements discussed. RESULTS: There was a varied amount of agreement on the quality of evidence for the outcomes relating to each of the twelve questions (kappa coefficients for agreement beyond chance ranged from 0 to 0.82). However, there was fair agreement about the relative importance of each outcome. There was poor agreement about the balance of benefits and harms and recommendations. Most of the disagreements were easily resolved through discussion. In general we found the GRADE approach to be clear, understandable and sensible. Some modifications were made in the approach and it was agreed that more information was needed in the evidence profiles. CONCLUSION: Judgements about evidence and recommendations are complex. Some subjectivity, especially regarding recommendations, is unavoidable. We believe our system for guiding these complex judgements appropriately balances the need for simplicity with the need for full and transparent consideration of all important issues.

Comprehension↗

Portals to Wonderland: health portals lead to confusing information about the effects of health care.

BACKGROUND: The Internet offers a seemingly endless amount of health information of varying quality. Health portals, which provide entry points to quality-controlled collections of websites, have been hailed as a solution to this problem. The objective of this study is to assess the extent to which government-run health portals provide access to relevant, valid and understandable information about the effects of health care. METHODS: We selected eight clinically relevant questions for which there was a systematic review, searched four portals for answers, and compared the answers we found to the results of the systematic reviews. RESULTS: Our searches resulted in 3400 hits, 155 of which mentioned both the condition and the intervention in one of the eight questions. Sixty-three of the 155 web pages did not give any information about the effect of the intervention. Seventy-seven qualitatively described the effects of the intervention. Twenty-six of these had information that was too unclear to be categorised; 15 were not consistent with the systematic review; and 36 were consistent with the review, but usually did not mention what happens without the intervention, what outcomes have been measured or when they were measured. Fifteen web pages quantitatively described effects. Four of these were abstracts from the systematic review, nine had information that was incomplete and potentially misleading because of a lack of information about people not receiving the intervention and the length of follow-up; one had information that was consistent with the review, but only referred to three trials whereas the review included six; and one was consistent with the review. CONCLUSION: Information accessible through health portals is unlikely to be based on systematic reviews and is often unclear, incomplete and misleading. Portals are only as good as the websites they lead to. Investments in national health portals are unlikely to benefit consumers without investments in the production and maintenance of relevant, valid and understandable information to which the portals lead.

Delivery of Health Care↗

International variation in prescribing antihypertensive drugs: its extent and possible explanations.

BACKGROUND: Inexpensive antihypertensive drugs are at least as effective and safe as more expensive drugs. Overuse of newer, more expensive antihypertensive drugs is a poor use of resources. The potential savings are substantial, but vary across countries, in large part due to differences in prescribing patterns. We wanted to describe prescribing patterns of antihypertensive drugs in ten countries and explore possible reasons for inter-country variation. METHODS: National prescribing profiles were determined based on information on sales and indications for prescribing. We sent a questionnaire to academics and drug regulatory agencies in Canada, France, Germany, UK, US and the Nordic countries, asking about explanations for differences in prescribing patterns in their country compared with the other countries. We also conducted telephone interviews with medical directors of drug companies in the UK and Norway, the countries with the largest differences in prescribing patterns. RESULTS: There is considerable variation in prescribing patterns. In the UK thiazides account for 25% of consumption, while the corresponding figure for Norway is 6%. In Norway alpha-blocking agents account for 8% of consumption, which is more than twice the percentage found in any of the other countries. Suggested factors to explain inter-country variation included reimbursement policies, traditions, opinion leaders with conflicts of interests, domestic pharmaceutical production, and clinical practice guidelines. The medical directors also suggested hypotheses that: Norwegian physicians are early adopters of new interventions while the British are more conservative; there are many clinical trials conducted in Norway involving many general practitioners; there is higher cost-awareness among physicians in the UK, in part due to fund holding; and there are publicly funded pharmaceutical advisors in the UK. CONCLUSION: Two compelling explanations the variation in prescribing that warrant further investigation are the promotion of less-expensive drugs by pharmaceutical advisors in UK and the promotion of more expensive drugs through "seeding trials" in Norway.

Antihypertensive Agents↗

Systems for grading the quality of evidence and the strength of recommendations I: critical appraisal of existing approaches The GRADE Working Group.

BACKGROUND: A number of approaches have been used to grade levels of evidence and the strength of recommendations. The use of many different approaches detracts from one of the main reasons for having explicit approaches: to concisely characterise and communicate this information so that it can easily be understood and thereby help people make well-informed decisions. Our objective was to critically appraise six prominent systems for grading levels of evidence and the strength of recommendations as a basis for agreeing on characteristics of a common, sensible approach to grading levels of evidence and the strength of recommendations. METHODS: Six prominent systems for grading levels of evidence and strength of recommendations were selected and someone familiar with each system prepared a description of each of these. Twelve assessors independently evaluated each system based on twelve criteria to assess the sensibility of the different approaches. Systems used by 51 organisations were compared with these six approaches. RESULTS: There was poor agreement about the sensibility of the six systems. Only one of the systems was suitable for all four types of questions we considered (effectiveness, harm, diagnosis and prognosis). None of the systems was considered usable for all of the target groups we considered (professionals, patients and policy makers). The raters found low reproducibility of judgements made using all six systems. Systems used by 51 organisations that sponsor clinical practice guidelines included a number of minor variations of the six systems that we critically appraised. CONCLUSIONS: All of the currently used approaches to grading levels of evidence and the strength of recommendations have important shortcomings.

Advisory Committees↗

Improving prescribing of antihypertensive and cholesterol-lowering drugs: a method for identifying and addressing barriers to change.

BACKGROUND: We describe a simple approach we used to identify barriers and tailor an intervention to improve pharmacological management of hypertension and hypercholesterolaemia. We also report the results of a post hoc exercise and survey we carried out to evaluate our approach for identifying barriers and tailoring interventions. METHODS: We used structured reflection, searched for other relevant trials, surveyed general practitioners and talked with physicians during pilot testing of the intervention. The post hoc exercise was carried out as focus groups of international researchers in the field of quality improvement in health care. The post hoc survey was done by telephone interviews with physicians allocated to the experimental group of a randomised trial of our multifaceted intervention. RESULTS: A wide range of barriers was identified and several interventions were suggested through structured reflection. The survey led to some adjustments. Studying other trials and pilot testing did not lead to changes in the design of the intervention. Neither the post hoc focus groups nor the post hoc survey revealed important barriers or interventions that we had not considered or included in our tailored intervention. CONCLUSIONS: A simple approach to identifying barriers to change appears to have been adequate and efficient. However, we do not know for certain what we would have gained by using more comprehensive methods and we do not know whether the resulting intervention would have been more effective if we had used other methods. The effectiveness of our multifaceted intervention is under evaluation in a randomised controlled trial.

Anticholesteremic Agents↗

Grading quality of evidence and strength of recommendations.

Users of clinical practice guidelines and other recommendations need to know how much confidence they can place in the recommendations. Systematic and explicit methods of making judgments can reduce errors and improve communication. We have developed a system for grading the quality of evidence and the strength of recommendations that can be applied across a wide range of interventions and contexts. In this article we present a summary of our approach from the perspective of a guideline user. Judgments about the strength of a recommendation require consideration of the balance between benefits and harms, the quality of the evidence, translation of the evidence into specific circumstances, and the certainty of the baseline risk. It is also important to consider costs (resource utilisation) before making a recommendation. Inconsistencies among systems for grading the quality of evidence and the strength of recommendations reduce their potential to facilitate critical appraisal and improve communication of these judgments. Our system for guiding these complex judgments balances the need for simplicity with the need for full and transparent consideration of all important issues.

Cost-Benefit Analysis↗

You cannot make informed choices without information.

Informed choices require information that is relevant, valid and accessible. Systematic reviews of the effects of alternative strategies provide information that is essential but not sufficient for recommendations about how best to manage mild brain injury or other problems. Work such as that of the Task Force on Mild Traumatic Brain Injury make decisions easier and better informed. To achieve better outcomes the information derived from systematic reviews needs to be applied critically and well-informed, context specific recommendations must be effectively implemented.

Choice Behavior↗

Letters, numbers, symbols and words: how to communicate grades of evidence and recommendations.

The GRADE Working Group is developing and evaluating a common, sensible approach to grading quality of evidence and strength of recommendations in health care. In this article, we discuss the advantages and disadvantages of using letters, numbers, symbols or words to represent grades of evidence and recommendations. Using multiple strategies, we searched for comparative studies of alternative ways of representing ordered categories in any context. In addition, we contacted experts and reviewed theoretical work and qualitative research on how best to communicate grades of any kind quickly and clearly. We were unable to identify health care research that addressed, either directly or indirectly, the best way to present grades of evidence and recommendations. We found examples of symbols used by government, commercial and consumer organizations to communicate quality of evidence or strength of recommendations, but no comparative studies. Although a number of grading systems are used in health care and other fields, there is little or no evidence of how well various presentations are understood. Before promoting the use of specific symbols, numbers, letters or words, the extent to which the intended message is comprehended should be evaluated.

Communication↗

The potential savings of using thiazides as the first choice antihypertensive drug: cost-minimisation analysis.

BACKGROUND: All clinical practice guidelines recommend thiazides as a first-choice drug for the management of uncomplicated hypertension. Thiazides are also the lowest priced antihypertensive drugs. Despite this, the use of thiazides is much lower than that of other drug-classes. We wanted to estimate the potential for savings if thiazides were used as the first choice drug for the management of uncomplicated hypertension. METHODS: For six countries (Canada, France, Germany, Norway, the UK and the US) we estimated the number of people that are being treated for hypertension, and the proportion of them that are suitable candidates for thiazide-therapy. By comparing this estimate with thiazide prescribing, we calculated the number of people that could switch from more expensive medication to thiazides. This enabled us to estimate the potential drug-cost savings. The analysis was based on findings from epidemiological studies and drug trials, and data on sales and prescribing provided by IMS for the year 2000. RESULTS: For Canada, France, Germany, Norway, the UK and the US the estimated potential annual savings were US13.8 million dollars, US37.4 million dollars, US72.2 million dollars, US10.7 million dollars, US119.7 million dollars and US433.6 million dollars, respectively.

Adult↗

Rational Prescribing in Primary Care (RaPP-trial). A randomised trial of a tailored intervention to improve prescribing of antihypertensive and cholesterol-lowering drugs in general practice [ISRCTN48751230].

BACKGROUND: The underlying reasons for differences between clinical practice and systematically developed guidelines vary from one clinical problem to another. It is therefore logical to tailor strategies to support the implementation of guidelines to address identified barriers to change. The objective of this trial is to evaluate the effects of a tailored intervention to support the implementation of systematically developed guidelines for the use of antihypertensive and cholesterol-lowering drugs for the primary prevention of cardiovascular disease. METHODS/DESIGN: Unblinded, cluster-randomised trial. 150 general practices will be recruited from two geographical areas in Norway, and randomised to the intervention or control group (passive dissemination of guidelines). Outcomes will be measured for all eligible patients seen in the participating practices during one year after the intervention. A multifaceted intervention has been tailored to address identified barriers to change. Key components are an educational outreach visit with audit and feedback, and computerised reminders. Pharmacists will conduct the visits. During the outreach visit the main recommendations will be presented and software will be installed that links to the electronic medical record systems used in the participating practices. The software will perform an audit that will be fed back during the visit, present pop-up reminders for patients with high blood pressure or cholesterol, and provide a cardiovascular risk calculator and patient education material. The main outcomes are the proportions of 1) first time prescriptions for hypertension where thiazides are not prescribed, 2) patients not assessed for cardiovascular risk before prescribing antihypertensive or cholesterol-lowering drugs, and 3) patients treated for hypertension or high cholesterol for three months or more who have not achieved recommended treatment goals.

Anticholesteremic Agents↗

Identifying barriers and tailoring interventions to improve the management of urinary tract infections and sore throat: a pragmatic study using qualitative methods.

BACKGROUND: Theories of behaviour change indicate that an analysis of factors that facilitate or impede change is helpful when trying to influence professional practice. The aim of this study was to identify barriers to implementing evidence-based guidelines for urinary tract infection and sore throat in general practice in Norway, and to tailor interventions to address these barriers. METHODS: We used a checklist to identify barriers and possible interventions to address these in an iterative process that included a review of the literature, brainstorming, focus groups, a pilot study, small group discussions and interviews. RESULTS: We identified at least one barrier for each category. Both guidelines recommended increased use of telephone consultations and reduced use of laboratory tests, and the barriers and the interventions were similar for the two guidelines. The complexity of changing routines involving patients, general practitioners and general practitioner assistants, loss of income with telephone consultations, fear of overlooking serious disease, perceived patient expectations and lack of knowledge about the evidence for the guidelines were the most prominent barriers. The interventions that were tailored to address these barriers included support for change processes in the practices, increasing the fee for telephone consultations, patient information leaflets and computer-based decision support and reminders. CONCLUSION: A systematic approach using qualitative methods helped identify barriers and generate ideas for tailoring interventions to support the implementation of guidelines for the management of urinary tract infections and sore throat. Lack of resources limited our ability to address all of the barriers adequately.

Adolescent↗

Medical messages in the media--barriers and solutions to improving medical journalism.

CONTEXT: Medical issues are widely reported in the mass media. These reports influence the general public, policy makers and health-care professionals. This information should be valid, but is often criticized for being speculative, inaccurate and misleading. An understanding of the obstacles medical reporters meet in their work can guide strategies for improving the informative value of medical journalism. OBJECTIVE: To investigate constraints on improving the informative value of medical reports in the mass media and elucidate possible strategies for addressing these. DESIGN: We reviewed the literature and organized focus groups, a survey of medical journalists in 37 countries, and semi-structured telephone interviews. RESULTS: We identified nine barriers to improving the informative value of medical journalism: lack of time, space and knowledge; competition for space and audience; difficulties with terminology; problems finding and using sources; problems with editors and commercialism. Lack of time, space and knowledge were the most common obstacles. The importance of different obstacles varied with the type of media and experience. Many health reporters feel that it is difficult to find independent experts willing to assist journalists, and also think that editors need more education in critical appraisal of medical news. Almost all of the respondents agreed that the informative value of their reporting is important. Nearly everyone wanted access to short, reliable and up-to-date background information on various topics available on the Internet. A majority (79%) was interested in participating in a trial to evaluate strategies to overcome identified constraints. CONCLUSIONS: Medical journalists agree that the validity of medical reporting in the mass media is important. A majority acknowledge many constraints. Mutual efforts of health-care professionals and journalists employing a variety of strategies will be needed to address these constraints.

Australia↗

Process evaluation of a cluster randomized trial of tailored interventions to implement guidelines in primary care--why is it so hard to change practice?

BACKGROUND: A cluster randomized trial of tailored interventions to support the implementation of guidelines for sore throat and urinary tract infection found little or no change in the main outcomes, which were antibiotic prescriptions, use of laboratory tests and use of telephone consultations. There was great variation between the practices in the change in these outcomes. OBJECTIVES: Our aim was to evaluate how the interventions were received and to understand why practices did or did not change. METHODS: The trial was conducted in general practices in Norway. Data for this process evaluation were collected from the 120 practices that completed the trial. Multiple methods were used: observations, semi-structured telephone interviews, a postal survey and data extracted from electronic medical records. We investigated factors that might explain a lack of change, including: agreement with the guidelines; communication within each practice; degree of participation in the project; taking time to discuss the guidelines and their implementation; use of the components of the interventions; and routines for telephone consultations. Possible explanatory factors were explored in relation to variation in change and the overall extent of change in rates of use of antibiotics, laboratory tests and telephone consultations. RESULTS: Sixty-three per cent of practices agreed with the guidelines. Only 35% reported having regular meetings, and 33% discussed the project before its start, although 75% reported agreement about participating within the practice. Only 33% reported meeting to discuss the guidelines. Use of the components of the interventions ranged from 11% for the increased fee for telephone consultations to 48% for the computerized decision support. Forty-four per cent reported problems with telephone routines. No single factor explained the observed variation in the extent of change across practices. CONCLUSIONS: Inadequate time, resources and support were the most salient factors that might explain a lack of change. Problems with internal communication and telephone routines were important contributing factors in many practices.

Cluster Analysis↗