PubMed Health⌕ Search

Biomedical subjects

J M Grimshaw

Publications and source records attributed to J M Grimshaw.

At least 19 recordsLinked to original sources

Effects of mailed dissemination of the Royal College of Radiologists' guidelines on general practitioner referrals for radiography: a time series analysis.

AIM: To evaluate the effect of postal dissemination of the third edition of the Royal College of Radiologists' (RCR) guidelines on general practitioner referrals for radiography. MATERIALS AND METHODS: An interrupted time series using monthly data for 34 months before and 14 months after dissemination of the guidelines was employed. Data were abstracted for the period April 1994 to March 1998 from the computerized administrative systems of open access radiological services provided by two teaching hospitals in one region of Scotland. The time series results are contrasted with those obtained by using a simple before and after design. RESULTS: A total of 117 747 imaging requests from general practice were received in the two departments. There were no significant effects of disseminating the guidelines on the total number of requests, or on requests for individual examinations. If a simple before and after study had been used, then we would have erroneously concluded that significant changes had occurred in referral practice for 11 of the 18 procedures concerned. CONCLUSION: Mailing of copies of the RCR guidelines had a small effect on general practitioners' use of X-ray investigations of uncertain clinical significance. Additional dissemination and implementation strategies appear necessary to promote the use of guidelines.

Family Practice↗

Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated?

CONTEXT: Practice guidelines need to be up-to-date to be useful to clinicians. No published methods are available for assessing whether existing practice guidelines are still valid, nor does any empirical information exist regarding how often such assessments need to be made. OBJECTIVES: To assess the current validity of 17 clinical practice guidelines published by the US Agency for Healthcare Research and Quality (AHRQ) that are still in circulation, and to use this information to estimate how quickly guidelines become obsolete. DESIGN, SETTING, AND PARTICIPANTS: We developed criteria for defining when a guideline needs updating, mailed surveys to members of the original AHRQ guideline panels (n = 170; response rate, 71%), and searched the literature for evidence through March 2000 (n = 6994 titles yielding 173 articles plus 159 new guidelines on the same topics). MAIN OUTCOME MEASURES: Identification of new evidence calling for a major, minor, or no update of the 17 guidelines; survival analysis of the rate at which guidelines became outdated. RESULTS: For 7 guidelines, new evidence and expert judgment indicated that a major update is required; 6 were found to be in need of a minor update; 3 were judged as still valid; and for 1 guideline, we could reach no conclusion. Survival analysis indicated that about half the guidelines were outdated in 5.8 years (95% confidence interval [CI], 5.0-6.6 years). The point at which no more than 90% of the guidelines were still valid was 3.6 years (95% CI, 2.6-4.6 years). CONCLUSIONS: More than three quarters of the AHRQ guidelines need updating. As a general rule, guidelines should be reassessed for validity every 3 years.

Practice Guidelines as Topic↗

Cluster trials in implementation research: estimation of intracluster correlation coefficients and sample size.

The cluster randomized trial with a concurrent economic evaluation is considered the gold standard evaluative design for the conduct of implementation research evaluating different strategies to promote the transfer of research findings into clinical practice. This has implications for the planning of such studies, as information is needed on the effects of clustering on both effectiveness and efficiency outcomes. This paper describes the design considerations specific to implementation research studies, focusing particularly on the estimation of sample size requirements and on the need for reliable information on intracluster correlation coefficients for both effectiveness and efficiency outcomes.

Cluster Analysis↗

Oral versus intra-vaginal imidazole and triazole anti-fungal treatment of uncomplicated vulvovaginal candidiasis (thrush).

BACKGROUND: Anti-fungals are available for oral and intra-vaginal treatment of vulvovaginal candidiasis (thrush). OBJECTIVES: The primary objective of this review was to assess the relative effectiveness of oral versus intra-vaginal anti-fungals for the treatment of uncomplicated vulvovaginal candidiasis. The secondary objectives of the review were to assess the cost-effectiveness, safety and patient preference of oral versus intra-vaginal anti-fungals. SEARCH STRATEGY: The following sources were searched: The Cochrane Library (Issue 4, 1999), MEDLINE (January 1985 to May 2000), EMBASE (January 1980 to January 2000) and the Cochrane Collaboration Sexually Transmitted Disease Group Specialised Register of Controlled Trials. The reference lists of retrieved articles were reviewed manually. The manufacturers of anti-fungals available in the UK were contacted. SELECTION CRITERIA: ~Bullet~Randomised controlled trials published in any language. ~Bullet~Trials had to compare at least one oral anti-fungal with one intra-vaginal anti-fungal. ~Bullet~Women (aged 16 years or over) with uncomplicated vulvovaginal candidiasis. ~Bullet~The diagnosis of vulvovaginal candidiasis to be made mycologically (i.e. a positive culture and / or microscopy for yeast). ~Bullet~Trials were excluded if they solely involved subjects who were HIV positive, immunocompromised, pregnant, breastfeeding or diabetic. ~Bullet~The primary outcome measure was clinical cure. DATA COLLECTION AND ANALYSIS: Duplicate scrutiny was performed of the titles and abstracts of the electronic search results. Full article formats of all selected abstracts were retrieved and independently assessed by two reviewers. Independent duplicate abstraction was performed by four reviewers. Disagreements regarding trial inclusion or data abstraction were resolved by discussion between the reviewers. Odds ratios were pooled using the random effects model. Chi-squared tests with a p-value of less than 0.1 indicated heterogeneity in the results. MAIN RESULTS: Seventeen trials are included in the review, reporting 19 oral versus intra-vaginal anti-fungal comparisons. No statistically significant differences were shown between oral and intra-vaginal anti-fungal treatment for clinical cure at short term (OR 1.00 (95% CI, 0.72 to 1.40)) and long term (OR 1.03 (95% CI, 0.72 to 1.49)) follow-up. No statistically significant differences for mycological cure were observed between oral and intra-vaginal treatment at short term (OR 1.20(95% CI, 0.87 to 1.65)) or long term follow-up (OR 1.30 (95% CI, 0.99 to 1.71)). Two trials each reported one withdrawal from treatment due to an adverse reaction. Treatment preference data were poorly reported. REVIEWER'S CONCLUSIONS: No differences exist in terms of the relative effectiveness (measured as clinical and mycological cure) of anti-fungals administered by the oral and intra-vaginal routes for the treatment of uncomplicated vaginal candidiasis. No definitive conclusion can be made regarding the relative safety of oral and intra-vaginal anti-fungals for uncomplicated vaginal candidiasis. The oral route of administration is the preferred route for anti-fungals for the treatment of vulvovaginal candidiasis. The decision to prescribe or recommend the purchase of an anti-fungal for oral or intra-vaginal administration should take into consideration: safety, cost and treatment preference. Unless there is a previous history of adverse reaction to one route of administration or contraindications: if women are purchasing their own treatment, they should be given full information about the characteristics and costs of treatment to make their own decision. If health services are paying the treatment cost, decision-makers should consider whether the higher cost of oral anti-fungal administration is worth the gain in convenience, if this is the patient's preference.

Administration, Intravaginal↗

Getting evidence into practice: the work of the Cochrane Effective Practice and Organization of care Group (EPOC).

Policy makers and continuing educators often face difficult decisions about which educational and quality assurance interventions to provide. Where possible, such decisions are best informed by rigorous evidence, such as that provided by systematic reviews. The Cochrane Collaboration is an international organization that aims to help people make well-informed decisions about health care by preparing, maintaining, and ensuring the accessibility of systematic reviews of the benefits and risks of health care interventions. International collaborative review groups prepare Cochrane reviews for publication in The Cochrane Library, a collection of databases available on CD-ROM and the World Wide Web and updated quarterly. The Cochrane Effective Practice and Organization of Care Group (EPOC) aims to prepare and maintain systematic reviews of professional, financial, organizational, and regulatory interventions that are designed to improve professional practice and the delivery of effective health services. EPOC has 17 reviews and 20 protocols published in Issue 3, 2000, of the Cochrane Library, with further protocols in development. We also have undertaken an overview of previously published systematic reviews of professional behavior change strategies. Our specialized register contains details of over 1,800 studies that fall within the group's scope. Systematic reviews provide a valuable source of information for policy makers and educators involved in planning continuing education and quality assurance initiatives and organizational change. EPOC will attempt to keep the Journal of Continuing Education in the Health Professions informed on an ongoing basis about new systematic reviews that it produces in the area of continuing medical education and quality assurance.

CD-ROM↗

The prevalence of prophylaxis for deep vein thrombosis in acute hospital trusts.

OBJECTIVE: The effectiveness of activities to promote routine prophylaxis to prevent thromboembolism is difficult to assess because information about the prevalence of prophylaxis is sparse. The aim of this study was to assess the prevalence of deep vein thrombosis (DVT) prophylaxis for patients at risk in general medicine, general surgery, orthopaedics and gynaecology in Scotland and the North of England. DESIGN: Retrospective case note review of a random sample of episodes of care in a stratified random sample of directorates in Scotland and a convenience sample in England. SETTING: Twenty acute hospital directorates in Scotland and eight in the North of England. PARTICIPANTS: Case notes of patients at risk of thrombosis and discharged from the selected directorates in a 12-month period (n = 742). MAIN OUTCOME MEASURES: The proportion of patients receiving prophylaxis in each directorate. RESULTS: Overall, 469/526 (89%) of patients in Scotland and 199/216 (92%) in England received prophylaxis. The proportion varied from 71% in general medicine to 100% in orthopaedics. The frequency of use of different forms of prophylaxis varied between directorates. Approximately 60% of the patients who received prophylaxis received more than one form. CONCLUSIONS: Prophylaxis for DVT is well established for procedures and conditions that are known to increase the risk of thrombosis and for which there are no contraindications. Additional efforts to promote prophylaxis for these conditions are unlikely to be cost effective. Further research is needed to establish whether rates are equally high in other conditions, and whether the high prophylaxis rates are due to clinical effectiveness initiatives.

Anticoagulants↗

A systematic review of discharge coding accuracy.

BACKGROUND: The aim of the study was to review systematically the literature measuring the accuracy of routine UK hospital statistics that classify patients on discharge. METHODS: A systematic review was carried out of studies comparing routine discharge statistics about an episode of hospital care with the original medical record. Dual quality assessment and extraction was completed for included studies. Qualitative and descriptive analyses were undertaken. Additional comparisons of factors that could potentially introduce systematic variation in coding accuracy were also undertaken. RESULTS: Thirty studies were identified, of which 21 were included in the review. Twelve of these were conducted in England and Wales, and nine in Scotland. The majority assessed the accuracy of a single diagnosis, or selection of diagnoses in a limited range of hospital settings. The median coding accuracy rates were 91 per cent for diagnostic codes and 69.5 per cent for operation or procedure codes in studies in England or Wales; 82 per cent for diagnostic codes and 98 per cent for operation or procedure codes in Scottish studies. There were no significant differences in coding accuracy over time or in the type or rarity of the codes being assessed. Accuracy rates were higher for ICD7 codes (median 96.5 per cent) than for ICD8 (median 87 per cent) or ICD9 (median 77 per cent). CONCLUSIONS: Coding accuracy on average is high in the United Kingdom, especially for operations and procedures. However, policy-makers, planners and researchers need to recognize and account for the degree of inaccuracy in routine hospital information statistics. Further research is needed into methods of improving and maintaining coding accuracy.

Abstracting and Indexing↗

Changing provider behavior: an overview of systematic reviews of interventions.

BACKGROUND: Increasing recognition of the failure to translate research findings into practice has led to greater awareness of the importance of using active dissemination and implementation strategies. Although there is a growing body of research evidence about the effectiveness of different strategies, this is not easily accessible to policy makers and professionals. OBJECTIVES: To identify, appraise, and synthesize systematic reviews of professional educational or quality assurance interventions to improve quality of care. RESEARCH DESIGN: An overview was made of systematic reviews of professional behavior change interventions published between 1966 and 1998. RESULTS: Forty-one reviews were identified covering a wide range of interventions and behaviors. In general, passive approaches are generally ineffective and unlikely to result in behavior change. Most other interventions are effective under some circumstances; none are effective under all circumstances. Promising approaches include educational outreach (for prescribing) and reminders. Multifaceted interventions targeting different barriers to change are more likely to be effective than single interventions. CONCLUSIONS: Although the current evidence base is incomplete, it provides valuable insights into the likely effectiveness of different interventions. Future quality improvement or educational activities should be informed by the findings of systematic reviews of professional behavior change interventions.

Education, Medical, Continuing↗

Printed educational materials: effects on professional practice and health care outcomes.

BACKGROUND: It is often assumed that merely providing information in an accessible form will influence practice. Although such a strategy is still widely used in an attempt to change behaviour, there is a growing awareness that simply providing information may not lead to appropriate changes in the practice of health care professionals. OBJECTIVES: To assess the effects of printed educational materials in improving the behaviour of health care professionals and patient outcomes. SEARCH STRATEGY: We searched the Cochrane Effective Practice and Organisation of Care Group specialised register, reference lists of articles, and contacted content area experts. SELECTION CRITERIA: Randomised trials, interrupted time series analyses and non equivalent group designs with pre-post measures of interventions comparing 1. Printed educational materials versus a non-intervention control; and 2. Printed educational materials plus additional implementation strategies versus printed educational materials alone. The participants were any health care professionals provided with printed educational materials aimed at improving their practice and/or patient outcomes. DATA COLLECTION AND ANALYSIS: Two reviewers independently extracted data and assessed study quality. MAIN RESULTS: Eleven studies were included involving more than 1848 physicians. It proved impractical to examine the impact of interventions quantitatively because of poor reporting of results and inappropriate primary analyses. Nine studies examined comparison 1. Estimates of the benefit from printed educational materials ranged from -3% to 243.4% for provider outcomes, and from -16.1% to 175.6% for patient outcomes, although the practical importance of these changes is, at best, small. Six studies (seven comparisons) examined comparison 2. Benefits attributable to additional interventions ranged from -11.8% to 92.7% for professional behaviour, and -24.4% to 74.5% for patient outcomes. Two of the 14 estimates of professional behaviour, and two of the 11 estimates of patient outcomes were statistically significant. REVIEWER'S CONCLUSIONS: The effects of printed educational materials compared with no active intervention appear small and of uncertain clinical significance. These conclusions should be viewed as tentative due to the poor reporting of results and inappropriate primary analyses. The additional impact of more active interventions produced mixed results. Audit and feedback and conferences/workshops did not appear to produce substantial changes in practice; the effects in the evaluations of educational outreach visits and opinion leaders were larger and likely to be of practical importance. None of the studies included full economic analyses, and thus it is unclear to what extent the effects of any of the interventions may be worth the costs involved.

Education, Medical, Continuing↗

A recruitment strategy for cluster randomized trials in secondary care settings.

Trials of educational or organizational interventions to change clinical practice require cluster randomization, that is, randomization of units such as hospitals or clinical teams rather than individual patients. Cluster randomization is relatively novel in health care settings and raises new methodological challenges, in particular: are units willing to be randomized at an organizational level; and, what procedures should be followed to successfully enrol all of the clinicians in a unit rather than individual clinicians as in conventional multicentre trials. This is particularly problematic for trials of large units such as hospitals. The aim of this study was to develop and partially evaluate a strategy to recruit acute, secondary care NHS hospitals in the UK into cluster randomized trials. Literature search and interviews with senior staff in acute hospitals and relevant national organizations were used to develop a recruitment strategy. The strategy was evaluated by inviting 32 randomly selected clinical directorates to participate in a trial feasibility study. A seven step recruitment strategy was developed: (1) Identify stakeholders and gatekeepers; (2) Inform stakeholders and gatekeepers; (3) Approach gatekeepers; (4) Local negotiation; (5) Conduct the research; (6) Feedback to gatekeepers; (7) Feedback to stakeholders. Key problems were the possibility of multiple gatekeepers and identification of all possible stakeholders in varying organizational structures. The strategy was effective in two respects. First, 32 (100%) of the directorates approached agreed to participate. Second, baseline data collection was successfully achieved in all of the directorates. However, the strategy is costly in terms of time and resources. We conclude that NHS trusts are willing to participate in cluster randomized trials. This recruitment strategy is successful and could be widely adopted, but realistic time and financial cost estimates are required at the planning stage.

Evaluation Studies as Topic↗

Analysis of cluster randomized trials in primary care: a practical approach.

BACKGROUND: Cluster randomized trials increasingly are being used in health services research and in primary care, yet the majority of these trials do not account appropriately for the clustering in their analysis. OBJECTIVES: We review the main implications of adopting a cluster randomized design in primary care and highlight the practical application of appropriate analytical techniques. METHODS: The application of different analytical techniques is demonstrated through the use of empirical data from a primary care-based case study. CONCLUSION: Inappropriate analysis of cluster trials can lead to the presentation of inaccurate results and hence potentially misleading conclusions. We have demonstrated that adjustment for clustering can be applied to real-life data and we encourage more routine adoption of appropriate analytical techniques.

Cluster Analysis↗

Evaluation of clinical guidelines for the management of end-stage renal disease in europe: the EU BIOMED 1 study.

BACKGROUND: There are wide national and international variations in the management of patients with end-stage renal disease (ESRD). The aim of this study was to develop, harmonize, implement, and evaluate consensus-based clinical guidelines for the management of renal anaemia and renal bone disease in patients with ESRD, and for the prevention and management of cytomegalovirus disease in renal transplant recipients across six renal centres in Europe. METHODS: The trial was a prospective, multicentre, randomized balanced incomplete block design. Nephrologists from the six European renal units were randomized to develop and implement guidelines for two out of the three conditions and to act as a control for the third condition. Data were collected pre- (1 year) and post- (9 months) intervention on aspects of patient monitoring, management, and outcome. RESULTS: Eight hundred and twenty-nine dialysis patients from the six European dialysis centres were included in the study. Multivariate analysis (adjusting for case-mix and secular trends) showed a significant increase in the number of monitoring events in the guideline group compared with control group (6%, 95% CI, 1-11%). There was no concomitant increase in either appropriate management or the number of favourable patient outcomes. CONCLUSIONS: In the first European collaboration on renal guidelines, the introduction of the guidelines improved the monitoring of the patients, but did not improve patient management or outcome. This study suggests the potential for creating clinical guidelines with the aim of standardizing treatment protocols across international boundaries, and improving the quality of the medical care provided.

Adolescent↗

Comparison of analytical methods for cluster randomised trials: an example from a primary care setting.

BACKGROUND: Cluster randomisation is commonly used to evaluate educational and organisational interventions in primary care. We conducted a study where 66 general practices in the North East of Scotland were randomised to receive guidelines and access to a fast-track investigation service for two common urological conditions. Patients were identified from referral letters and recruited upon referral to secondary care. Although these urological conditions are common in secondary care, the number of referrals per general practice can be small; this created a number of issues for the analysis. METHODS: Three general approaches in the analysis of cluster randomised trials; the adjustment of standard tests; analysis at cluster level; and advanced statistical techniques (random effects models and generalised estimating equations) were applied to data from the above trial. The effect of the intervention on both a continuous and a dichotomous outcome was investigated. RESULTS: Spuriously low P values were obtained when conventional tests (which do not account for clustering in the data) were applied. Cluster level analysis of the dichotomous outcome with no account for cluster size resulted in a different conclusion compared with cluster level analysis with weighting, standard tests with adjustment and advanced statistical methods. DISCUSSION: Cluster randomised trials are becoming increasingly common in primary care. Where recruitment of individual patients is generated by referral from primary to secondary care it is likely that the trial will suffer from inherent weaknesses: not all clusters randomised contribute to the analysis; there is the likelihood of single size clusters and variable cluster sizes. Our analysis indicated that the different approaches produced consistent results across continuous outcomes, but for dichotomous outcomes in the cluster level analysis, failure to weight observations would have resulted in a different conclusion.

Cluster Analysis↗

Development and application of a generic methodology to assess the quality of clinical guidelines.

BACKGROUND: Despite clinical guidelines penetrating every aspect of clinical practice and health policy, doubts persist over their ability to improve patient care. We have designed and tested a generic critical appraisal instrument, that assesses whether developers have minimized the biases inherent in creating guidelines, and addressed the requirements for effective implementation. DESIGN: Thirty-seven items describing suggested predictors of guideline quality were grouped into three dimensions covering the rigour of development, clarity of presentation (including the context and content) and implementation issues. The ease of use, reliability and validity of the instrument was tested on a national sample of guidelines for the management of asthma, breast cancer, depression and coronary heart disease, with 120 appraisers. A numerical score was derived to allow comparison of guidelines within and between diseases. RESULTS: The instrument has acceptable reliability (Cronbach's alpha coefficient, 0.68-0.84; intra-class correlation coefficient, (0.82-0.90)). The results provided some evidence of validity (Pearson's correlation coefficient between appraisers' dimension scores and their global assessment was 0.49 for dimension one, 0.63 for dimension two and 0.40 for dimension three). The instrument could differentiate between national and local guidelines and was easy to apply. There was variation in the performance of guidelines with most not achieving a majority of criteria in each dimension. CONCLUSIONS: Use of this instrument should encourage developers to create guidelines that reflect relevant research evidence more accurately. Potential users or groups adapting guidelines for local use could apply the instrument to help decide which one to follow. The National Health Service Executive is using the instrument to assist in deciding which guidelines to recommend to the UK National Health Service. This methodology forms the basis of a common approach to assessing guideline quality in Europe.

Evaluation Studies as Topic↗