PubMed HealthSearch

Biomedical subjects

R C Fraser

Publications and source records attributed to R C Fraser.

At least 19 recordsLinked to original sources

Is ownership more important than the scientific credibility of audit protocols? A survey of medical audit advisory groups.

BACKGROUND: It is commonly accepted that ownership is an important factor in determining the acceptability and use of protocols or guidelines. OBJECTIVES: We aimed to determine whether Medical Audit Advisory Groups (MAAGs) are prepared to accept and use audit protocols developed systematically by an external agency. METHOD: A postal questionnaire was sent to all 105 MAAG chairmen in England and Wales to seek their views on the external development of protocols, the inclusion of evidence-based prioritized criteria, the general design of the protocols issued by the Lilly Audit Centre and the numbers of practices reported by MAAGs as making use of at least one of the first four protocols issued. RESULTS: Ninety-five MAAGs (90%) responded. Of these, 86% were in favour of the external development of protocols, and 98% and 94%, respectively, found evidence-based and prioritized criteria valuable; 98% felt the overall design and content of the Audit Centre protocols were excellent or good. A total of 1018 practices was known to have made use of one of these protocols, 261 taking part in multi-practice audits organized by their MAAGs. CONCLUSION: Ownership is not necessarily more important than scientific credibility and/or perceived utility. Externally developed audit protocols containing evidence-based, prioritized review criteria are acceptable to MAAGs, which are prepared to recommend their use in practice. Accordingly, such systematically developed protocols offer a promising and practical method for improving clinical effectiveness. Further research is needed, however, to determine the comparative impact on standards of care of protocols and other methods such as clinical guidelines.

Attitude of Health Personnel

Effective audit in general practice: a method for systematically developing audit protocols containing evidence-based review criteria.

Though many general practitioners (GPs) now take part in audit, there is still concern about the extent to which participation in audit leads to improvements in practice. Improved methods are needed for the incorporation of research evidence into criteria for use in audit. In this paper, a six-stage systematic method is described for developing audit protocols containing prioritized evidence-based criteria. The stages are: selection of a topic, identification of key elements of care, focused literature reviews, prioritization of the criteria on the strength of the evidence and impact on outcome, preparation of full documentation, and peer review.

Clinical Protocols

Development of review criteria: linking guidelines and assessment of quality.

Review criteria are designed to enable clinicians and others to assess care. However, there is no established method for developing criteria, and they are often confused with guidelines. Criteria should comprise measurable activities that are appropriate for the setting in which they are to be used. They should also be based on research evidence and prioritised according to the strength of that evidence and effect on outcome. Good criteria can be used to aid implementation of guidelines by providing a standard against which to monitor performance and enabling clinical audit.

Decision Making

Use of vitamin B-12 in Leicestershire practices: a single topic audit led by a medical audit advisory group.

OBJECTIVE: To encourage active participation of Leicestershire general practitioners and their staff in audit; to examine the use of vitamin B-12 injections and to achieve a more appropriate use. DESIGN: Implementation of an agreed audit protocol, with central analysis and feedback of anonymous and aggregated data by a medical audit advisory group. SETTING: All 147 Leicestershire practices. MAIN OUTCOME MEASURES: Participation in the complete audit cycle, comparison of actual use of vitamin B-12 injections with agreed criteria of use, and assessment of improvement in use. RESULTS: 264 general practitioners (55% of all doctors from 49% of all Leicestershire practices) completed both phases of the audit cycle, and 321 (67%) completed phase 1 only. Twenty four (16%) practices failed to participate from the outset, and a further 58 (35%) dropped out at various stages. Only 10 of the 37 singlehanded practices completed the audit, although 34 initially agreed to participate. If singlehanded practices were excluded, 56% (61) of practices completed both phases of the audit cycle. In total 1714 patients received B-12 injections. Appropriate use increased from 62% in phase 1 to 72% in phase 2 of the audit; there was a 32% reduction in the number of patients inappropriately receiving B-12 (521 to 352), and the proportion of patients receiving B-12 at the correct frequency rose from 58% to 72%. The proportion of patients in whom all the diagnostic criteria for pernicious anaemia were established before treatment with B-12 was 27% in phase 1 and 28% in phase 2. CONCLUSION: Our study suggests that single topic audits organised by a medical audit advisory group can encourage large numbers of general practitioners to participate and can bring about changes in behaviour resulting in improvements in standards of care. Nevertheless, advisory groups will need to devise strategies to encourage even higher levels of involvement, most particularly from singlehanded practices.

Anemia, Pernicious

Consultation competence in general practice: testing the reliability of the Leicester assessment package.

BACKGROUND: An acceptable assessment must be both valid and reliable; the face validity of the Leicester assessment package has already been established. AIM: This study set out to test the reliability of the Leicester assessment package, and the factors influencing it, when used by multiple assessors to assess performance in general practice consultations. METHOD: Six randomly selected course organizer assessors simultaneously used the package to conduct independent assessments of the performance of five doctors of widely varying abilities in consultation with six simulated patients. The scores allocated were subjected to generalizability analysis. RESULTS: The mean scores allocated for consultation performance of individual doctors ranged from 51% to 70%, with the lower scores being allocated to the less experienced doctors. Scores of each assessor across the cases were examined for internal consistency and five of the six assessors consistently scored the doctors with an alpha coefficient of the minimum accepted level of 0.80 or greater. The other assessor had a consistency of only 0.22. Measurements of consistency within cases between markers indicated that the first case produced unreliable results (alpha coefficient 0.25) but all other cases were scored consistently. Two independent assessors scoring eight consultations are the requisite numbers to achieve acceptable levels of reliability in a formal assessment process; seven consultations produce the minimum acceptable generalizability coefficient of 0.80 plus the first 'non-counting' consultation. CONCLUSION: Required levels of reliability can be achieved when the package is used by multiple markers assessing the same consultations over a wide range of consultation performance. To achieve reliability only two hours of assessment time are required using the Leicester package compared with the previously regarded minimum of 32 hours. Although assessors can produce reliable scores with minimal training, intra-assessor reliability cannot be taken for granted and all assessors should be trained and calibrated before being sanctioned to conduct assessments, particularly for regulatory purposes. The Leicester assessment package has now been shown to be valid, reliable, feasible and easy to use in practice. It can, therefore, be recommended for use in both formative and summative assessment of consultation competence in general practice.

Communication

Consultation competence in general practice: establishing the face validity of prioritized criteria in the Leicester assessment package.

AIM: This study set out to test the face validity of prioritized criteria of consultation competence in general practice as contained in the Leicester assessment package. METHOD: A questionnaire was sent to a geographically stratified random sample of 100 members of the United Kingdom Association of Course Organisers to seek their views on the categories, components and weightings contained in the Leicester assessment package and to determine the proportion of respondents who rejected or suggested a new category, component or weighting or reallocated components to other categories or amended weightings. Their views were sought on a six-point scale (strongly approve, approve, tend to approve, tend to disapprove, disapprove and strongly disapprove). RESULTS: There was a 73% response rate. Of the respondents 99% either strongly approved or approved of the overall set of categories of consultation competence. Only two respondents (3%) expressed any disapproval of individual categories. Thirty five of the 39 suggested components of consultation competence were supported by more than 80% of respondents. There was minimal support for excluding any categories or components of consultation competence, for moving any components to different categories or for the inclusion of new categories or components. Eighty eight per cent of respondents were in favour of the need to identify priorities between any agreed categories of consultation competence and 79% expressed approval of the suggested weightings. Although 42% of respondents indicated a wish for some alteration in weightings, the mean values for all consultation categories suggested by all respondents were almost identical to the original weightings in the Leicester package. CONCLUSION: The face validity of the categories and components of consultation competence contained in the Leicester assessment package has been established, and the suggested weightings of consultation categories have been validated. Consequently, the criteria contained in the Leicester package can be adopted with confidence as measures against which performance can be judged in formative or summative assessment of consultation performance in general practice.

Clinical Competence

Sequestration of the left coronary artery from the aorta.

A patient with the left coronary artery isolated from the ascending aorta is discussed. This is the seventh case described and the third diagnosed preoperatively. In contrast to other patients she had predominant aortic incompetence and was much older (52 years compared with the other patients, all younger than 25 years). She also had two angiograms demonstrating progressive isolation of the coronary artery with time. The patient was managed by aortic valve replacement. It is our belief that the condition is acquired and resulted from fusion of the free edge of the aortic valve leaflet to the supravalvar ridge secondary to an inflammatory process.

Aorta

High risk of coeliac disease in Punjabis. Epidemiological study in the south Asian and European populations of Leicestershire.

The purpose of this study was to measure the incidence of coeliac disease in different ethnic communities and investigate the hypothesis that the incidence is decreasing in most European countries and the role incomplete retrieval of data may play. In a retrospective study of histologically confirmed cases of coeliac disease between 1975 and 1989 in the City of Leicester, 106 patients with coeliac disease were identified. Of these 86 were European and 20 Asian. The overall incidence of coeliac disease in Europeans was 2.5/10(5)/year (95% CI 2-3.2), in Gujaratis 0.9/10(5)/year (95% CI 0.4-1.8), and in Punjabis 6.9 (95% CI 3.2-12.3). These differences were independent of religious belief. The relative risk to Punjabis compared with Europeans is 2.9 (95% CI 1.5-5.3; chi 2 = 12.5, p < 0.01) and to Gujaratis 8.1 (95% CI 3-22.4; chi 2 = 25; p < 0.001). Gujaratis were at 0.4 risk of Europeans (90% CI 0.2-0.8; chi 2 = 6.7; p < 0.01). The incidence in the urban populations of Leicester was 6/10(5)/year (95% CI 1.3-1.9) which was significantly lower than the 3.2/10(5)/year (95% CI 2.7-3.8; chi 2 = 5.6; p < 0.001) in surrounding rural areas. This study shows that the incidence of coeliac disease in Punjabis (Sikhs, Hindus and Muslims) is 8 times higher than in Gujaratis (Hindus and Muslims) and 4 times higher than in Europeans in Leicester.

Adult

Teaching and assessment in the consultation. A workshop for general practice clinical teachers.

A faculty development programme for general practice clinical teachers offered a skills development workshop which specifically addressed the skills needed when teaching and assessing students consulting with patients. The course was sequential, that is, a group moved on to a new skill only when its members could demonstrate mastery of a lower-order skill. Participants practised skills and received feedback on their performance from peers and learners (students and trainees). Participants comments about the course were highly favourable and the majority foresaw a general improvement in their own personal consultation skills as a result. They recognized that the use of a valid and reliable set of criteria (the Leicester Assessment Package) was essential in order to make correct judgements about consultation performance before instituting remedial teaching.

Educational Measurement

Prognostic value of peritoneal cytology in endometrial carcinoma.

To determine whether positive peritoneal cytology is an independent poor prognostic factor in patients with endometrial carcinoma the records of 381 patients were reviewed. Positive peritoneal cytology was found in 24 of 381 (6.3%) patients. In clinical stage I disease, 16 of 322 (5.0%) patients had positive peritoneal cytology. Patients with positive cytology were more likely to have higher-grade tumors and extrauterine disease at the time of surgery (45% vs 2.3%) than were patients with negative cytology. Five-year survival was significantly less for patients with positive cytology than negative (50% vs 81.2%). For patients with surgical stage I disease (no extrauterine spread at surgery) there was no significant difference in 5-year survival between groups with positive and negative cytology (80% vs 86.3%). The majority (70.8%) of patients with endometrial cancer and positive peritoneal cytology have extrauterine disease at the time of surgery. Although overall 5-year survival is less for patients with positive cytology, when other risk factors are controlled for, there is no difference in survival for patients with no demonstrable extrauterine disease despite positive cytology. We conclude that positive peritoneal cytology is not an independent prognostic indicator for patients with endometrial cancer.

Adenocarcinoma

Teaching the teachers at Leicester: the general practice approach.

This article describes a systematic induction programme devised for newly appointed lecturers in general practice. The programme aims to help them develop skills in both teaching and assessment and to encourage self-appraisal. The progress of participants is monitored by direct observation and video-recording with the regular provision of feedback a prominent characteristic. All the lecturers have found participation in the programme an effective way of developing their teaching capabilities.

Education, Medical