Biomedical subjects

Anne Baroffio

Publications and source records attributed to Anne Baroffio.

3 recordsLinked to original sources

PubMed2006

Tutor training, evaluation criteria and teaching environment influence students' ratings of tutor feedback in problem-based learning.

AIM: In a problem-based learning (PBL) curriculum, tutor's feedback skills are important. However, evaluation studies often show that students rate many tutors as ineffective in providing feedback. We explored whether this is related: (a) to tutors' skills, and hence a teaching intervention might improve their performance; (b) to the formulation of the evaluation item, hence a more specific wording might help students better recognize a feedback when received; (c) to PBL teaching environment, and hence the tutors' teaching unit might influence students' ratings. METHODS: Students rated 126 tutors of 13 one-month teaching units over three consecutive years on their ability of providing feedback. We assessed how (a) a teaching intervention given between years 1 and 2, (b) a rewording of the evaluation item which took place in year 3, and (c) the tutors' teaching unit, influenced students' ratings. RESULTS: The ratings of tutors considered as effective by students at year 1 improved after the teaching intervention, while those of unsatisfactory tutors did not progress. However the ratings of the latter increased after reformulation of the evaluation item. This increase varied across teaching units. DISCUSSION: Students' ratings of tutors' ability to give feedback seem to vary in function of the tutors' training, of the formulation of the evaluation item, and of the tutors' teaching environment. These variables should be considered for setting up effective strategies in faculty development.

Analysis of Variance↗

PubMed2006

Effect of teaching context and tutor workshop on tutorial skills.

Effective faculty development workshops are essential to develop and sustain the quality of faculty's teaching. In an integrated problem-based curriculum, tutors expressed the needs to further develop their skills in facilitating students' content learning and small-group functioning. Based on the authors' prior observations that tutors' performance depends on their teaching context, a workshop was designed not only tailored to the tutors' needs but also organized within their respective teaching unit. The purposes of this study are (1) to evaluate whether this workshop is effective and improves tutors' teaching skills, and (2) to assess whether workshop effectiveness depends on tutors' performance before the workshop and on their teaching unit environment. Workshop effectiveness was assessed using (a) tutors' perception of workshop usefulness and of their improvement in tutorial skills, and (b) students' ratings of tutor performance before and after the workshop. In addition, an analysis of variance model was designed to analyse how tutors' performance before the workshop and their teaching unit influence workshop effectiveness. Tutors judged the workshop as helpful in providing them with new teaching strategies and reported having improved their tutorial skills. Workshop attendance enhanced students' ratings of tutors' knowledge of problem content and ability to guide their learning. This improvement was also long-lasting. The workshop effect on tutor performance was relative: it varied across teaching units and was higher for tutors with low scores before the workshop. A workshop tailored to tutors' needs and adapted to their teaching unit improves their tutorial skills. Its effectiveness is, however, influenced by tutors' level of performance before the workshop and by the environment of their teaching unit. Thus, to be efficient, the design of a workshop should consider not only individual tutors' needs, but also the background of their teaching units, with special attention to their internal organization and tutor group functioning.

Analysis of Variance↗

PubMed2005

Effects of item and rater characteristics on checklist recording: what should we look for?

OBJECTIVE: Examinations based on using standardised patients (SPs) commonly use checklist recordings to evaluate students' clinical performance. This paper examines whether and to what extent item and rater characteristics affect the reliability of history checklist recording in an SP-based assessment. METHODS: Checklist items were reviewed for the presence or absence of 5 item characteristics and a 2-point versus 3-point scoring scale. Agreement between checklist recordings obtained from SPs and clinician-examiners (CEs) were compared by item characteristics, scoring scale and CEs' level of involvement in the assessment. RESULTS: Based on 3179 pairs of recordings, the overall percentage of agreement between SPs and CEs was 83% (kappa = 0.64). Agreement was significantly higher for items scored on a 2-point than on a 3-point scale, and when the CE was also the author and the trainer of the station. After controlling for other factors, item characteristics were only marginally associated with level of interrater agreement. CONCLUSIONS: This study suggests that attention should be paid to specific aspects of checklist development and checklist recording training when an SP or CE is used as recorder.

Clinical Competence↗