The developing physician--becoming a professional.
Explore the source record for details and available documents.
Education, Medical↗
Biomedical subjects
David T Stern
Publications and source records attributed to David T Stern.
Setting school-level outcome standards.
BACKGROUND: To establish international standards for medical schools, an appropriate panel of experts must decide on performance standards. A pilot test of such standards was set in the context of a multidimensional (multiple-choice question examination, objective structured clinical examination, faculty observation) examination at 8 leading schools in China. METHODS: A group of 16 medical education leaders from a broad array of countries met over a 3-day period. These individuals considered competency domains, examination items, and the percentage of students who could fall below a cut-off score if the school was still to be considered as meeting competencies. This 2-step process started with a discussion of the borderline school and the relative difficulty of a borderline school in achieving acceptable standards in a given competency domain. Committee members then estimated the percentage of students falling below the standard that is tolerable at a borderline school and were allowed to revise their ratings after viewing pilot data. RESULTS: Tolerable failure rates ranged from 10% to 26% across competency domains and examination types. As with other standard-setting exercises, standard deviations from initial to final estimates of the tolerable failure rates fell, but the cut-off scores did not change significantly. Final, but not initial cut-off scores were correlated with student failure rates (r = 0.59, P = 0.03). DISCUSSION: This paper describes a method to set school-level outcome standards at an international level based on prior established standard-setting methods. Further refinement of this process and validation using other examinations in other countries will be needed to achieve accurate international standards.
China↗
Are we making progress in medical education?
Explore the source record for details and available documents.
Clinical Competence↗
Disciplinary action by medical boards and prior behavior in medical school.
BACKGROUND: Evidence supporting professionalism as a critical measure of competence in medical education is limited. In this case-control study, we investigated the association of disciplinary action against practicing physicians with prior unprofessional behavior in medical school. We also examined the specific types of behavior that are most predictive of disciplinary action against practicing physicians with unprofessional behavior in medical school. METHODS: The study included 235 graduates of three medical schools who were disciplined by one of 40 state medical boards between 1990 and 2003 (case physicians). The 469 control physicians were matched with the case physicians according to medical school and graduation year. Predictor variables from medical school included the presence or absence of narratives describing unprofessional behavior, grades, standardized-test scores, and demographic characteristics. Narratives were assigned an overall rating for unprofessional behavior. Those that met the threshold for unprofessional behavior were further classified among eight types of behavior and assigned a severity rating (moderate to severe). RESULTS: Disciplinary action by a medical board was strongly associated with prior unprofessional behavior in medical school (odds ratio, 3.0; 95 percent confidence interval, 1.9 to 4.8), for a population attributable risk of disciplinary action of 26 percent. The types of unprofessional behavior most strongly linked with disciplinary action were severe irresponsibility (odds ratio, 8.5; 95 percent confidence interval, 1.8 to 40.1) and severely diminished capacity for self-improvement (odds ratio, 3.1; 95 percent confidence interval, 1.2 to 8.2). Disciplinary action by a medical board was also associated with low scores on the Medical College Admission Test and poor grades in the first two years of medical school (1 percent and 7 percent population attributable risk, respectively), but the association with these variables was less strong than that with unprofessional behavior. CONCLUSIONS: In this case-control study, disciplinary action among practicing physicians by medical boards was strongly associated with unprofessional behavior in medical school. Students with the strongest association were those who were described as irresponsible or as having diminished ability to improve their behavior. Professionalism should have a central role in medical academics and throughout one's medical career.
College Admission Test↗
Initial use of a novel instrument to measure professionalism in surgical residents.
BACKGROUND: No universally accepted method to measure professionalism exists. We developed an instrument to measure specific aspects of professionalism in surgical residents. METHODS: Professionalism was deconstructed into 15 domains. Behavioral descriptors were determined for extreme and selected intermediate anchors. It became evident that residents could "go too far" in some professional behaviors. Therefore, although a 7-point continuous ordinal scale forms the framework, a score of 7 does not necessarily indicate the ideal. This characteristic minimizes the problem of inflated ratings. RESULTS: The instrument was utilized by attending faculty to evaluate residents and also by residents as a self-evaluation. Calculated from ordinal values, mean (SD) of the ratings across domains for faculty evaluations of residents was 4.95 (0.38) while mean for self-evaluations was 4.95 (0.39). Reliability was high (coefficient alpha 0.85). CONCLUSIONS: This instrument provides a means to measure professional behaviors during surgical residency. Repeated use will be required to thoroughly establish validity and reliability.
Accreditation↗
The economic impact of quarantine: SARS in Toronto as a case study.
OBJECTIVES: Over time, quarantine has become a classic public health intervention and has been used repeatedly when newly emerging infectious diseases have threatened to spread throughout a population. Here, we weigh the economic costs and benefits associated with implementing widespread quarantine in Toronto during the SARS outbreaks of 2003. METHODS: We compared the costs of two outbreak scenarios: in Scenario A, SARS is able to transmit itself throughout a population without any significant public health interventions. In Scenario B, quarantine is implemented early on in an attempt to contain the virus. By evaluating these situations, we can investigate whether or not the use of quarantine is justified by being either cost-saving, life saving, or both. RESULTS: Our results indicate that quarantine is effective in containing newly emerging infectious diseases, and also cost saving when compared to not implementing a widespread containment mechanism. CONCLUSIONS: This paper illustrates that it is not only in our humanitarian interest for public health and healthcare officials to remain aggressive in their response to newly emerging infections, but also in our collective economic interest. Despite somewhat daunting initial costs, quarantine saves both lives and money.
Canada↗
Ensuring global standards for medical graduates: a pilot study of international standard-setting.
Increasing physician and patient mobility has led to a move toward internationalization of standards for physician competence. The Institute for International Medical Education proposed a set of outcome-based standards for student performance, which were then measured using three assessment tools in eight leading schools in China: a 150-item multiple-choice examination, a 15-station OSCE and a 16-item faculty observation form. The purpose of this study was to empanel a group of experts to determine whether international student-level performance standards could be set. The IIME convened an international panel of experts in student education with specialty and geographic diversity. The group was split into two, with each sub-group establishing standards independently. After a discussion of the borderline student, the sub-groups established minimally acceptable cut-off scores for performance on the multiple-choice examination (Angoff and Hofstee methods), the OSCE station and global rating performance (modified Angoff method and holistic criterion reference), and faculty observation domains (holistic criterion reference). Panelists within each group set very similar standards for performance. In addition, the two independent parallel panels generated nearly identical performance standards. Cut-off scores changed little before and after being shown pilot data but standard deviations diminished. International experts agreed on a minimum set of competences for medical student performance. In addition, they were able to set consistent performance standards with multiple examination types. This provides an initial basis against which to compare physician performance internationally.
Clinical Competence↗
Maximizing participation in peer assessment of professionalism: the students speak.
BACKGROUND: Medical students have unique information about peers' professionalism but are reluctant to share it through peer assessment. METHOD: Students (231 of 375; 62%) in one school replied to a survey about whether various characteristics of peer assessment (e.g., who receives the assessment, its anonymity, implications for the classmate) would prevent or encourage their participation. RESULTS: Sixty-six percent of the students agreed that there should be peer assessment of professionalism as long as the assessment reflected their preferences for how the assessment should take place. Some of their preferences included reporting unprofessional behavior to an impartial counselor, a 100% anonymous process, and having the classmate receive corrective instruction. Students across year levels generally agreed about the characteristics of peer assessment. Men and women disagreed about some characteristics. CONCLUSION: Most students are willing to participate in peer assessment as long as their preferences are taken into consideration.
Female↗
The prediction of professional behaviour.
OBJECTIVE: The purpose of this study was to establish outcome measures for professionalism in medical students and to identify predictors of these outcomes. DESIGN: Retrospective cohort study. SETTING: A US medical school. PARTICIPANTS: All students entering in 1995 and graduating within 5 years. MEASURES: Outcome measures included review board identification of professionalism problems and clerkship evaluations for items pertaining to professionalism. Pre-clinical predictor variables included material from the admissions application, completion of required course evaluations, students' self-reporting of immunisation compliance, students' performance on standardised patient (SP) exercises, and students' self-assessed performance on SP exercises. RESULTS: The outcome measures of clerkship professionalism scores were found to be highly reliable (alpha 0.88-0.96). No data from the admissions material was found to be predictive of professional behaviour in the clinical years. Using multivariate regression, failing to complete required course evaluations (B = 0.23) and failing to report immunisation compliance (B = 0.29) were significant predictors of unprofessional behaviour found by the review board in subsequent years. Immunisation non-compliance predicted low overall clerkship professional evaluation scores (B = - 0.34). Student self-assessment accuracy (SP score minus self-assessed score) (B = 0.03) and immunisation non-compliance (B = 0.54) predicted the internal medicine clerkship professionalism score. CONCLUSIONS: This study identifies a set of reliable, context-bound outcome measures in professionalism. Although we searched for predictors of behaviour in the admissions application and other domains commonly felt to be predictive of professionalism, we found significant predictors only in domains where students had had opportunities to demonstrate conscientious behaviour or humility in self-assessment.
Attitude of Health Personnel↗
Medical students' views on peer assessment of professionalism.
BACKGROUND: Although peer assessment holds promise for assessing professionalism, reluctance and refusal to participate have been noted among learners and practicing physicians. Understanding the perspectives of potential participants may therefore be important in designing and implementing effective peer assessment. OBJECTIVE: To identify factors that, according to students themselves, will encourage or discourage participation in peer assessment. DESIGN: A qualitative study using grounded theory to interpret views shared during 16 focus groups that were conducted by leaders using a semi-structured guide. PARTICIPANTS: Sixty-one students in Years 1, 3, and 4 in 2 mid-western public medical schools. RESULTS: Three themes students say would promote or discourage peer assessment emerged: personal struggles with peer assessment, characteristics of the assessment system itself, and the environment in which the system operates. Students struggle with reporting an unprofessional peer lest they bring harm to the peer, themselves, or their clinic team or work group. Who receives the assessment and gives the peer feedback and whether it is formative or summative and anonymous, signed, or confidential are important system characteristics. Students' views of characteristics promoting peer assessment were not unanimous. Receptivity to peer reports and close positive relationships among students and between students and faculty mark an environment conducive to peer assessment, students say. CONCLUSIONS: The study lays a foundation for creating acceptable peer assessment systems among students by soliciting their views. Merely introducing an assessment tool will not result in students' willingness to assess each other.
Attitude of Health Personnel↗
Bedside interactions from the other side of the bedrail.
OBJECTIVE: To assess the importance to patients of various aspects of bedside interactions with physician teams. DESIGN: Cross-sectional survey. SETTING: VA hospital. PATIENTS: Ninety-seven medical inpatients. INTERVENTION: Survey of 44 questions including short answer, multiple choice, and Likert-type questions. MEASUREMENTS AND MAIN RESULTS: Data analysis included descriptive statistics. The sample was predominantly male, with a mean age of 62. Overall satisfaction with the hospital experience and with the team of doctors were both high (95% and 96% reported being very or mostly satisfied, respectively). Patients reported learning about several issues during their interactions with the teams; the 3 most highly rated areas were new problems, tests that will be done, and treatments that will be done. Most patients (76%) felt that their teams cared about them very much. Patients were made comfortable when the team showed that they cared, listened, and appeared relaxed (reported by 63%, 57%, and 54%, respectively). Patients were made uncomfortable by the team using language they did not understand (22%) and when several people examined them at once (13%). Many (58%) patients felt personally involved in teaching. The majority of patients liked having medical students and residents involved in their care (69% and 64%, respectively). CONCLUSIONS: Patients have much to teach about what is important about interacting with physician teams. Although patients' reactions to team interactions are generally positive, patients are different with respect to what makes them comfortable and uncomfortable. Taking their preferences into account could improve the experience of being in a teaching hospital.
Cross-Sectional Studies↗
A content analysis of e-mail communication between patients and their providers: patients get the message.
OBJECTIVE: E-mail use in the clinical setting has been slow to diffuse for several reasons, including providers' concerns about patients' inappropriate and inefficient use of the technology. This study examined the content of a random sample of patient-physician e-mail messages to determine the validity of those concerns. DESIGN: A qualitative analysis of patient-physician e-mail messages was performed. MEASUREMENTS: A total of 3,007 patient-physician e-mail messages were collected over 11 months as part of a randomized, controlled trial of a triage-based e-mail system in two primary care centers (including 98 physicians); 10% of messages were randomly selected for review. Messages were coded across such domains as message type, number of requests per e-mail, inclusion of sensitive content, necessity of a physician response, and message tone. RESULTS: The majority (82.8%) of messages addressed a single issue. The most common message types included information updates to the physicians (41.4%), prescription renewals (24.2%), health questions (13.2%), questions about test results (10.9%), referrals (8.8%), "other" (including thank yous, apologies) (8.8%), appointments (5.4%), requests for non-health-related information (4.8%), and billing questions (0.3%). Overall, messages were concise, formal, and medically relevant. Very few (5.1%) included sensitive content, and none included urgent messages. Less than half (43.2%) required a physician response. CONCLUSION: A triage-based e-mail system promoted e-mail exchanges appropriate for primary care. Most patients adhered to guidelines aimed at focusing content, limiting the number of requests per message, and avoiding urgent requests or highly sensitive content. Thus, physicians' concerns about the content of patients' e-mails may be unwarranted.
Communication↗
Exploring professional values and health policy through Photovoice.
Explore the source record for details and available documents.
Audiovisual Aids↗
The physical examination of patients with abdominal pain: the long-term effect of adding standardized patients and small-group feedback to a lecture presentation.
BACKGROUND: One of the most effective methods for teaching physical diagnosis may be standardized patient instructors. PURPOSE: To determine if a lecture plus standardized patient instructors with small-group sessions is more effective than a lecture alone for teaching the evaluation of patients with abdominal pain. METHODS: Control (class of 2001) and intervention (class of 2002) groups both attended a lecture on the abdominal examination. The intervention group then underwent an exercise with standardized patient instructors and a review session with surgical faculty. An evaluation 18 months later used standardized patient instructors to complete evaluations assessing history-taking and physical examination skills. RESULTS: The intervention group performed significantly better than the control group on both the history and the physical examination subscales. CONCLUSION: It is possible to have an important, measurable, and lasting effect on physical examination skills by adding standardized patient instructors and small-group discussion to a lecture presentation.
Abdominal Pain↗
Future challenges from the U.S. perspective: trust as the key to clinical research.
Explore the source record for details and available documents.
Biomedical Research↗
Shifting patients: how residency programs respond to residency review committee requirements.
Explore the source record for details and available documents.
Advisory Committees↗
Effect of a triage-based E-mail system on clinic resource use and patient and physician satisfaction in primary care: a randomized controlled trial.
OBJECTIVES: E-mail communication between patients and their providers has diffused slowly in clinical practice. To address concerns about the use of this technology, we performed a randomized controlled trial of a triage-based e-mail system in primary care. DESIGN AND PATIENTS/PARTICIPANTS: Physicians in 2 university-affiliated primary care centers were randomized to a triage-based e-mail system promoted to their patients. E-mails from patients of intervention physicians were routed to a central account and parsed to the appropriate staff for response. Control group physicians and their patients did not have access to the system. We collected information on patient e-mail use, phone calls, and visit distribution by physician over the 10 months and performed physician and patient surveys to examine attitudes about communication. RESULTS: E-mail volume was greater for intervention versus control physicians (46 weekly e-mails per 100 scheduled visits vs 9 in the control group at the study midpoint; P <.01) but there were no between-group differences in phone volume (67 weekly phone calls per 100 scheduled visits vs 55 in the control group; P =.45) or rates of patient no-shows (5% in both groups; P =.77). Intervention physicians reported more favorable attitudes toward electronic communication than did control physicians but there were no differences in attitudes toward patient or staff communication in general. There were few between-group differences in patient attitudes toward electronic communication or communication in general. CONCLUSIONS: E-mail generated through a triage-based system did not appear to substitute for phone communication or to reduce visit no-shows in a primary care setting. Physicians' attitudes toward electronic communication were improved, but physicians' and patients' attitudes toward general communication did not change. Growth of e-mail communication in primary care settings may not improve the efficiency of clinical care.
Adult↗
The assessment of Global Minimum Essential Requirements in medical education.
Using an international network of experts in medical education, the Institute for International Medical Education (IIME) developed the Global Minimum Essential Requirements (GMER) as a set of competence-based outcomes for graduating students. To establish a set of tools to evaluate these competences, the IIME then convened a Task Force of international experts on assessment that reviewed the GMER. After screening 75 potential assessment tools, they identified three that could be used most effectively. Of the 60 competences envisaged in the GMER, 36 can be assessed using a 150-item multiple-choice question (MCQ) examination, 15 by using a 15-station objective structured clinical examination (OSCE), and 17 by using a 15-item faculty observation form. In cooperation with eight leading medical schools in China, the MCQ, OSCE and Faculty Observation Form were developed to be used in an assessment program that is scheduled to be given to all seven-year students in October 2003.
Attitude of Health Personnel↗