SEARCH · PubMed Health

Results for “Content validation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53Linked to original sources

PubMed1995

Factors influencing dairy calcium intake in women.

OBJECTIVES: Most national dietary studies have reported inadequate calcium (Ca) intake by women, indicating that marketing and educational efforts have not effected dietary behavior changes. The purpose of this study was to identify knowledge, attitudes, and behaviors which influence dairy Ca intake. METHODS: A questionnaire was developed to accomplish these objectives, and piloted for clarity and content validity. Dietary Ca intake was assessed using a food frequency questionnaire. After revisions, women were sampled from four sources: a health spa, elderhostel classes, through a Cooperative Extension Service program, and from the Illinois Older Women's League. The response rate was 66.5%. RESULTS: Mean total reported Ca intake (n = 351) was 591 +/- 355 mg/day. Over 40% of the women reported Ca intakes below 60% of the RDA and could therefore be considered to have deficient intake. Unfortunately, 27.1% of these with deficient intake believed they were meeting the Ca RDA. Significant differences (p < or = 0.01) were found in attitudes and beliefs about dairy Ca when comparing women whose intake was below 60% of the RDA with those whose intake was above 60%. The most commonly mentioned beliefs of the entire sample concerned cholesterol (16.5%), high calories (13.7%) and gastrointestinal discomfort (12.8%). CONCLUSIONS: These findings suggest an important discrepancy between perceived and actual Ca intake which could influence receptiveness to education. Non-dairy Ca rich food sources need to be clarified as does the caloric and cholesterol content of dairy foods.

Adult↗

PubMed2001

A multiple-station test of the teaching skills of general practice preceptors in Flanders, Belgium.

PURPOSE: The Interuniversity Center for Education in General Practice in Flanders, Belgium, supervises its general practice (GP) preceptors so they will meet the quality criteria required for their role in training general practitioners. The author developed a teaching skills assessment test to determine the individual preceptors' competence regarding teaching. The preliminary research described in this article, carried out in 1999, aimed to verify the reliability, validity, and acceptability of that multiple-station test. METHOD: The test consists of seven stations in which simulated teaching situations are portrayed. In the present study, in each station, the GP preceptors (n = 35) had a learning conversation with a standardized GP trainee. The teaching situations were (1) drawing up a learning agenda, (2) leading an advisory conversation, (3) having an exchange of information about practice visits, (4) having a case-related discussion, (5) having a feedback conversation, (6) giving a demonstration of a particular skill or technique, and (7) having an intermediate evaluation conversation. In each station two observers independently scored the preceptors on a five-point scale. RESULTS: The preceptors' scores on the entire test ranged from 30 to 82.7 on a scale whose maximum was 100. The average score was 54.4 (SD, 11.6), and the average scores on the various stations fluctuated between 51.2 and 57.7. The interobserver reliability varied from good to very good for five of the seven stations (Pearson r = 0.77-0.92). The separate stations had a good internal consistency (Cronbach alpha = 0.85). Based on these research results only, the content validity and acceptability of the instrument are good for the GP preceptors in Flanders. CONCLUSIONS: The study findings suggest that the teaching skills assessment test is a reliable instrument, especially fit for screening GP preceptors' teaching skills. However, validation of the instrument needs further investigation.

Belgium↗

PubMed2003

Panic disorder phenomenology in urban self-identified Caucasian-Non-Hispanics and Caucasian-Hispanics.

The epidemiology of panic disorder is well known, but data about some phenomenological aspects are sparse. The symptom criteria for panic disorder were developed largely from rational expert consensus methods and not from empirical research. This fact calls attention to the construct validity of the panic disorder diagnosis, which may affect accuracy of epidemiological findings. Seventy self-identified Non-Hispanic-Caucasian (Anglo) and Hispanic-Caucasian (Hispanic) people who were diagnosed with DSM-III-R panic disorder with or without agoraphobia were invited to complete a Panic Phenomenological Questionnaire (PPQ), which was constructed for this study from the Hamilton Anxiety Scale Items and The DSM-III-R panic symptoms. Fifty (71%) subjects agreed to participate, and there was no response bias detected. Seven symptoms on the PPQ that are not in the DSM-IV diagnostic criteria were reported to occur with a high prevalence in this study. Furthermore, many symptoms that occurred with a high frequency and were reported to be experienced as severe are also not included in current nosology. A few of the DSM-IV criterion symptoms occurred with low prevalence, frequency, and severity. Cognitive symptoms were reported to occur with higher frequency and severity during attacks than autonomic or other symptoms. There were modest differences between ethnic groups with regard to panic attack phenomena. Further research using multiple empirical methods aimed at improving the content validity of the panic disorder diagnosis is warranted. This includes utilizing consistent methods to collect data that will allow for rational decisions about how to construct valid panic disorder criteria across cultures.

Adult↗

PubMed2002

The Wheelchair Skills Test: a pilot study of a new outcome measure.

OBJECTIVE: To evaluate the practicality, safety, reliability, validity, and usefulness of a new Wheelchair Skills Test (WST). DESIGN: A pilot study with within-subject comparisons. SETTING: Rehabilitation center. PATIENTS: Twenty-four wheelchair users (11 with amputations, 4 with stroke, 3 with musculoskeletal disorders, 3 with spinal cord injury, 3 with neuromuscular disorders). INTERVENTION: The WST. MAIN OUTCOME MEASURES: Subjects were videotaped while performing 33 skills twice (>10d apart). Their ability to perform each skill was rated on a 3-point ordinal scale. The test-retest, intra-, and interrater reliabilities were determined. Each subject's occupational therapist completed a visual analog scale (VAS), reflecting a global rating of the subject's manual wheelchair skills. We assessed validity by evaluating whether the WST detected expected changes (construct validity) and how well the total WST scores correlated with the occupational therapists' global ratings (concurrent validity). Each occupational therapist also used a VAS to quantify the usefulness of the WST. RESULTS: The mean time required to administer the WST was 29 minutes. There were no adverse incidents. For the test-retest, intra-, and interrater reliabilities, the correlations for the total scores were .65 (P =.001), .96 (P <.001), and .95 (P <.001), respectively. The 9 therapists unanimously endorsed 30 (91%) of the 33 WST skills. The correlation between the mean changes in the WST and global rating scores was .45 (P <.05). There was a slight negative relationship between total WST score and age (P <.05). There were no significant differences related to the diagnoses accounting for wheelchair use. Wheelchair users with more than 3 weeks of experience with their wheelchairs scored higher than those with less experience (P =.0085). The correlations between the WST and global rating scores ranged from .40 to .54 (P <.05). Through Rasch analysis, we eliminated 6 skills, with the remaining skills comprising a unidimensional screening test of wheelchair ability. The mean VAS score for perceived usefulness was 59%. CONCLUSIONS: The WST is practical, safe, well tolerated, exhibits good to excellent reliability, excellent content validity, fair construct and concurrent validity, and moderate usefulness. This pilot study makes an important contribution toward meeting the need for a well-validated outcome measure of manual wheelchair ability.

Adult↗

PubMed2000

Clinical work sampling A new approach to the problem of in-training evaluation.

OBJECTIVE: Existing systems of in-training evaluation (ITE) have been criticized as being unreliable and invalid methods for assessing student performance during clinical education. The purpose of this study was to assess the feasibility, reliability, and validity of a clinical work sampling (CWS) approach to ITE. This approach focused on the following: (1) basing performance data on observed behaviors, (2) using multiple observers and occasions, (3) recording data at the time of performance, and (4) allowing for a feasible system to receive feedback. PARTICIPANTS: Sixty-two third-year University of Ottawa students were assessed during their 8-week internal medicine inpatient experience. MEASUREMENTS AND MAIN RESULTS: Four performance rating forms (Admission Rating Form, Ward Rating Form, Multidisciplinary Team Rating Form, and Patient's Rating Form) were introduced to document student performance. Voluntary participation rates were variable (12%-64%) with patients excluded from the analysis because of low response rate (12%). The mean number of evaluations per student per rotation (19) exceeded the number of evaluations needed to achieve sufficient reliability. Reliability coefficients were high for the Ward Form (.86) and the Admission Form (.73) but not for the Multidisciplinary Team (.22) Form. There was an examiner effect (rater leniency), but this was small relative to real differences between students. Correlations between the Ward Form and the Admission Form were high (.47), while those with the Multidisciplinary Team Form were lower (.37 and .26, respectively). The CWS approach ITE was considered to be content valid by expert judges. CONCLUSIONS: The collection of ongoing performance data was reasonably feasible, reliable, and valid.

Clinical Competence↗

PubMed2006

Regulatory end-point assessment of the consultation competence of family practice trainees in Kuwait.

BACKGROUND: No single approach to the regulatory assessment of global consultation competence has been shown to possess the required levels of validity, reliability and feasibility. OBJECTIVE: To evaluate the approach adopted in Kuwait to the regulatory end-point assessment of the global consultation competence of family practice trainees with particular reference to validity, reliability and feasibility. METHODS: Family practice trainees in Kuwait were individually and directly observed for 3 hours in consultation with a minimum of 10 patients by a pair of examiners. Performance was judged against the explicit criteria of consultation competence as contained in the Leicester Assessment Package (LAP). RESULTS: The marks independently allocated by the pairs of examiners to 126 trainees between 1994 and 2001 were within five percentage points on 91% of occasions. A reliability coefficient of 0.82 was achieved when two examiners independently marked candidates consulting with 10 real patients; this rose to 0.95 at the critical 50% pass-fail margin. The main sources of variance contributing to the reliability of marks allocated were candidate performance (42%) and the interaction of candidate performance across cases, i.e., case specificity (30%). The clinical challenges presented by the patients were judged by both examiners to be sufficient to enable performance to be assessed across the seven LAP consultation categories as follows: behaviour and relationship with patients (100% of consultations), interviewing/history taking (100%), record keeping (99%), patient management (99%), problem solving (98%), physical examination (95%), and anticipatory care (86%). Each assessment involved a pair of examiners and lasted approximately 3.5 hours. CONCLUSION: The Kuwait clinical examination achieves high content validity and authenticity as it uses direct observation of performance, validated and explicit criteria against which performance is judged, and real patient challenges. It can discriminate between different levels of consultation performance and satisfies the recognized reliability threshold for regulatory examinations (0.82 vs 0.80). Accordingly, we recommend the use of such an approach in the regulatory end-point assessment of the global consultation competence of trainees in family practice. Such an approach is more valid, and is likely to be more feasible, than simulated surgeries or the short-case OSCE format.

Family Practice↗

PubMed1992

Assessing the needs and quality of life of patients with HIV infection: development of the HIV Overview of Problems-Evaluation System (HOPES).

OBJECTIVE: To develop and evaluate the psychometric properties (reliability, validity etc.) of a comprehensive Quality of Life (QOL) tool, for patients infected with the human immunodeficiency virus (HIV), that was adapted from a previously validated cancer tool. DESIGN: Cross-sectional, patient completed written surveys and interviews. SETTING: The Medical Centers serving HIV infected patients in the Los Angeles community including UCLA, community physicians, Veterans Affairs Medical Centers, and a County hospital: and additional data contributed from Johns Hopkins University Medical Center CMV Retinitis Clinic. PATIENTS: Patients (n = 318) with HIV infection including asymptomatic (37%), ARC (20%), AIDS (25%) and AIDS with Cancer (18%) receiving health services at one of the above sites. MEASUREMENTS: The patients self-administered the newly developed instrument, the HOPES (HIV Overview of Problems-Evaluation System), other QOL related tools including the Medical Outcomes Study instrument adapted for HIV (MOS-HIV) the Profile of Mood States (POMS), the Perceived Adjustment to Chronic Illness Scale (PACIS), and the Physical Activity Scale (PAS). Brief interview to assess the Karnofsky Performance Status Score (KPS). Measured sociodemographic characteristics included age, sex, race, HIV risk factor, education etc. Assessed medical history, current medications, HIV clinical classification. MAIN RESULTS: The sociodemographic and medical characteristics of the sample resemble those of the general population with HIV infection in this geographic area: 96% male, 28% nonwhite, 84% homosexual contact as risk factor, 75% receiving antiretroviral therapy. The adaptation of the cancer QOL instrument to HIV appears to have face and content validity according to patients and health professionals who care for HIV infected patients. Analyses of the psychometric properties found that the HOPES has a similar structure to its parent instrument following factor analyses which results in five summary scales representing the Physical, Psychosocial, Medical Interaction, Sexual and Significant Other/Partners domains in addition to a Global Score. Internal consistency of 35 subscales is high with a mean alpha coefficient of 0.82. Correlations of the HOPES summary scales with other QOL instruments are in the predicted directions. Comparing patients within the HIV clinical diagnostic categories on the HOPES Global, Physical, and Psychosocial Summary Scales indicates that Asymptomatic Patients have better QOL than symptomatic patients. This finding is also found in the other QOL instruments which provides evidence of construct validity. CONCLUSIONS: The HOPES is an excellent tool for identifying the problems and needs of patients with HIV infection and for assessing their quality of life. It is reliable, valid and acceptable to patients. The tool may be especially useful in developing a normative data base.

Acquired Immunodeficiency Syndrome↗

PubMed2006

Cross-cultural adaptation of a tobacco questionnaire for Punjabi, Cantonese, Urdu and Sylheti speakers: qualitative research for better clinical practice, cessation services and research.

OBJECTIVE: To develop cross-culturally valid and comparable questionnaires for use in clinical practice, tobacco cessation services and multiethnic surveys on tobacco use. METHODS: Key questions in Urdu, Cantonese, Punjabi and Sylheti on tobacco use were compiled from the best existing surveys. Additional items were translated by bilingual coworkers. In one-to-one and group consultations, lay members of the Pakistani, Chinese, Indian Sikh and Bangladeshi communities assessed the appropriateness of questions. Questionnaires were developed and field tested. Cross-cultural comparability was judged in a discussion between the researchers and coworkers, and questionnaires were finalised. Questionnaires in Cantonese (written and verbal forms differ) and Sylheti (no script in contemporary use) were written as spoken to avoid spot translations by interviewers. RESULTS: The Chinese did not use bidis, hookahs or smokeless tobacco, so these topics were excluded for them. It was unacceptable for Punjabi Sikhs to use tobacco. For the Urdu speakers and Sylheti speakers there was no outright taboo, particularly for men, but it was not encouraged. Use of paan was common among women and men. Many changes to existing questions were necessary to enhance cultural and linguistic appropriateness-for example, using less formal language, or rephrasing to clarify meaning. Questions were modified to ensure comparability across languages, including English. CONCLUSION: Using theoretically recommended approaches, a tobacco-related questionnaire with face and content validity was constructed for Urdu, Punjabi, Cantonese and Sylheti speakers, paving the way for practitioners to collect more valid data to underpin services, for sounder research and ultimately better tobacco control. The methods and lessons are applicable internationally.

Community Health Services↗

PubMed2001

Exploring the nursing minimum data set for The Netherlands using multidimensional scaling techniques.

RATIONALE: To fulfil the need for a systematic collection of nursing data that give insight in nursing care and its benefits and costs, a nursing minimum data set (NMDS) has been developed and validated for Dutch general hospitals. A NMDS provides data describing the diversity in patient populations and variability in nursing activities that can be analysed in various ways. AIM OF THE STUDY: To explore and compare the fundamental underlying dimensions describing patient problems and nursing interventions in Dutch general hospital wards. METHODS: Data of predominantly nominal and ordinal measurement level that were collected with the NMDS for The Netherlands on 15 Dutch hospital wards underwent two consecutive steps: first, they were transformed into metric data by means of RIDIT (relative to an identified distribution) analysis; secondly, they were analysed by means of multidimensional scaling. RESULTS: Multidimensional scaling techniques yielded a fairly good three-dimensional solution of the NMDS data. Hospital wards could be distinguished from each other on the basis of patient problems and nursing interventions most common on some wards but not on others. The core aspects underlying patient problems concerned dependency problems, life threatening problems and endogenous-exogenous problems, while discriminating nursing interventions were cure-care activities, internally-externally oriented activities and psychosocial-physical interventions. LIMITATIONS: Not all types of hospital wards were represented, which limits the representativeness of the results for Dutch general hospitals. Furthermore, the patient sample size over the 15 wards was relatively small. CONCLUSION: The constructs are consistent with NMDS findings in Belgium and findings from practice, which contributes to their content validity.

Data Interpretation, Statistical↗

PubMed2006

Design and validation of a medication assessment tool for cancer pain management.

OBJECTIVE: A clinical tool to examine prescribing in cancer pain management may provide a means to help establish acceptable standards of adherence to treatment guidelines. The study aim was to design and validate a Medication Assessment Tool for Cancer Pain Management (MAT-CP). SETTING: Hospitals in Northern Norway METHOD: The MAT-CP was designed from guideline criteria based on a previously developed method. The tool was validated by peer review before and during field-testing on a study sample of cancer patients experiencing pain. MAIN OUTCOME MEASURE: Perceived relevance, utility, and clarity of individual criteria, and reliability of their application to clinical documentation. Frequency of adherence to agreed definitions of guideline criteria. RESULTS: The final tool comprised 36 criteria covering six different aspects of cancer pain management: (1) pain assessment and information transfer, (2) start of strong opioid therapy; (3) current continuous analgesia; (4) current intermittent analgesia; (5) follow-up of therapy, and; (6) other care issues. The tool was tested on 109 cancer patients experiencing pain (57 males), mean (SD) age 60.8 (11.5) years. Guideline adherence overall was 61% (n=1704 applicable criteria). The field-testing informed the modification of the MAT-CP to optimise its clarity and utility when applied to patients' clinical documentation. Good inter- and intra-rater reliability (Cohen's kappa kappa=0.86 and kappa=0.95, respectively) were demonstrated in the application. The preliminary application of the tool during field-testing has highlighted the following for further study: (a) Low adherence <50%) to 14 standards concerning start of opioid treatment and pain therapy follow-up, clinical assessment of risk of gastro-intestinal adverse effects among patients on non-steroidal anti-inflammatory drugs (NSAID), current treatment of breakthrough pain, management of nausea/vomiting; (b) High adherence (>75%) to standards of prescribing of continuous analgesia. CONCLUSION: A clinical tool to examine prescribing in cancer pain management has been designed. Face and content validity have been informed by field-testing. The tool requires further study among palliative care specialists as part of the validation required before it can be recommended for clinical use.

Adult↗

PubMed2006

Development and validation of a scale to assess attitudes of health care administrators toward the use of e-mail communication between patients and physicians.

BACKGROUND: The medical profession has been slow in embracing the e-mail as a means of improving patient communications. Today, most physicians work in group practices where administrators seek to develop standard procedures for care delivery. To understand the slow adoption of e-mail technology among physicians when communicating with their patients, it is important to understand these administrators' attitudes. OBJECTIVE: The purpose of this study was to develop and purify a scale to measure health care administrators' attitudes toward the use of e-mail communication and identify associations between e-mail communication attitudes and administrators' demographic and practice-related characteristics. METHODS: A preliminary list of features for e-mail communication was generated by reviewing the literature and Rogers' diffusion theory. The features were grouped initially into 5 hypothesized dimensions: relative advantage, norms (established rules of the social system), complexity, compatibility, and infrastructure. Following pilot testing, the main survey instrument was mailed to a total of 1500 health care administrators. Attitudes toward features of e-mail communication scale were analyzed using exploratory factor analysis with promax rotation. Internal consistency of the scale and its subscales was determined using Cronbach's alpha and item-total correlations. RESULTS: The overall response rate was 8.7%. Scale purification procedures reduced the preliminary scale of 22 items to a final scale of 20 items. The reliability of the scale measured by Cronbach's alpha was 0.81. Norms was considered the major barrier to e-mail communication, whereas infrastructure was considered a facilitator, and other features like relative advantage, complexity, and compatibility issues were perceived more as a barrier than a facilitator. The item related to and usage of e-mail by staff was statistically significant with the overall scale score (P=0.0095), complexity subscale score (P=0.0168), and infrastructure subscale score (P=0.0480). The relationship between number of years of experience of the administrator and infrastructure subscale score was statistically significant (P=0.0480). CONCLUSION: A scale developed to determine the attitudes of health care administrators regarding e-mail communication between patients and physicians demonstrated adequate content validity and reliability.

Adolescent↗

PubMed2000

Validation of an instrument measuring patient satisfaction with chest physiotherapy techniques in cystic fibrosis.

OBJECTIVES: Chest physiotherapy (CPT) has been an important part of cystic fibrosis (CF) treatment regimens for > 40 years. Techniques with different perceived costs, benefits, and patient satisfaction exist. An instrument measuring patient satisfaction with CPT has not been reported. Our goal was to develop and validate such an instrument. DESIGN: A cross-sectional survey sent to 349 patients seen at a large, urban, academic CF care center. The two-page survey asked 17 questions related to CPT satisfaction (efficacy, convenience, comfort, overall satisfaction), followed by 4 general CF-care questions (disease severity, importance of therapies, prescribed vs missed therapies). A 5-point Likert-type scale was used for responses. Psychometric analysis included itemetric performance, confirmatory factor analysis, test-retest reliability, and evaluation of subject's responses to the general CF-care questions. RESULTS: One hundred twenty-nine individuals returned completed surveys (39%; 66 males and 63 females; age range, 2 months to 47 years). FEV(1)values were 21 to 155% predicted (mean, 76%; n = 82). Disease severity was as follows: 60 mild, 47 moderate, and 14 severe. Seventy-nine subjects used postural drainage, percussion, and vibration (PDPV), 21 used a flutter device, and 14 used high-frequency chest wall oscillation (HFCWO). Five subjects used more than one technique. Internal consistency analysis found an overall coefficient alpha of 0.87 (range, 0.74 to 0.89 for four domains). Factor analysis demonstrated domains for efficacy, convenience, comfort, and overall satisfaction. Mean total satisfaction scores differed significantly among therapies (R(2) = 0. 118; F[ 2,111] = 7.56; p = 0.0008): PDPV, 3.8 (SD = 0.6); Flutter, 4. 3 (SD = 0.5); and HFCWO, 4.1 (SD = 0.5). Therapies also differed significantly on all subscores. Perceived importance of CPT and compliance with CPT increased linearly with disease severity. Overall satisfaction was positively correlated with CPT compliance. CONCLUSIONS: The CPT satisfaction survey has good reliability and content validity. Significant differences in patient satisfaction exist among therapies. Sicker patients recognize the importance of, and demonstrate better compliance with prescribed CPT. Increased satisfaction is associated with better compliance with therapy.

Adolescent↗

PubMed2005

Evaluating national cause-of-death statistics: principles and application to the case of China.

Mortality statistics systems provide basic information on the levels and causes of mortality in populations. Only a third of the world's countries have complete civil registration systems that yield adequate cause-specific mortality data for health policy-making and monitoring. This paper describes the development of a set of criteria for evaluating the quality of national mortality statistics and applies them to China as an example. The criteria cover a range of structural, statistical and technical aspects of national mortality data. Little is known about cause-of-death data in China, which is home to roughly one-fifth of the world's population. These criteria were used to evaluate the utility of data from two mortality statistics systems in use in China, namely the Ministry of Health-Vital Registration (MOH-VR) system and the Disease Surveillance Point (DSP) system. We concluded that mortality registration was incomplete in both. No statistics were available for geographical subdivisions of the country to inform resource allocation or for the monitoring of health programmes. Compilation and publication of statistics is irregular in the case of the DSP, and they are not made publicly available at all by the MOH-VR. More research is required to measure the content validity of cause-of-death attribution in the two systems, especially due to the use of verbal autopsy methods in rural areas. This framework of criteria-based evaluation is recommended for the evaluation of national mortality data in developing countries to determine their utility and to guide efforts to improve their value for guiding policy.

Adolescent↗

PubMed1998

Identifying the content area for the 51-item National Eye Institute Visual Function Questionnaire: results from focus groups with visually impaired persons.

OBJECTIVE: To identify the content area for a questionnaire designed to measure vision-targeted health-related quality of life and to determine whether problems with vision-related functioning are qualitatively similar across different common eye diseases. DESIGN: Twenty-six condition-specific focus groups were conducted with 246 patients from 5 geographic regions to identify the content area for a questionnaire for use among persons with diabetic retinopathy, glaucoma, macular degeneration, cytomegalovirus retinitis, and cataract. A standard protocol was used to structure each focus group discussion. Sessions were audiotaped, transcribed, and coded in preparation for a content analysis. SETTINGS: Five university-based ophthalmology practices and 1 nonprofit eye care foundation. PARTICIPANTS: Eligible participants had to have 1 of the following eye conditions: age-related cataracts, age-related macular degeneration, diabetic retinopathy, primary open angle glaucoma, cytomegalovirus retinitis, or low vision from any cause. All eligible persons were older than 21 years, spoke English, and had sufficient cognitive function to provide informed consent. RESULTS: Among the 246 participants, 2623 problems with vision-related functioning were mentioned. The mean number of problems per person ranged from 13.5 for those with diabetic retinopathy to 7.9 for persons with glaucoma. For the sample overall, reading problems were mentioned most frequently, followed by driving, general problems with seeing clearly, and mental health complaints caused by vision. Although the proportion of persons who reported each problem varied by condition, at least some persons with each eye disease reported each problem. The 3 most common descriptors associated with each problem were difficulty or ease of performance (13%), psychological distress associated with performance of the activity (11%), and complete inability to participate in a visual activity (11%). CONCLUSION: An item-generation strategy for a new questionnaire using a standardized focus group method identified content areas and aspects of visual disability that are not included in currently available vision-specific instruments that assess the impact of common eye diseases on visual functioning in every-day life. Although participants mentioned problems that were unique to their disease, across conditions the problems mentioned were similar. These findings provide empirical evidence of content validity for a vision-targeted, health-related quality-of-life survey designed for use across conditions.

Adult↗

PubMed1999

A pediatric clinical skills assessment using children as standardized patients.

OBJECTIVES: To develop and implement a pediatric clinical skills assessment (PCSA) for residents, using children as standardized patients (SPs); to assess the psychometric adequacy of the PCSA and use it to evaluate the performance of residents; and to evaluate the feasibility of using child SPs and the response of the residents and the child SPs to participation in the PCSA. METHODS: Ten 22-minute complete patient encounters were developed, 7 with child SPs. Fifty-six residents (10 second-year pediatric residents, 29 first-year pediatric residents, and 17 first-year family practice residents) were evaluated on the following clinical skills: history taking, physical examination, interpersonal skills, and documentation and interpretation of clinical data/patient note. MAIN OUTCOME MEASURES: Patient encounter checklists, focus groups, and questionnaires. RESULTS: Average skill scores for the 56 residents were 68% (SD, 12%) for history taking, 56% (SD, 26%) for physical examination, 46% (SD, 12%) for patient note, and 68% (SD, 16%) for interpersonal skills. Second-year pediatric residents scored significantly higher on history taking than first-year pediatric and first-year family practice residents; first-year pediatric residents scored significantly higher on interpersonal skills than second-year pediatric and first-year family practice residents; and first- and second-year pediatric residents scored significantly higher on the patient note component than first-year family practice residents. All differences noted were significant at P<.05. There were no significant differences on physical examination between the groups. Reliabilities were 0.69 for history taking, 0.64 for physical examination, 0.76 for interpersonal skills, and 0.81 for the patient note component. On a Likert scale (5 indicates high; 1, low), residents rated the PCSA 3.9 for realism, 4.1 for challenge, 3.1 for enjoyment, and 2.9 for fairness. Child SPs found the experience positive. No negative effects on the children were identified by their real parents or their SP parents. CONCLUSIONS: Our development method gives content validity to our PCSA, and resident scores give indication of PCSA construct validity. Reliabilities are in the acceptable range. Residents found the PCSA challenging and realistic but less than enjoyable and fair. Use of child SPs is feasible. Resident performance scores were low relative to the performance criteria of the PCSA development group. The adequacy of clinical skills teaching and assessment in residency programs needs to be reviewed. Deficits in specific skills and overall performance of residents identified by a PCSA could be used to guide individual remediation and curricular change.

Adolescent↗

PubMed1979

Newer experimental methods for classifying depression. A report from the NIMH collaborative pilot study.

A total of 83 patients receiving diagnoses of major depressive disorder in the pilot phase of the National Institute of Mental Health Collaborative Study of the Psychobiology of Depression were used to evaluate two newer methods of classifying depressive disorders on the basis of family history or course. A third subtype based on family history, nonfamilial depression, was compared with the two subtypes originally proposed by Winokur and colleagues, pure depression and depression spectrum diseases. The system for classifying depressions on the basis of course and antecedent disorder, primary vs secondary depression, was also compared. These data from the pilot study indicate that two newer systems for classification have some predictive, construct, and content validity, but both are in need of further investigation before they become accepted methods for the classification of depressive disorders.

Depression↗

PubMed2003

Alterations in stress cortisol reactivity in depressed preschoolers relative to psychiatric and no-disorder comparison groups.

BACKGROUND: Despite the robust and widely replicated finding of elevated hypothalamic-pituitary-adrenal (HPA) axis reactivity in depressed adults, studies of depressed children have yielded ambiguous findings. Animal models of early depression and studies of children experiencing early psychosocial deprivation have suggested that alterations in HPA axis reactivity are evident in early "depressive-like" conditions. The current study is, to our knowledge, the first investigation of HPA axis reactivity in very young children with a clinical depressive syndrome for which content validity has been established. METHODS: Depressed, psychiatric, and no-disorder comparison children aged 3 through 5.6 years were studied for HPA axis reactivity in response to experimental psychosocial stressors. The children were diagnosed using a developmentally appropriate, structured psychiatric interview. Salivary cortisol was obtained at 3 time points during a laboratory assessment before and after stressors involving separation from the parent and frustrating tasks. RESULTS: Repeated measures of multivariate analysis of variance revealed a significant interaction between the diagnostic group and 2 cortisol percent change scores. Depressed preschoolers displayed a pattern of increasing cortisol levels throughout the assessment in response to both separation and frustration stressors. In contrast, both comparison groups showed decreasing cortisol levels in response to the separation stressor. All groups displayed increasing cortisol levels in response to frustrating tasks. Preschoolers with a presumptive melancholic depressive subtype displayed these alterations at a greater magnitude relative to comparison groups. CONCLUSIONS: To our knowledge, these findings are the first to demonstrate altered HPA axis reactivity in depressed preschoolers. These alterations are consistent with those described in depressed adults and in animal models of early depression. These findings provide evidence for possible continuity of HPA axis alterations in depressive disorders across the lifespan and are discussed in the context of prior studies of HPA axis reactivity in clinically depressed children and adolescents, suggesting that younger age and inpatient status are features associated with altered HPA axis reactivity.

Arousal↗

PubMed1999

Development and testing of the Resistiveness to Care Scale.

A conceptual model and objective scale for measuring resistiveness to care in individuals with advanced dementia of the Alzheimer type (DAT) were empirically generated from the perspective of nursing staff caregivers and through observation of residents with DAT. The resistiveness to care scale (RTC-DAT) was judged to have content validity and reduced to 13 items. Quantifiable scoring procedures and methods for rating videotapes and conducting clinical observations were developed. The RTC-DAT was tested with 68 subjects at three sites. The RTC has a range of 0-156. Initial testing provided reliability estimates of .82-.87 for internal consistency and good to excellent kappas. Criterion-related validity with observed discomfort and construct validity by factor analysis support the RTC-DAT. Measurement issues and recommendations for use in research are discussed.

Activities of Daily Living↗