PubMed HealthSearch

Biomedical subjects

D V Cicchetti

Publications and source records attributed to D V Cicchetti.

At least 19 recordsLinked to original sources

Three diagnostic systems for autism: DSM-III, DSM-III-R, and ICD-10.

ICD-10 draft research criteria for childhood autism were applied to a previously published data set comparing DSM-III and DSM-III-R to clinicians' diagnoses of autism. The ICD-10 approach paralleled clinicians' patterns of diagnosis and, to a lesser extent, the DSM-III system. Relative to either clinicians, DSM-III, or ICD-10 the DSM-III-R system overdiagnosed the presence of autism. Implications for research and for future revision of diagnostic criteria are discussed.

Adolescent

Assessing the reliability of clinical scales when the data have both nominal and ordinal features: proposed guidelines for neuropsychological assessments.

The purpose of this article is to present, for the first time, a comprehensive methodology for assessing the reliability of a clinical scale that is frequently utilized in neuropsychological research and in biomedical studies, more generally. The dichotomous-ordinal scale is characterized by a single category of "absence" and two or more ordinalized categories of "presence" of a symptom trait, state, or behavior, and it also has special properties that need to be understood in order for its reliability to be appropriately assessed. Using the Brief Psychiatric Rating Scale (BPRS) as a clinical example, we cover the principles of expressing scale reliability in terms of a dichotomy ("absence" - "presence" of a given BPRS symptom); as a trichotomy ("none"; "mild to moderate" symptomatology; and "severe" symptomatology); and as the full 7-category dichotomous-ordinal scale: "none," "very mild," "mild," "moderate," "moderately severe," "severe," and "extremely severe." Criteria are presented that can be used to evaluate which of these three formats produces the most reliable results. Finally, we address, with a second sample, the important issue of replication, or whether the original reliability findings generalize to other independent populations.

Adult

The outpatient treatment of depression. Implications of outcome research for clinical practice.

Multiple studies have demonstrated that individual psychotherapy, pharmacotherapy, and the two in combination are all effective treatments for depressed outpatients. However, the implications of these data for clinical practice have been incompletely considered, and the often drawn mistaken conclusion is that they support routine treatment with psychotherapy and pharmacotherapy together. Analyses of treatment success rates, treatment failure rates, and treatment dropout rates indicate that combined treatment offers no advantage over treatment with psychotherapy alone and only modest advantage over treatment with pharmacotherapy alone. Routine use of combined treatment, therefore, exposes patients to unnecessary costs and side effects. The data suggest that psychotherapy alone should usually be the initial treatment.

Ambulatory Care

Demographic, clinical, and psychosocial predictors of the reliability of mothers' clinical judgments.

The purpose of this study was to investigate to what extent selected adverse demographic, clinical, and psychosocial data measured at the 2-week well child visit could predict poorer reliability of mothers' judgments during acute illness episodes over the next 32 months. The study was a randomized trial of the Acute Illness Observation Scales (AIOS); 369 mothers participated, 183 in the intervention group using the Acute Illness Observation Scales and 186 in the control group using a three-point global assessment scale. There were 704 acute illnesses judged simultaneously and independently by mothers and pediatricians. Standard Pearson r correlations were performed between the independent variables, taken singly and in all possible combinations, and the dependent variable, reliability of mothers' judgments as measured by weighted kappa (kappa W). Group assignment was entered as an independent variable. Analyses were performed separately for all first, second, and third acute illness visits to control for any "practice effect" (analysis 1). To control for consistency of observers, the first, second, and third visits of mothers with three visits were also analyzed (analysis 2). Depending on the visit number, adverse demographic, clinical, and psychosocial characteristics did correlate with poorer reliability independent of group assignment. The correlations ranged from small (analysis 1, first visit, multiple variable r2 = 4%) to large (analysis 2, second visit, multiple variable r2 = 29%). Controlling for both visit number and consistency of observers vs visit number alone (analysis 2 vs analysis 1) increased multivariate correlations to kappa W. The results support the untoward impact that adverse demographic, clinical, and psychosocial factors have on mothers' clinical judgment. These data may assist pediatricians in identifying parents who might benefit from more intensive teaching and support about acute illness episodes in their children.

Acute Disease

Observer variability in echo-Doppler measurements of portal flow in cirrhotic patients and normal volunteers.

The intraobserver and interobserver variability in measuring the portal vein flow by the echo-Doppler technique was evaluated in a blind controlled study. A total of 22 cirrhotic patients and 14 normal volunteers were examined by two skilled operators using duplex Doppler within a period of 1-3 mo (6 cirrhotics and 7 normal volunteers by both observers). Area, mean velocity, and flow were measured (4 measurements: A, B on day 1; C, D on day 2). The intraclass correlation coefficient was used to assess both the statistical and clinical significance of intraobserver and interobserver agreement for the measurements of these three parameters. The level of intraobserver agreement for each parameter on normal subjects and cirrhotics was obtained from the two measurements on the same day and from the two measurements at the same time on consecutive days. Overall agreement between the four measurements was also calculated. Levels of interobserver agreement were obtained by calculating separately the intraclass correlation coefficient from each of the four pairs by measurements made on the same subject by the two observers over the same period of 2 days. The coefficient of variation was also used to compare the variability in these measurements. Overall, intraobserver agreement on normal subjects varied from good to excellent for observer 1, and from fair to good for observer 2. On cirrhotic patients, observer 1 was excellent at all times for all parameters. Observer 2 had lower intraclass correlation coefficient values, especially for velocity on consecutive days. For the best of the two observers on the portal flow, the coefficient of variation in cirrhotic patients ranged from 2%-30% with a mean +/- SEM of 12% +/- 4%. No acceptable interobserver agreement was found between the two observers in either of the two samples of subjects. These results support the use of this technique mainly for the determination of rapid and large changes in portal hemodynamics within a short period of time. The technique seems to have low precision in monitoring chronic changes in portal hemodynamics.

Adult

High agreement but low kappa: I. The problems of two paradoxes.

In a fourfold table showing binary agreement of two observers, the observed proportion of agreement, p0, can be paradoxically altered by the chance-corrected ratio that creates kappa as an index of concordance. In one paradox, a high value of p0 can be drastically lowered by a substantial imbalance in the table's marginal totals either vertically or horizontally. In the second pardox, kappa will be higher with an asymmetrical rather than symmetrical imbalanced in marginal totals, and with imperfect rather than perfect symmetry in the imbalance. An adjustment that substitutes kappa max for kappa does not repair either problem, and seems to make the second one worse.

Models, Statistical

High agreement but low kappa: II. Resolving the paradoxes.

An omnibus index offers a single summary expression for a fourfold table of binary concordance among two observers. Among the available other omnibus indexes, none offers a satisfactory solution for the paradoxes that occur with p0 and kappa. The problem can be avoided only by using ppos and pneg as two separate indexes of proportionate agreement in the observers' positive and negative decisions. These two indexes, which are analogous to sensitivity and specificity for concordance in a diagnostic marker test, create the paradoxes formed when the chance correction in kappa is calculated as a product of the increment in the two indexes and the increment in marginal totals. If only a single omnibus index is used to compared different performances in observer variability, the paradoxes of kappa are desirable since they appropriately "penalize" inequalities in ppos and pneg. For better understanding of results and for planning improvements in the observers' performance, however, the omnibus value of kappa should always be accompanied by separate individual values of ppos and pneg.

Observer Variation

Mothers' clinical judgment: a randomized trial of the Acute Illness Observation Scales.

The purpose of this study was to investigate whether the reliability, sensitivity, and specificity of mothers' judgments about acute illnesses in their children could be improved by using the Acute Illness Observation Scales (AIOS). At the 2-week well child care visit in a primary care center and a private practice, 369 mothers were divided at random into an intervention group (n = 183) and a control group (n = 186). A teaching film and booklet were used to educate mothers in the intervention group about the AIOS; control group mothers were taught a 3-point global scoring system for evaluating the chance of serious illness. In the 32 months of follow-up, 704 acute illnesses were evaluated in tandem and independently by mothers and pediatricians before the history and physical examination; 20 of these illnesses were serious. The judgments of the intervention group were more reliable than those of the control group (weighted kappa = 0.50 vs 0.26, respectively), as was the specificity of their judgments (85% vs 52%, respectively; p less than 0.0001). No difference was noted in the sensitivity of intervention group and control group mothers' judgments (80% vs 90%, respectively). Teaching parents to assess specific clinical information, as represented in the AIOS, has its greatest effect on the reliability and specificity, not the sensitivity, of their judgments. Such teaching could lead to fewer unnecessary office visits during acute illnesses.

Acute Disease

The Structured Clinical Interview for DSM-III-R Dissociative Disorders: preliminary report on a new diagnostic instrument.

The authors describe the Structured Clinical Interview for DSM-III-R Dissociative Disorders (SCID-D), which investigates five groups of dissociative symptoms (amnesia, depersonalization, derealization, identity confusion, and identity alteration) and systematically rates both the severity of individual symptoms and the evaluation of overall diagnosis of dissociative disorder. Preliminary findings from a study of 48 subjects with and without psychiatric diagnoses indicate good to excellent reliability and discriminant validity for the SCID-D as a diagnostic instrument for the five dissociative disorders and as a tool for the evaluation of dissociative symptoms encountered within nondissociative syndromes.

Adult

Comparative reliability of categorical and analogue rating scales in the assessment of psychiatric symptomatology.

The reliability of 26 items from the ninth edition of the Present State Examination (PSE) was assessed using both the conventional categorical scales and separately constructed analogue scales. Reliability was also calculated when the analogue responses were rescaled down to 2, 3 and 4 categories. The levels of inter-rater agreement obtained were comparable to those achieved in previous studies of PSE reliability, although as expected the levels of agreement on audiotapes were greater than those for independent interviews performed on the same day. These levels were not significantly affected by any of the changes in scale format, but there were apparent differences in reliability depending on the statistics used. In selecting or constructing a psychiatric rating scale, the question of reliability should not influence the choice of a categorical or continuous scale, or the number of scored points in the scale.

Psychiatric Status Rating Scales

Behavior rating inventory for moderately, severely, and profoundly retarded persons.

The reliability and validity of the behavior of a sample of institutionalized mentally retarded children, with total IQs between 2 and 53, were assessed by a new scale measuring the following areas; communication, self-help, physical skills, self-control, and social behavior. Clinically and statistically acceptable levels of interrater agreement were found. With respect to validity: (a) several factors loaded very highly on items consistent with the a priori labeling of subscales; (b) two of the factors (cognitive and psychomotor development) could account for about 75% of the explained variance in ward placement levels (multiple R = .86); and (c) individual items on the Behavior Rating Inventory for the Retarded correlated highly with independently derived measures of the actual behavior these items represented. The major advantages of this scale over existing ones include its clearly demonstrated validity and relative ease of administration and scoring.

Adolescent

Sleep in mammals: ecological and constitutional correlates.

The interrelationships between sleep, ecological, and constitutional variables were assessed statistically for 39 mammalian species. Slow-wave sleep is negatively associated with a factor related to body size, which suggests that large amounts of this sleep phase are disadvantageous in large species. Paradoxical sleep is associated with a factor related to predatory danger, which suggests that large amounts of this sleep phase are disadvantageous in prey species.

Animals