PubMed HealthSearch

SEARCH · PubMed Health

Results for “Observer Variation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5Linked to original sources

Observer variation in clinical examination of the nasal airway.

There has been no standardization of clinical assessment of the nasal airway between different clinical trials. In order to evaluate the reproducibility of tests in use in current clinical practice, a pre-trial inter-observer assessment of the nasal airway tests was made and an intra- and inter-observer assessment was made in 25 patients. Differing degrees of correlation were demonstrated, using the Kappa statistic. Suggestions are made to enable improved standardization of clinical examination of the nasal airways for clinical trials.

Clinical Trials as Topic

Observer variation in the assessment of dysplasia in ulcerative colitis.

Six histopathologists allocated 100 sections from patients with long-standing ulcerative colitis into four diagnostic categories, regular hyperplasia, reactive atypia, low-grade and high-grade dysplasia. Their allocations were analysed using kappa statistics, including Fleiss's multiple kappa for groups of observers, and agreement on specific diagnoses was explored by constructing a conditional probability matrix. The nature of their disagreements was investigated using coefficients for systematic and haphazard errors. Over the four diagnostic categories there was a wide range of pairwise agreement from a low of 49% up to 72% and kappa values were only 'fair' or 'moderate'. As expected, agreement over the two categories 'dysplasia' vs 'no dysplasia' was better, ranging from 68% to 84%, and for 'atypia present' (reactive atypia, low- and high-grade dysplasia) vs "no atypia' two pairings achieved over 90% and 11 pairings over 80% agreement. In view of its clinical importance, conditional agreement on high-grade dysplasia, pairwise agreement on this diagnosis ranged from 100% down to as low as 33%. However, most of these disagreements fell into the low-grade dysplasia category so that closer follow-up and further biopsies would still have been indicated. It is a truism that the basis for safe management is careful co-operation between clinicians and pathologists who have all the relevant facts and who know and trust one another's judgement. Thus, several aspects of the ideal diagnostic process cannot be evaluated in inter-observer studies and the element of artificiality should be borne in mind when applying the findings to diagnostic practice. Nevertheless, the low level of agreement on the diagnosis of high-grade dysplasia achieved by certain pairings of specialist pathologists is a disturbing outcome of this study. Inaccuracies should be minimized by a concensus approach and we therefore recommend referral of putative cases of dysplasia to interested pathologists for further opinions. We would also advocate that pathologists faced with appearances which are indefinite between reactive atypia and dysplasia, would do better to describe them in terms of "atypia, significance uncertain', so that closer surveillance is undertaken, rather than force them into more precise diagnostic categories which may be incorrect.

Colitis, Ulcerative

Chemical basis of the electrophoretic variation observed at the alcohol dehydrogenase locus of Drosophila melanogaster.

The amino acid substitution responsible for the different electrophoretic mobility of the ADHs alleloenzyme and the ADHf alleloenzyme of the alcohol dehydrogenase from a Nigerian population of Drosophila melanogaster has been established as lysine (ADHs) for threonine (ADHf). This result is discussed with reference to the charge state model of electrophoretic variation, in conjunction with other know substitutions at this locus. It is concluded that electrophoretic methods should be capable of distinguishing many alleloenzymes which have identical isoelectric points without recourse to explanations involving conformational variability.

Alcohol Oxidoreductases

Comparison of four articular indices for use in clinical trials in rheumatoid arthritis: patient, order and observer variation.

Using a Latin square design, 4 patients were examined by 4 rheumatologists. Joints were scored for tenderness and inflammation. The Ritchie, the index of the American Rheumatism Association (ARA), the Hart modified Ritchie and a simplified Lansbury index were calculated from the raw data. The results suggest that an articular index consisting of a simple count of tender joints (Hart modified Ritchie) or a simple count of tender or swollen joints (ARA index) are the most reproducible with multiple observers. We suggest that these indices would be most appropriate for multicenter clinical trials.

Arthritis, Rheumatoid

Observer variation in assessing spinal curvature and skeletal development in adolescent idiopathic scoliosis.

Accurate measurements of spinal curvature and skeletal development are crucial in planning treatment and assessing curve progression in adolescent idiopathic scoliosis (AIS). An inter-rater agreement trial was undertaken to estimate the reliability of measuring these spinal parameters. Two orthopaedic surgeons and two trained technicians from a scoliosis clinic independently read 30 anteroposterior roentgenograms of AIS patients. Skeletal maturity was assessed using the six-point Risser sign scale, and spinal curvature was measured using the method of Cobb. Excellent agreement was observed in evaluating Risser signs (Kappa = 0.8) and primary Cobb angles (intra-class correlation coefficient, Rho = 0.98). The standard deviation of inter-observer error in measuring primary Cobb angles was 2.5 degrees, and the intra-reader error, based on one observer's reassessments of 15 films, was 1.9 degrees. Inter-rater agreement for assessing secondary Cobb angles was much lower (Rho = 0.52) because small curves (less than 20 degrees) were often not noticed. Differences in agreement between surgeons and technicians were relatively minor. These results indicate that personnel trained at this clinic are able to assess these spinal parameters reliably.

Adolescent

Observer variations in the diagnosis of stroke. WHO collaborative study on the control of stroke in the community.

Validity and consistency of the diagnosis of stroke and its types were tested with 60 case reports including 15 diguised duplicates, drawn at random from community-based stroke registers. Seven European, 5 Japanese, and 5 other centers participated the test. The diagnosis of stroke as such (regardless of its type) seems to have been established accurately in all the 3 groups of centers; this leads to the conclusion that the incidence rates of stroke as registered in the participating centers were comparable. The diagnosis of the types of stroke was less reliable, since intra-and inter-observer bias was found in the diagnosis of the identical sample of test cases. In some European centers, the type of stroke was rarely determined, unless objective and definitive evidences were available. The Japanese centers appeared to have diagnosed the type of stroke in a relatively more uniform way between centers, however, the consistency of the diagnosis at separate times was lower. Subarachnoid hemorrhage, when diagnosed, was generally based on firmer gounds. These observations were confirmed in a small number of autopsy-verified cases. These varying diagnostic attitudes introduce false differences. Such "softness" of type-diagnosis must be borne in mind when comparison of type of stroke at different times or between populations is attempted.

Cerebral Hemorrhage

Observer variation in histopathological diagnosis and grading of cervical intraepithelial neoplasia.

To assess the variability among histopathologists in diagnosing and grading cervical intraepithelial neoplasia eight experienced histopathologists based at different hospitals examined the same set of 100 consecutive colposcopic cervical biopsy specimens and assigned them into one of six diagnostic categories. These were normal squamous epithelium, non-neoplastic squamous proliferations, cervical intraepithelial neoplasia grades I, II, and III, and other. The histopathologists were given currently accepted criteria for diagnosing and grading cervical intraepithelial neoplasia and asked to mark their degree of confidence about their decision on a visual linear analogue scale provided. The degree of agreement between the histopathologists was characterised by kappa statistics, which showed an overall poor agreement (unweighted kappa 0.358). Agreement between observers was excellent for invasive lesions, moderately good for cervical intraepithelial neoplasia grade III, and poor for cervical intraepithelial neoplasia grades I and II (unweighted kappa 0.832, 0.496, 0.172, and 0.175, respectively); the kappa value for all grades of cervical intraepithelial neoplasia taken together was 0.660. The most important source of disagreement lay in the distinction of reactive squamous proliferations from cervical intraepithelial neoplasia grade I. The histopathologists were confident in diagnosing cervical intraepithelial neoplasia grade III and invasive carcinoma (other) but not as confident in diagnosing cervical intraepithelial neoplasia grades I and II and glandular atypia (other). Experienced histopathologists show considerable interobserver variability in grading cervical intraepithelial neoplasia and more importantly in distinguishing between reactive squamous proliferations and cervical intraepithelial neoplasia grade I. It is suggested that the three grade division of cervical intraepithelial neoplasia should be abandoned and a borderline category introduced that entails follow up without treatment.

Biopsy

Observer variation in the pathologic diagnosis of malignant lymphoma in Canada.

Biopsies from "poor prognosis" non-Hodgkin's lymphomas were studied to assess diagnostic variations among pathologists. The original diagnosis and the diagnoses of a nationwide panel of local reference pathologists (LRPs) from 104 cases were reviewed and the technical quality of each biopsy evaluated. Using a modified Rappaport classification, there was agreement in 57% of cases among the panel. This increased to 84% when diagnoses were grouped according to Working Formulation grades. Of the 90 cases in which a comparison of the contributing pathologist's diagnosis and the most common panel diagnosis was possible, there was exact agreement in 51% (kappa = 0.311) of cases and agreement regarding WF grade in 68% (kappa = 0.318). Major panel disagreements occurred in 26 (25%) cases, involving the distinction of metastatic anaplastic carcinoma or Hodgkin's disease from non-Hodgkin's lymphoma in 17 cases and follicular versus diffuse architecture in 16 (overlap present). The contributing pathologist had a major disagreement with the panel in 18 cases (20%), of type and frequency similar to those within the panel itself. Poor fixation (complete or partial) was present in 49 cases (47%); this resulted in significantly fewer majority agreements than in the well-fixed group (25% versus 60%, P = 0.020) and also increased rates of disagreement in the diagnosis of lymphoma versus anaplastic carcinoma. Thus improvements in the technical quality of biopsy material could further improve the diagnostic accuracy of lymphoma diagnosis.

Female

The pineal gland of the mole (Talpa europaea L.). II. Ultrastructural variations observed in the pinealocytes during different parts of the sexual cycle.

Changes of some ultrastructural parameters (paracrystalline structures, Golgi apparatus, secretory granules) in mole pinealocytes were quantitatively studied during the various phases of the sexual cycle. An increase in quantity of paracrystalline structures and of the Golgi appratuses was demonstrated during the period of high sexual activity in male pinealocytes and during oestrus, gestation and lactation in female pinealocytes. Moreover, the appearance of vacuoles in female pinealocytes was observed during pro-oestrus. These results seemto demonstrate close relationship between the endocrine activity of the hypophyseo-gonadal axis and the synthesis of some compounds by the pinealocytes. No increase in the quantity of secretory granules was observed during the various phases of the sexual cycle studied. Key words: pinealocytes, mole, sexual cycle, ultrastructure, paracrystalline structure.

Animals

Observer variation in the classification of mammographic parenchymal patterns.

Wolfe has described different cancer risks associated with a classification of four patterns of the breast parenchyma on mammography, but there is however little information available on the ability of radiologists to agree on the classification of the different patterns. We have assessed inter-rater agreement on the assignment of films to one of the four mammographic patterns described by Wolfe. One hundred xeromammograms were selected, copied and distributed to 10 radiologists who were experts in mammography. Films were classified according to the presence or absence of several radiological signs, according to diagnosis and recommendation, and according to mammographic pattern. Agreement was assessed after correction for agreement expected by chance, using the Kappa statistic. In general, high levels of agreement were found for the classification of mammographic pattern. Agreement on the classification of mammographic pattern was substantially greater than agreement for any other feature of mammographic interpretation, including diagnosis and recommendation.

Breast Neoplasms

Dysplasia and deoxyribonucleic acid aneuploidy in the assessment of precancerous changes in chronic ulcerative colitis. Observer variation and correlations.

Cancer prevention in patients with long-standing ulcerative colitis depends on the detection of epithelial dysplasia in colorectal biopsy specimens. Deoxyribonucleic acid analysis by flow cytometry has also been used to examine biopsy specimens, and might be a more quantitative method of detecting precancerous change. Histology and flow cytometry were used to analyze 333 paraffin blocks from colectomy specimens of 58 patients with extensive ulcerative colitis; 22 of these patients had developed carcinoma. Interobserver agreement between three experienced pathologists grading the sections was good for high-grade dysplasia and no dysplasia, but poor for low-grade and indefinite dysplasia. Deoxyribonucleic acid aneuploidy was easier to recognize than dysplasia and, as with dysplasia, it was found to be associated with patients who had developed carcinomas. The presence of deoxyribonucleic acid aneuploidy correlated with the presence of dysplasia. We believe that dysplasia is a useful marker of premalignant change and that flow cytometry may be useful as a complement to histologic examination when dysplasia is suspected.

Adult

Observer variation in the diagnosis of dysplasia in Barrett's esophagus.

The potential value of biopsy surveillance of patients with Barrett's esophagus for dysplasia is diminished by a lack of agreement on the diagnostic criteria for dysplasia. In a preliminary consensus conference, experienced gastrointestinal pathologists from four medical centers agreed on criteria for a five-tiered histologic classification of dysplasia in Barrett's esophagus--negative for dysplasia, indefinite for dysplasia, low-grade dysplasia, high-grade dysplasia, and intramucosal carcinoma. Eight morphologists in the four centers tested the criteria for interobserver agreement by examining a set of coded slides that had been chosen to include some especially difficult interpretative problems in all five histologic classifications. Interobserver agreement of 85 and 87% was achieved in successive reviews when the combined group of high-grade dysplasia and intramucosal carcinoma was compared with the combined group of low-grade dysplasia, indefinite for dysplasia, and negative for dysplasia. Comparison of other groups yielded less agreement. For example, negative for dysplasia could be distinguished from all other diagnoses with an interobserver agreement of 72%. We conclude that experienced gastrointestinal morphologists can diagnose high-grade dysplasia and intramucosal carcinoma with a high degree of agreement and thus can detect those patients who may need immediate rebiopsy or esophageal resection. Either further refinement of histologic criteria or alternate diagnostic methods will be needed to achieve the reproducible diagnosis of indefinite changes and low-grade dysplasia. This is important because patients with such changes theoretically merit closer endoscopic surveillance.

Barrett Esophagus