SEARCH · PubMed Health

Results for “Observer Variation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2Linked to original sources

PubMed1990

Observer variation in the assessment of scintigraphy of the thyroid gland.

In order to determine observer variation in the assessment of thyroid scintigrams two specialists in nuclear medicine and two specialists in endocrinology independently evaluated 240 thyroid pertechnetate scintigrams twice, and assessed a number of variables concerning size and isotope uptake. The observed agreement between pairs of observers for the variables ranged from 0.70 to 0.98. By the use of the kappa coefficient the observed agreement was adjusted for change agreement. Kappa can variate from -1 (total disagreement) to +1 (perfect agreement). Kappa values between 0.29 and 0.86 were found. In the intraobserver study the observed agreement ranged from 0.83 to 0.99 resulting in kappa coefficients between 0.53 and 0.96. Thus the level of agreement in the present study was "fair to substantial" for agreement in the interobserver part and "substantial to almost perfect" for agreement in the intraobserver part. No difference was found in the level of agreement between the nuclear specialists and the endocrinologists. Although the treatment of patients is based on knowledge of the case histories and clinical and laboratory findings the high degree of observer variation may lead to misclassification of a number of patients with thyroid disease and subsequently a less optimal choice of treatment.

Adolescent↗

PubMed1991

Observer variation in the clinical assessment of the thyroid gland.

In order to evaluate the reliability of clinical assessment of the thyroid gland, two specialists in endocrinology and two younger doctors independently examined 53 patients twice, and assessed whether they had a diffuse goitre, a multinodular goitre, a solitary nodule or a normal gland. In 30% of the patients all four observers were in agreement, whereas in 47% and 23% of the patients, two and three different diagnoses were given, respectively. Inter-observer variation was determined and kappa values between -0.04 and 0.54 were found. Intra-observer variation was smaller, revealing kappa values between 0.44 and 1.00. The present study suggests that clinical assessment of the thyroid gland may lead to misclassification of the type of thyroid disease, and thereby to a less than optimal choice of therapy.

Adult↗

PubMedDate not supplied

Observer variation in interpreting radiographs of the pituitary fossa.

Observer variation in interpreting sellar radiographs in patients suspected or known to have a pituitary tumor has been examined. Two radiologists experienced in interpreting sellar radiographs examined independently, without clinical details, plain films and tomograms of the sella of 101 patients. In most, only minor changes were anticipated. Of the 93 female patients, 67 were under investigation for amenorrhea. Radiographs were examined four times, each radiologist examining each set twice. Appearances were classified as normal, doubtful or abnormal on each occasion. Overall intraobserver agreement was 76%--85%. Neither radiologist changes his opinion by more than one category, e.g. from normal to doubtful. Overall interobserver agreement was 63%--75%. Disagreement between observers concerning 11 (11%) of the patients resulted from differences of opinion about whether minor changes in sellar outline represented an abnormality or merely a normal variation. Kappa analysis suggested that much of the agreement may be ascribed to chance. Agreement rates resemble those for other clinical and radiological investigations.

Adolescent↗

PubMed1990

Observer variation in equine abdominal auscultation.

The reliability of abdominal auscultation was investigated via an observer variation study. Clinicians listened to a variety of minute-long equine gut sound recordings. They evaluated the amount of gut sounds as 'absent', 'decreased', 'normal', or 'increased'. They subsequently evaluated the same recordings replayed in a different order. Intra- and inter-observer agreement was measured by the statistic kappa. There was significant intra-observer (kappa 0.57) agreement, but less agreement between observers (kappa 0.37). The best agreement was on the classification of sound tracks as 'absent' (intra-observer kappa 0.72 and inter-observer kappa 0.55). There was significant correlation between the clinicians' average assessment of the recordings and their acoustic energy levels. In this study abdominal noise was reliably assessed by auscultation. Standardised techniques and definitions would probably enhance the reliability of abdominal auscultation for the evaluation of gastrointestinal disease.

Abdominal Pain↗

PubMed1986

Observer variation in the detection of osteopenia.

In order to determine observer variation in the detection of osteopenia, 15 pairs of lateral chest radiographs obtained within two weeks of each other were reviewed separately by two radiologists and one orthopedist on three separate occasions. Intra- and interobserver variations were calculated for each individual film and film pairs using Kappa values. The individual observers were not able to give consistent readings on the same film on different days (average Kappa = 0.54). When the additional factors of repeat films (average kappa = 0.47), or separate observers (average Kappa = 0.38) were analyzed, agreement was even worse. The identification of osteopenia from the lateral view of the thoracic spine is highly subjective and variable from film to film and observer to observer.

Humans↗

PubMed1990

[Observer variation of the radiographic assessment of pulmonary changes caused by asbestos].

Assessment was undertaken of 165 x-ray photographs of the thorax originating from 165 men with varying degrees of exposure to asbestos: 37 were workers in an eternite factory, 65 insulation workers, 42 were plumbers and 21 were patients from the Lung Clinic in Bispebjerg Hospital. Assessment of the x-rays was carried out according to the directives established by the International Workers' Organisation (ILO) by three experienced specialists who had no knowledge of the individual person's exposure to asbestos or smoking habits. In order to investigate not only inter- but also intra observer variation, the three medical specialists described the material on two occasions with an interval of several days. Analysis of the descriptions revealed that there was considerable inter- and intra-observer variation in assessment of the changes caused by asbestos. Description of the parenchymatous changes was associated with slightly greater variation than description of the pleural changes. A partial analysis of smokers who had not had occupational exposure to asbestos showed a not inconsiderable occurrence (5-33%) of parenchymatous changes which could not be differentiated from changes caused by asbestos. It is concluded, that the diagnosis of pulmonary disease caused by asbestos should not be based on radiographic examination alone.

Adolescent↗

PubMed1991

Clinical assessment of ankylosing spondylitis: a study of observer variation in spinal measurements.

Twenty-two measurements repeated non-sequentially on each of 10 patients by five observers were undertaken to determine their reliability for routine clinical use. Measurements without significant inter-observer variation or with a coefficient of reliability greater than 0.70 were cervical rotation, cervical lateral flexion, tragus to wall distance, fingertip to floor distance on sagittal and lateral flexion, C7 to iliac crest line distraction and modified Schober index. It is concluded that many of the currently used measurements are either statistically unreliable or clinically unhelpful in mild or moderate ankylosing spondylitis. The most clinically useful were cervical rotation using a protractor, cervical lateral flexion using a goniometer, thoracolumbar flexion as the C7 to iliac crest line distraction, thoracolumbar lateral flexion as the fingertip to floor distance and the modified Schober index.

Adult↗

PubMed1990

Inter-observer variation in decision-making regarding patients on chronic hemodialysis: a study using the kappa index.

To examine inter-observer variation in the monitoring of patients with chronic disease, four nephrologists independently assessed 62 patients on maintenance hemodialysis. Deviation from normal was determined for adequacy of dialysis, protein intake, and metabolic state. The kappa-index, which allows to adjust for chance agreement, was used to analyze each monitoring diagnosis. Low agreement was found on decisions concerning adequacy of dialysis (kappa 0.12-0.26), while agreement was higher about protein intake (kappa 0.21-0.46), and metabolic state (kappa 0.24-0.52). Two physicians classified no patient as overdialyzed, while 16-18% were thus categorized by the other two. Routines for review of recent medical history also differed significantly between the physicians. Measures are needed to increase the reliability of decisions regarding the monitoring of chronic hemodialysis. A long lasting physician-patient relationship is not a sufficient prerequisite for diminishing decision variation. Medical audit as part of the clinical routine, and use of additional sources of information, exemplified by urea kinetic modeling, are discussed.

Adult↗

PubMed1992

Intra- and inter-observer variation of optic nerve head measurements in glaucoma suspects using disc-data.

The aim of this study was to determine the intra- and inter-observer variation in the use of a system designed for exact measurements from standard optic nerve head photographs. The commercially available system consisted of a colour CCD Videocamera, a dedicated frame grabber and customized software run on a IBM AT compatible computer. Masked measurements were made 3 times by 2 observers, from stereophotographs of the optic nerve head of 56 eyes from 30 glaucoma suspects. The cup was defined on the basis of contour, not pallor and the disc area was defined as the area inside Elschnig's ring. Intra-observer variances were 0.001 +/- 0.001 mm2 for cup area (mean +/- SD), 0.002 +/- 0.002 mm2 for disc area and 0.002 +/- 0.003 mm2 for rim area. These values for intra-observer variance were comparable with the results obtained using manual planimetric techniques. Intra-observer variance for disc area was significantly larger for the less trained of the two experienced observers. Inter-observer variances were 0.004 +/- 0.009 mm2 for cup area, 0.008 +/- 0.013 mm2 for disc area and 0.009 +/- 0.014 mm2 for rim area. These inter-observer variances were significantly larger than those previously reported for manual planimetry. The absolute differences between the two observers ranged from -0.35 to +0.20 mm2 (-0.08 +/- 0.11 mm2) for cup area, from -0.38 to +0.15 mm2 (-0.08 +/- 0.11 mm2) for disc area and from -0.29 to +0.34 mm2 (-0.06 +/- 0.12 mm2) for rim area.(ABSTRACT TRUNCATED AT 250 WORDS)

Adult↗

PubMed1979

Palpatory estimation of liver size. Within- and between-observer variation.

A study based upon 23 patients revealed substantial within- and between-observer variation, when 14 senior and junior surgeons under blindfold conditions were requested to measure the distance from the thoracic cage to the lower border of the liver in the midclavicular and midsternal lines. Clinical decisions should accordingly not rely heavily upon a palpatory estimate of liver size.

Adult↗

PubMed1986

Observer variation in the echocardiographic diagnosis of mitral valve prolapse.

To assess inter- and intraobserver variation in the echocardiographic diagnosis of mitral valve prolapse, three independent observers analyzed M-mode echocardiograms (n = 80) and two-dimensional echocardiograms (n = 65) of patients with a mobile midsystolic click with or without a late or holosystolic murmur. In addition, a control group of 100 normal echocardiograms were interspersed among the echocardiograms of patients with mitral valve prolapse and were then interpreted. Each of the three observers analyzed all M-mode and two-dimensional echocardiograms initially and then 2 weeks later for the presence or absence of mitral valve prolapse. M-mode echocardiographic criteria for mitral valve prolapse consisted of late systolic posterior motion (greater than or equal to 3 mm) of one or both mitral leaflets or holosystolic hammocking (greater than or equal to 3 mm) of one or both mitral leaflets. Two-dimensional echocardiographic criteria for mitral valve prolapse consisted of: posterior systolic arching of one or both mitral leaflets in the parasternal long-axis view, and/or posterior systolic bowing of one or both mitral leaflets in the apical four-chamber view posterior to the plane of the mitral anulus, and/or excessive posterior coaptation of the mitral leaflets in either view flush with or posterior to the plane of the mitral anulus. There was insignificant observer variation both in the M-mode and two-dimensional echo groups, as determined using Cochran's Q test.(ABSTRACT TRUNCATED AT 250 WORDS)

Adult↗

PubMed1990

Global assessment of patients--a bedside study. II. Inter-observer variation and frequency of clinical findings.

Three physicians independently assessed 201 hospital in-patients for the presence of 10 basic physical characteristics, and made an overall assessment of whether or not the patients appeared ill. There were significant differences between the physicians in the average number of observations recorded for each patient (P less than 0.001). There was a significant difference (P less than 0.05) between the physicians regarding the number of positive diagnoses of anaemia, abnormal nutritional state, breathing difficulties and the overall assessment. Inter-observer variation was estimated by a pairwise comparison of the three physicians. Overall agreement rates ranged from 0.65 for abnormal nutritional state to 0.99 for presence of pain. After adjusting for random agreement, kappa values between 0.09 (elevated body temperature) and 0.88 (consciousness impaired) were found. No tendency towards a higher level of agreement in the overall assessment than in the basic findings was observed.

Diagnosis↗

PubMed1975

The definition of radiological signs in gastric ulcer and assessment of their validity by inter-observer variation study.

The initial aim was to program a computer with information on the frequency of radiological signs in benign and malignant gastric ulcers in order to obtain a percentage probability of benignancy or malignancy in succeeding ulcers in clinical practice. However, only four of the many signs described in gastric ulcer were confirmed to be of validity (i.e. reliable existence) by an inter-observer variation study using two observers and the films from 69 barium meal examinations. These were projection or non-projection of the in-profile ulcer, presence or absence of adjacent mucosal folds, good or poor definition of the in-face ulcer's edge, and extension of radiating folds to the in-face ulcer's edge. A few more remained unassessed due to insufficient numbers of relevant cases. It is condluced that: as defined in the literature the majority of radiological signs in this field are of uncertain existence; and the four that were found to be valid do not fully describe the important appearances that may be seen in benign and malignant ulcers and would be inadequate to differentiate them to a sufficiently high degree of probability.

Diagnosis, Computer-Assisted↗

PubMed1979

Sampling error and observer variation in the interpretation of esophageal biopsies.

Esophageal autopsy specimens from 11 subjects were used to determine observer variation and sampling error in assessing alterations attributed to gastroesophageal reflux. Inter- and intraobserver variation exceeded 20% even when the diagnosis was limited to a normal and abnormal reading. Marked differences in basal cell thickness but not in papillary height occurred when specimens were obtained from different levels of the lower esophagus. The differences were less marked in specimens obtained from the same level. Based on these data the reliability of basal cell thickness and papillary height as an index of gastroesophageal reflux appears limited.

Autopsy↗

PubMed1990

Observer variation in mammary thermography: results of a teaching file test carried out in four different centers.

To evaluate observer variation in mammary thermography, a teaching file test of 159 thermographies was worked out by 4 senology centers. The evaluation of accuracy and the K index of variability demonstrated a significant variability among centers. The reliability of thermography in senology seems to be too poor for it to be able to direct any therapeutic decision, either diagnostic or prognostic.

Breast Neoplasms↗

PubMed1990

Observer variation in the radiological measurement of the anorectal angle.

Determination of the anorectal angle (ARA) and the position of the pelvic floor is, theoretically, very important in understanding the mechanisms of anorectal continence and defaecation. The variability in the measurement of the ARA was analyzed. Nine experts drew ther rectal axis either as a line along the posterior wall of the distal rectum or as the central axis of the rectal lumen on the outlines of 18 representative proctographic images. The standard deviations and ranges of the mean values of each ARA were comparable but large in both methods. On average, the S.D. was 8 degrees and the range value about 23 degrees. Inter-observer variation was not related to the magnitude of the ARA, but rather to the anorectal configuration. Drawing a line along the posterior distal rectal wall is difficult when it is irregular or when the puborectalis impression is indistinct. The central rectal axis is difficult to draw when the junction between the upper and lower rectum is ill defined or when the outlines of the distal rectum are asymmetric e.g. by the presence of a rectocele. Thus, the variability of both methods was not strongly interrelated (r = 0.68 for the median values). It is concluded that, in general, radiologic assessment of the ARA is not reliable enough for comparative investigation of the dynamics of the anorectum.

Anal Canal↗

PubMed1978

Observer variation in histologic classification of thyroid cancer.

Histologic slides of 696 cases of thyroid cancer reported to the national cancer registries of Finland, Iceland, Norway and Sweden were reviewed by 5 Nordic pathologists in order to determine the observer variation between the pathologists, as well as the reproducibility of the WHO classification of thyroid tumours. In 58% of the cases all observers agreed upon the diagnosis and in 82% at least three of them agreed. The observer disagreement was lowest for papillary carcinoma (7%) and highest for follicular carcinoma (27%). The corresponding figures for anaplastic and medullary carcinomas were 18% and 23%, respectively. The most common diverging diagnosis for cases finally interpreted as papillary carcinoma was follicular carcinoma, and for cases finally interpreted as follicular carcinoma, a benign thyroid lesion. The results of the present study clearly indicate the necessity of having all cases reviewed by the same pathologist or group of pathologists in order to obtain reliable results for comparative studies.

Adenocarcinoma↗

PubMed1989

Observer variation in histological grading of breast cancer.

A multicentre study was conducted to assess the degree of agreement between pathologists grading breast tumours using the WHO criteria. Satisfactory correlation of grades was found to occur with observer variation of 21.9% on 874 tumours.

Breast Neoplasms↗