PubMed Health⌕ Search

PubMed · 15020562

Which data source in clinical performance assessment? A pilot study comparing self-recording with patient records and observation.

Abstract

OBJECTIVE: A pilot study aimed to determine the extent to which each of three data sources could provide complete and reliable data for valid assessment of clinical performance. DESIGN: Clinical decisions taken in 168 consultations by seven family physicians were reviewed against guidelines for 15 clinical conditions. In total, 206 criteria were reviewed using three sources: medical records, observation in surgery, and structured self-recording by the physicians. SETTING AND PARTICIPANTS: Seven family practices in the Netherlands. MAIN MEASURE: Scores (%) of data recorded/total were obtained for each method. Kappa scores for the agreement between the three data sources were also obtained. RESULTS: Medical record examination provided 40%, observation 72%, and physician self-recording 95% of the data required for the review against guidelines. Nine per cent of the clinical decisions could be reviewed when using medical records, 46% when using observation data, and 69% when using data from prospective self-recording. In particular, decisions in the area of patient education and diagnostic examinations could not be reviewed validly using medical records only. Kappa agreements between the data available from the three sources as well as between the review results appeared to be 0.79. CONCLUSIONS: Medical records alone only supply sufficient information for the review of a very limited set of clinical decisions. Physician self-recording has significantly more potential for valid review of a broad range of clinical decisions. Furthermore, self-recording seems a reliable data collection method that deserves further research.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Teun H Spies, Henk G A Mokkink, Pieter F De Vries Robbé, Richard P T M Grol. 2004. Which data source in clinical performance assessment? A pilot study comparing self-recording with patient records and observation.. https://doi.org/10.1093/intqhc%2Fmzh001

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

The feasibility of three-dimensional displays of the thorax for preoperative planning in the surgical treatment of lung cancer.

OBJECTIVE: Three-dimensional (3D) displays of anatomic structures have become feasible for preoperative planning in some surgical procedures. There have been no reports, however, on the use of 3D displays for surgical treatment of lung cancer. We hypothesized that 3D displays of the thorax are useful for preoperative planning for lung cancer. METHODS: Based on virtual reality technologies, we rendered 3D displays of the thorax from two-dimensional (2D) computed tomographic (CT) images of six anonymous patients, some of whom underwent surgical removal of lung cancer. For determining the resectability of lung cancer, we tested 17 participants with varying degrees of surgical skills to view 3D displays and read 2D CT images of these thoracic cavities in a randomized order. We measured their performance in terms of the accuracy of predicted resectability, the confidence of their prediction, planning time used, and workload experienced. RESULTS: The results demonstrated that viewing 3D displays of thoracic cavities has significant advantages over reading 2D CT images in determining the resectability of lung cancer: increasing the accuracy of predicted resectability by about 20%, enhancing the confidence of the prediction by about 20%, decreasing planning time by about 30%, and reducing workload by about 50%. All participants preferred viewing 3D displays to reading 2D CT images for preoperative planning. Junior residents found 3D displays of thoraces more useful than senior residents. CONCLUSIONS: It is feasible to use 3D displays of the thorax for preoperative planning in treating lung cancer. Using 3D displays in surgical treatment of lung cancer has potential benefits, once the technique is perfected.

Clinical Competence↗

The learning curve in the training of percutaneous nephrolithotomy.

OBJECTIVES: To investigate the learning curve in the training of percutaneous nephrolithotomy (PCNL). METHODS: A total of 104 PCNL cases were included in this evaluation to define the learning curve of a surgeon with no previous experience at performing solo PCNL. Two parameters of expertise were reviewed, namely the operation and fluoroscopic screening times. The operation time was calculated as the beginning of access with the needle until the nephrostomy tube was placed and secured. PCNL procedures were analyzed in seven sets of 15 cases regarding the operation and fluoroscopy times, stone size, stone clearance rate, blood transfusion rate, and estimated blood loss. RESULTS: The mean operation time was 2.4 h for the first 15 patients. It decreased to a mean of 1.5 h for cases 46 through 60. No further decrease in the operation time was observed after case 60. The fluoroscopic screening time was a peak of 17.5 min in the first 15 cases, whereas it dropped to a mean of 8.9 min for cases 46 through 60. The decline in the mean fluoroscopy screening time continued in cases 61 to 104, but the decline was not significant. There was no significant difference in stone size, stone clearance rate, blood transfusion rate, and estimated blood loss among each set of cases. CONCLUSIONS: This study suggests that the surgical competence in PCNL can be reached after 60 cases. PCNL and fluoroscopy times drop to a steady-state level after performing 60 procedures.

Clinical Competence↗

Critical overview of the management of neonatal jaundice in the UK.

AIM: To determine the current management of early neonatal jaundice in the UK and to evaluate whether the current practices are evidence based. METHODS: A questionnaire survey was carried out among identified lead paediatricians of neonatal intensive care units. RESULTS: The survey found markedly differing practices for the recognition, investigation and treatment of neonatal jaundice. This applies particularly to confirmation of the clinical suspicion of jaundice; use of invasive and non-invasive technologies for diagnosis; preferred wavelength and intensity of light used for treatment; and whether birth weight, gestational age and postnatal age should influence treatment. CONCLUSION: The study found a lack of consistency in the management of jaundiced infants in the UK. The evidence-based practice currently available does not appear to have been incorporated into treatment protocols.

Clinical Competence↗