PubMed Health⌕ Search

Biomedical subjects

Douglas G Altman

Publications and source records attributed to Douglas G Altman.

At least 19 recordsLinked to original sources

Ghost authorship in industry-initiated randomised trials.

BACKGROUND: Ghost authorship, the failure to name, as an author, an individual who has made substantial contributions to an article, may result in lack of accountability. The prevalence and nature of ghost authorship in industry-initiated randomised trials is not known. METHODS AND FINDINGS: We conducted a cohort study comparing protocols and corresponding publications for industry-initiated trials approved by the Scientific-Ethical Committees for Copenhagen and Frederiksberg in 1994-1995. We defined ghost authorship as present if individuals who wrote the trial protocol, performed the statistical analyses, or wrote the manuscript, were not listed as authors of the publication, or as members of a study group or writing committee, or in an acknowledgment. We identified 44 industry-initiated trials. We did not find any trial protocol or publication that stated explicitly that the clinical study report or the manuscript was to be written or was written by the clinical investigators, and none of the protocols stated that clinical investigators were to be involved with data analysis. We found evidence of ghost authorship for 33 trials (75%; 95% confidence interval 60%-87%). The prevalence of ghost authorship was increased to 91% (40 of 44 articles; 95% confidence interval 78%-98%) when we included cases where a person qualifying for authorship was acknowledged rather than appearing as an author. In 31 trials, the ghost authors we identified were statisticians. It is likely that we have overlooked some ghost authors, as we had very limited information to identify the possible omission of other individuals who would have qualified as authors. CONCLUSIONS: Ghost authorship in industry-initiated trials is very common. Its prevalence could be considerably reduced, and transparency improved, if existing guidelines were followed, and if protocols were publicly available.

Authorship↗

The use of the World Wide Web by medical journals in 2003 and 2005: an observational study.

OBJECTIVES: The 2- to 6-page print journal article has been the standard for 200 years, yet this format severely limits the amount of detailed information that can be conveyed. The World Wide Web provides a low-cost option for posting extended text and supplementary information. It also can enhance the experience of journal editors, reviewers, readers, and authors through added functionality (eg, online submission and peer review, postpublication critique, and e-mail notification of table of contents.) Our aim was to characterize ways that journals were using the World Wide Web in 2005 and note changes since 2003. METHODS: We analyzed the Web sites of 138 high-impact print journals in 3 ways. First, we compared the print and Web versions of March 2003 and 2005 issues of 28 journals (20 of which were randomly selected from the 138) to determine how often articles were published Web only and how often print articles were augmented by Web-only supplements. Second, we examined what functions were offered by each journal Web site. Third, for journals that offered Web pages for reader commentary about each article, we analyzed the number of comments and characterized these comments. RESULTS: Fifty-six articles (7%) in 5 journals were Web only. Thirteen of the 28 journals had no supplementary online content. By 2005, several journals were including Web-only supplements in >20% of their papers. Supplementary methods, tables, and figures predominated. The use of supplementary material increased by 5% from 2% to 7% in the 20-journal random sample from 2003 to 2005. Web sites had similar functionality with an emphasis on linking each article to related material and e-mailing readers about activity related to each article. There was little evidence of journals using the Web to provide readers an interactive experience with the data or with each other. Seventeen of the 138 journals offered rapid-response pages. Only 18% of eligible articles had any comments after 5 months. CONCLUSIONS: Journal Web sites offer similar functionality. The use of online-only articles and online-only supplements is increasing.

Internet↗

The design of simulation studies in medical statistics.

Simulation studies use computer intensive procedures to assess the performance of a variety of statistical methods in relation to a known truth. Such evaluation cannot be achieved with studies of real data alone. Designing high-quality simulations that reflect the complex situations seen in practice, such as in prognostic factors studies, is not a simple process. Unfortunately, very few published simulation studies provide sufficient details to allow readers to understand fully all the processes required to design a simulation study. When planning a simulation study, it is recommended that a detailed protocol be produced, giving full details of how the study will be performed, analysed and reported. This paper details the important considerations necessary when designing any simulation study, including defining specific objectives of the study, determining the procedures for generating the data sets and the number of simulations to perform. A checklist highlighting the important considerations when designing a simulation study is provided. A small review of the literature identifies the current practices within published simulation studies.

Biomedical Research↗

Computed tomographic colonography: assessment of radiologist performance with and without computer-aided detection.

BACKGROUND & AIMS: In isolation, computer-aided detection (CAD) for computed tomographic (CT) colonography is as effective as optical colonoscopy for detection of significant adenomas. However, the unavoidable interaction between CAD and the reader has not been addressed. METHODS: Ten readers trained in CT but without special expertise in colonography interpreted CT colonography images of 107 patients (60 with 142 polyps), first without CAD and then with CAD after temporal separation of 2 months. Per-patient and per-polyp detection were determined by comparing responses with known patient status. RESULTS: With CAD, 41 (68%; 95% confidence interval [CI], 55%-80%) of the 60 patients with polyps were identified more frequently by readers. Per-patient sensitivity increased significantly in 70% of readers, while specificity dropped significantly in only one. Polyp detection increased significantly with CAD; on average, 12 more polyps were detected by each reader (9.1%, 95% CI, 5.2%-12.8%). Small- (< or =5 mm) and medium-sized (6-9 mm) polyps were significantly more likely to be detected when prompted correctly by CAD. However, overall performance was relatively poor; even with CAD, on average readers detected only 10 polyps (51.0%) > or =10 mm and 24 (38.2%) > or =6 mm. Interpretation time was shortened significantly with CAD: by 1.9 minutes (95% CI, 1.4-2.4 minutes) for patients with polyps and by 2.9 minutes (95% CI, 2.5-3.3 minutes) for patients without. Overall, 9 readers (90%) benefited significantly from CAD, either by increased sensitivity and/or by reduced interpretation time. CONCLUSIONS: CAD for CT colonography significantly increases per-patient and per-polyp detection and significantly reduces interpretation times but cannot substitute for adequate training.

Adenoma↗

From submission to publication: a retrospective review of the tables and figures in a cohort of randomized controlled trials submitted to the British Medical Journal.

STUDY OBJECTIVE: We characterize the quantity and quality of data tables and figures in reports of randomized controlled trials (RCTs) submitted to the British Medical Journal (BMJ) and published in peer-reviewed journals. We investigate how the peer review process affected table and figure quality. METHODS: We reviewed 62 consecutive reports of RCTs submitted to the BMJ in 2001 that were later published in the BMJ (n=12) or elsewhere. We counted and categorized the tables and figures in both the initial submissions and published articles. Using standardized instruments and procedures, we analyzed the quality of these tables and figures and checked BMJ editorial documents to see whether changes were triggered by their review process. RESULTS: The numbers of tables and figures did not change markedly between submission and publication. Five percent of publications had no data tables; 56% had no data figures. Data density was low for published tables and figures. Tables seldom showed data stratified on important covariates; 88% of published tables were simple lists or were stratified on only 1 variable. Less than half the figures met their data presentation potential, with most failing to portray by-subject data and few displaying advanced features such as pairing, symbolic dimensionality, or small multiples. BMJ external peer reviewers seldom commented on tables or figures. CONCLUSION: Tables and figures can convey details and complex relationships not easily described in text. Although tables are included in most submitted and published articles, they are not presented optimally; figures are used sparingly and are also of suboptimal quality. Journals should consider improving their table and figure quality in the hope that improved graphics will empower readers to scrutinize the data, thereby dissuading authors from presenting biased analyses and misrepresented conclusions.

Documentation↗

Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review.

OBJECTIVE: To determine whether the adoption of the CONSORT checklist is associated with improvement in the quality of reporting of randomised controlled trials (RCTs). DATA SOURCES: MEDLINE, EMBASE, Cochrane CENTRAL, and reference lists of included studies and of experts were searched to identify eligible studies published between 1996 and 2005. STUDY SELECTION: Studies were eligible if they (a) compared CONSORT-adopting and non-adopting journals after the publication of CONSORT, (b) compared CONSORT adopters before and after publication of CONSORT, or (c) a combination of (a) and (b). Outcomes examined included reports for any of the 22 items on the CONSORT checklist or overall trial quality. DATA SYNTHESIS: 1128 studies were retrieved, of which 248 were considered possibly relevant. Eight studies were included in the review. CONSORT adopters had significantly better reporting of the method of sequence generation (risk ratio [RR], 1.67; 95% CI, 1.19-2.33), allocation concealment (RR, 1.66; 95% CI, 1.37-2.00) and overall number of CONSORT items than non-adopters (standardised mean difference, 0.83; 95% CI, 0.46-1.19). CONSORT adoption had less effect on reporting of participant flow (RR, 1.14; 95% CI, 0.89-1.46) and blinding of participants (RR, 1.09; 95% CI, 0.84-1.43) or data analysts (RR, 5.44; 95% CI, 0.73-36.87). In studies examining CONSORT-adopting journals before and after the publication of CONSORT, description of the method of sequence generation (RR, 2.78; 95% CI, 1.78-4.33), participant flow (RR, 8.06; 95% CI, 4.10-15.83), and total CONSORT items (standardised mean difference, 3.67 items; 95% CI, 2.09-5.25) were improved after adoption of CONSORT by the journal. CONCLUSIONS: Journal adoption of CONSORT is associated with improved reporting of RCTs.

Editorial Policies↗

REporting recommendations for tumor MARKer prognostic studies (REMARK).

Despite years of research and hundreds of reports on tumor markers in oncology, the number of markers that have emerged as clinically useful is pitifully small. Often initially reported studies of a marker show great promise, but subsequent studies on the same or related markers yield inconsistent conclusions or stand in direct contradiction to the promising results. It is imperative that we attempt to understand the reasons that multiple studies of the same marker lead to differing conclusions. A variety of methodologic problems have been cited to explain these discrepancies. Unfortunately, many tumor marker studies have not been reported in a rigorous fashion, and published articles often lack sufficient information to allow adequate assessment of the quality of the study or the generalizability of study results. The development of guidelines for the reporting of tumor marker studies was a major recommendation of the National Cancer Institute-European Organisation for Research and Treatment of Cancer (NCI-EORTC) First International Meeting on Cancer Diagnostics in 2000. As for the successful CONSORT initiative for randomized trials and for the STARD statement for diagnostic studies, we suggest guidelines to provide relevant information about the study design, pre-planned hypotheses, patient and specimen characteristics, assay methods, and statistical analysis methods. In addition, the guidelines suggest helpful presentations of data and important elements to include in discussions. The goal of these guidelines is to encourage transparent and complete reporting so that the relevant information will be available to others to help them to judge the usefulness of the data and understand the context in which the conclusions apply.

Biomarkers, Tumor↗

Systematic reviews of diagnostic tests in cancer: review of methods and reporting.

OBJECTIVES: To assess the methods and reporting of systematic reviews of diagnostic tests. DATA SOURCES: Systematic searches of Medline, Embase, and five other databases identified reviews of tests used in patients with cancer. Of these, 89 satisfied our inclusion criteria of reporting accuracy of the test compared with a reference test, including an electronic search, and published since 1990. REVIEW METHODS: All reviews were assessed for methods and reporting of objectives, search strategy, participants, clinical setting, index and reference tests, study design, study results, graphs, meta-analysis, quality, bias, and procedures in the review. We assessed 25 randomly selected reviews in more detail. RESULTS: 75% (67) of the reviews stated inclusion criteria, 49% (44) tabulated characteristics of included studies, 40% (36) reported details of study design, 17% (15) reported on the clinical setting, 17% (15) reported on the severity of disease in participants, and 49% (44) reported on whether the tumours were primary, metastatic, or recurrent. Of the 25 reviews assessed in detail, 68% (17) stated the reference standard used in the review, 36% (9) reported the definition of a positive result for the index test, and 56% (14) reported sensitivity, specificity, and sample sizes for individual studies. Of the 89 reviews, 61% (54) attempted to formally synthesise results of the studies and 32% (29) reported formal assessments of study quality. CONCLUSIONS: Reliability and relevance of current systematic reviews of diagnostic tests is compromised by poor reporting and review methods.

Bias↗

[Constraints on publication rights in industry-initiated clinical trials--secondary publication].

In 22 of 44 industry-initiated clinical trial protocols from 1994-95, it was noted that the sponsor either owned the data or needed to approve the manuscript; another 18 protocols had other constraints. Furthermore, in 16 trials, the sponsor had access to accumulating data, and in an additional 16 trials the sponsor could stop the trial at any time, for any reason. These facts were not noted in any of the trial reports. We found similar constraints on publication rights in 44 protocols from 2004. This tight sponsor control over industry-initiated trials should be changed.

Clinical Trials Data Monitoring Committees↗

The content of medical journal Instructions for authors.

STUDY OBJECTIVE: We describe the general and statistical content of the Instructions for Authors of major medical journals. METHODS: This article reports on 2 observational studies. In study 1, we investigated the online versions of Instructions for Authors of 166 journals from 33 specialties for the presence of content about 15 methodologic and statistical topics. In study 2, we categorized the general content of the online versions of the Instructions for Authors of 35 medical journals. Two abstractors independently assigned the content into 18 categories and counted the total number of words devoted to each category. Interrater reliability of the classification was assessed. RESULTS: Less than half of the 166 Instructions for Authors in study 1 provided any guidance on statistical methods, and the majority failed to cite accepted publication standards such as the International Committee of Medical Journal Editors Uniform Guidelines or CONSORT. Only 13% of journals commented on the content and style of data tables and figures. The 35 Instructions for Authors in study 2 varied greatly in length (mean 3,308; median 2,283; range 885 to 18,927) and, with few exceptions, focused on formatting issues. Forty-three percent of Instructions offered no advice on scientific content, and only 5 journals devoted more than 10% of their words to scientific content. CONCLUSION: There is great heterogeneity among medical journal Instructions for Authors. Instructions provide little guidance about methodologic and statistical issues, and the advice provided is often contradictory among journals.

Guidelines as Topic↗

Polyp measurement and size categorisation by CT colonography: effect of observer experience in a multi-centre setting.

The extent measurement error on CT colonography influences polyp categorisation according to established management guidelines is studied using twenty-eight observers of varying experience to classify polyps seen at CT colonography as either 'medium' (maximal diameter 6-9 mm) or 'large' (maximal diameter 10 mm or larger). Comparison was then made with the reference diameter obtained in each patient via colonoscopy. The Bland-Altman method was used to assess agreement between observer measurements and colonoscopy, and differences in measurement and categorisation was assessed using Kruskal-Wallis and Chi-squared test statistics respectively. Observer measurements on average underestimated the diameter of polyps when compared to the reference value, by approximately 2-3 mm, irrespective of observer experience. Ninety-five percent limits of agreement were relatively wide for all observer groups, and had sufficient span to encompass different size categories for polyps. There were 167 polyp observations and 135 (81%) were correctly categorised. Of the 32 observations that were miscategorised, 5 (16%) were overestimations and 27 (84%) were underestimations (i.e. large polyps misclassified as medium). Caution should be exercised for polyps whose colonographic diameter is below but close to the 1-cm boundary threshold in order to avoid potential miscategorisation of advanced adenomas.

Chi-Square Distribution↗

CT colonography interpretation times: effect of reader experience, fatigue, and scan findings in a multi-centre setting.

Our purpose was to assess the effect of reader experience, fatigue, and scan findings on interpretation time for CT colonography. Nine radiologists (experienced in CT colonography); nine radiologists and ten technicians (both groups trained using 50 validated examinations) read 40 cases (50% abnormal) under controlled conditions. Individual interpretation times for each case were recorded, and differences between groups determined. Multi-level linear regression was used to investigate effect of scan category (normal or abnormal) and observer fatigue on interpretation times. Experienced radiologists (mean time 10.9 min, SD 5.2) reported significantly faster than less experienced radiologists and technicians; odds ratios of reporting times 1.4 (CI 1.1, 1.8) and 1.6 (1.3, 2.0), respectively (P<or=0.001). Experienced and less-experienced radiologists took longer to report abnormal cases; ratio 1.2 (CI 1.1,1.4, P<0.001) and 1.2 (1.0, 1.3, P=0.03), respectively. All groups took 70% as long to report the final five cases as they did with an initial five; ratio 0.7 (CI 0.6 to 0.8), P<0.001. For technicians only, accuracy increased with longer reporting times (P=0.04). Experienced radiologists report faster than do less-experienced observers and proportionally spend less time interpreting normal cases. Technicians who report more slowly are more accurate. All groups reported faster as the study period progressed.

Clinical Competence↗

Protocol for the Arterial Revascularisation Trial (ART). A randomised trial to compare survival following bilateral versus single internal mammary grafting in coronary revascularisation [ISRCTN46552265].

BACKGROUND: Standard coronary artery bypass graft surgery uses a single internal mammary artery and supplemental vein or radial artery grafts. Several observational studies have suggested a survival benefit with two internal mammary artery grafts compared to a single internal mammary artery graft, but this has not been tested in a randomised trial. The Arterial Revascularisation Trial is a Medical Research Council and British Heart Foundation funded, multi-centre international trial comparing single internal mammary artery grafting versus bilateral internal mammary artery grafting. METHODS/DESIGN: Twenty centres in the UK, Australia, Poland and Brazil are planning to randomise 3000 coronary artery bypass graft surgery patients to single or bilateral internal mammary artery grafting. Supplemental grafts may be either saphenous vein or radial artery. Coronary artery bypass grafting can be performed as an on-pump or off-pump procedure. The primary outcome is survival at 10 years and secondary end-points include clinical events, quality of life and cost effectiveness. The effect of age, left ventricular function, diabetes, number of grafts, vein grafts and off-pump surgery are pre-specified subgroups. DISCUSSION: The Arterial Revascularisation Trial is one of the first randomised trials to evaluate the effects on survival and other clinical outcomes of single internal mammary artery grafting versus bilateral internal mammary artery grafting, and will help to establish the best approach for patients requiring coronary artery bypass graft surgery.

Journal Article↗

Lead editorial: trials - using the opportunities of electronic publishing to improve the reporting of randomised trials.

This editorial introduces the new online, open access, peer-reviewed journal Trials. The journal considers manuscripts on any aspect of the design, performance, and findings of randomised controlled trials in any discipline related to health care, and also encourages the publication of protocols. Trialists will be able to provide the necessary detail for a true and complete scientific record. They will be able to communicate not only all outcome measures, as well as varying analyses and interpretations, but also in-depth descriptions of what they did and honest reflections about what they learnt. Trials also encourages articles covering generic issues related to trials, for example focussing on the design, conduct, analysis, interpretation, or reporting.

Editorial↗

Reporting of noninferiority and equivalence randomized trials: an extension of the CONSORT statement.

The CONSORT (Consolidated Standards of Reporting Trials) Statement, including a checklist and a flow diagram, was developed to help authors improve their reporting of randomized controlled trials. Its primary focus was on individually randomized trials with 2 parallel groups that assess the possible superiority of one treatment compared with another but is now being extended to other trial designs. Noninferiority and equivalence trials have methodological features that differ from superiority trials and present particular difficulties in design, conduct, analysis, and interpretation. Although the rationale for such trials occurs frequently, those designed and described specifically as noninferiority or equivalence trials appear less commonly in the medical literature. The quality of reporting of those that are published is often inadequate. In this article, we present an adapted CONSORT checklist for reporting noninferiority and equivalence trials and provide illustrative examples and explanations for those items amended from the original CONSORT checklist. The intent is to improve reporting of noninferiority and equivalence trials, enabling readers to assess the validity of their results and conclusions.

Publishing↗