PubMed Health⌕ Search

Biomedical subjects

Nicholas J Barrowman

Publications and source records attributed to Nicholas J Barrowman.

10 recordsLinked to original sources
PubMed2006

An alternative to the hand searching gold standard: validating methodological search filters using relative recall.

BACKGROUND: Search filters or hedges play an important role in evidence-based medicine but their development depends on the availability of a "gold standard"--a reference standard against which to establish the performance of the filter. We demonstrate the feasibility of using relative recall of included studies from multiple systematic reviews to validate methodological search filters as an alternative to validation against a gold standard formed through hand searching. METHODS: We identified 105 Cochrane reviews that used the Highly Sensitive Search Strategy (HSSS), included randomized or quasi-randomized controlled trials, and reported their included studies. We measured the ability of two published and one novel variant of the HSSS to retrieve the MEDLINE-index studies included in these reviews. RESULTS: The systematic reviews were comprehensive in their searches. 72% of included primary studies were indexed in MEDLINE. Relative recall of the three strategies ranged from .98 to .91 across all reviews and more comprehensive strategies showed higher recall. CONCLUSION: An approach using relative recall instead of a hand searching gold standard proved feasible and produced recall figures that were congruent with previously published figures for the HSSS. This technique would permit validation of a methodological filter using a collection of approximately 100 studies of the chosen design drawn from the included studies of multiple systematic reviews that used comprehensive search strategies.

Abstracting and Indexing↗
PubMed2006

Can electronic search engines optimize screening of search results in systematic reviews: an empirical study.

BACKGROUND: Most electronic search efforts directed at identifying primary studies for inclusion in systematic reviews rely on the optimal Boolean search features of search interfaces such as DIALOG and Ovid. Our objective is to test the ability of an Ultraseek search engine to rank MEDLINE records of the included studies of Cochrane reviews within the top half of all the records retrieved by the Boolean MEDLINE search used by the reviewers. METHODS: Collections were created using the MEDLINE bibliographic records of included and excluded studies listed in the review and all records retrieved by the MEDLINE search. Records were converted to individual HTML files. Collections of records were indexed and searched through a statistical search engine, Ultraseek, using review-specific search terms. Our data sources, systematic reviews published in the Cochrane library, were included if they reported using at least one phase of the Cochrane Highly Sensitive Search Strategy (HSSS), provided citations for both included and excluded studies and conducted a meta-analysis using a binary outcome measure. Reviews were selected if they yielded between 1000-6000 records when the MEDLINE search strategy was replicated. RESULTS: Nine Cochrane reviews were included. Included studies within the Cochrane reviews were found within the first 500 retrieved studies more often than would be expected by chance. Across all reviews, recall of included studies into the top 500 was 0.70. There was no statistically significant difference in ranking when comparing included studies with just the subset of excluded studies listed as excluded in the published review. CONCLUSION: The relevance ranking provided by the search engine was better than expected by chance and shows promise for the preliminary evaluation of large results from Boolean searches. A statistical search engine does not appear to be able to make fine discriminations concerning the relevance of bibliographic records that have been pre-screened by systematic reviewers.

Abstracting and Indexing↗
PubMed2006

A systematic review identifies a lack of standardization in methods for handling missing variance data.

BACKGROUND AND OBJECTIVES: To describe and critically appraise available methods for handling missing variance data in meta-analysis (MA). METHODS: Systematic review. MEDLINE, EMBASE, Web of Science, MathSciNet, Current Index to Statistics, BMJ SearchAll, The Cochrane Library and Cochrance Colloquium proceedings, MA texts and references were searched. Any form of text was included: MA, method chapter, or otherwise. Descriptions of how to implement each method, the theoretic basis and/or ad hoc motivation(s), and the input and output variable(s) were extracted and assessed. Methods may be: true imputations, methods that obviate the need for a standard deviation (SD), or methods that recalculate the SD. RESULTS: Eight classes of methods were identified: algebraic recalculations, approximate algebraic recalculations, imputed study-level SDs, imputed study-level SDs from nonparametric summaries, imputed study-level correlations (e.g., for change-from-baseline SD), imputed MA-level effect sizes, MA-level tests, and no-impute methods. CONCLUSION: This work aggregates the ideas of many investigators. The abundance of methods suggests a lack of consistency within the systematic review community. Appropriate use of methods is sometimes suspect; consulting a statistician, early in the review process, is recommended. Further work is required to optimize method choice to alleviate any potential for bias and improve accuracy. Improved reporting is also encouraged.

Data Interpretation, Statistical↗
PubMed2005

Cognitive changes in children treated for acute lymphoblastic leukemia with chemotherapy only according to the Pediatric Oncology Group 9605 protocol.

The purpose of this study was to examine cognitive functioning and neuroimaging in children with leukemia treated with the Pediatric Oncology Group 9605 protocol at the Children's Hospital of Eastern Ontario. Mean age at diagnosis was 4.88 +/- 2.54 years. The mean (n = 24) Wechsler Verbal and Performance IQ fell in the low-average range (87.33 +/- 15.69 and 84.83 +/- 19.11, respectively). Mean (n = 20) Verbal and Visual Memory Indexes of 82.95 +/- 15.46 and 88.30+/- 10.80, respectively, were obtained. The proportion of scores on measures of intelligence and memory falling > 1 SD below the normative mean was substantially higher than expected. Paired t-test suggested that Wechsler Verbal IQ and memory remained stable, whereas Wechsler Performance IQ declined significantly. The results of growth curve analyses replicated these findings and suggested a significant adverse effect of cumulative dosage of intrathecal methotrexate on estimated Wechsler Performance IQ. Although only two children experienced seizures, 78% of the group showed leukoencephalopathy on at least one magnetic resonance image. Reliance on seizures as a predictor of leukoencephalopathy might underestimate the incidence of neurotoxicity.

Anti-Inflammatory Agents↗
PubMed2003

Identifying null meta-analyses that are ripe for updating.

BACKGROUND: As an increasingly large number of meta-analyses are published, quantitative methods are needed to help clinicians and systematic review teams determine when meta-analyses are not up to date. METHODS: We propose new methods for determining when non-significant meta-analytic results might be overturned, based on a prediction of the number of participants required in new studies. To guide decision making, we introduce the "new participant ratio", the ratio of the actual number of participants in new studies to the predicted number required to obtain statistical significance. A simulation study was conducted to study the performance of our methods and a real meta-analysis provides further evidence. RESULTS: In our three simulation configurations, our diagnostic test for determining whether a meta-analysis is out of date had sensitivity of 55%, 62%, and 49% with corresponding specificity of 85%, 80%, and 90% respectively. CONCLUSIONS: Simulations suggest that our methods are able to detect out-of-date meta-analyses. These quick and approximate methods show promise for use by systematic review teams to help decide whether to commit the considerable resources required to update a meta-analysis. Further investigation and evaluation of the methods is required before they can be recommended for general use.

Computer Simulation↗
PubMed2003

Should meta-analysts search Embase in addition to Medline?

It is widely accepted that meta-analysts should search multiple databases. The selection of databases is ideally based on the potential contribution of each database to the project or on the potential for bias if a database is excluded, as supported by research evidence. We explore whether searching Embase yields additional trials that influence a meta-analysis. We identified meta-analyses that searched Medline and Embase. A random-effects weighted mean method was used to estimate the intervention effect in articles indexed only in Embase compared with those indexed elsewhere. On average, Embase-unique trials yielded significantly smaller estimates by 29% (ratio of odds ratio [ROR] 0.71, 95% confidence interval [CI] 0.56-0.90) but influenced the pooled estimate by an average of only 6% (ROR 0.94, 95% CI 0.88-0.99). Searching Medline but not Embase risks biasing a meta-analysis by finding studies that show larger estimates, but their prevalence seems low enough that the risk may be slight, provided the rest of the search is comprehensive.

Databases, Bibliographic↗
PubMed2003

Decrease in hospital admissions for febrile seizures and reports of hypotonic-hyporesponsive episodes presenting to hospital emergency departments since switching to acellular pertussis vaccine in Canada: a report from IMPACT.

OBJECTIVE: Acellular pertussis vaccines were introduced with the promise of an improved safety profile compared with whole-cell vaccines. In 1997-1998, Canada adopted 1 combination acellular pertussis vaccine, having previously used 1 particular combination whole-cell pertussis vaccine. We hypothesized that the change would result in a decrease in hospitalization rates for seizures and reports of hypotonic-hyporesponsive episodes (HHEs) temporally related to pertussis vaccination. METHODS: Active surveillance was performed between 1995 and 2001 by the Immunization Monitoring Program-Active monitors at 12 hospitals using standard case definitions. Seizures had to occur within 72 hours after immunization with a pertussis-containing vaccine or 5 to 30 days after immunization with measles-mumps-rubella vaccine. HHE episodes had to occur within 48 hours of receipt of a pertussis-containing vaccine. Poisson regression models were used to compare the average number of monthly admissions for seizures and HHEs before and after introduction of the acellular pertussis vaccine. RESULTS: We found a 79% decrease in febrile seizures associated with receipt of pertussis vaccine but no significant decrease in febrile seizures temporally related to measles-mumps-rubella between 1995-1996 and 1998-2001. There was a 60% to 67% reduction in HHEs associated with pertussis-containing vaccines between the same time periods, depending on case definition. CONCLUSIONS: The risks of febrile seizures and HHEs after pertussis-containing vaccine declined significantly with the introduction of acellular pertussis vaccine in Canada. Active surveillance systems are important for detecting trends in uncommon adverse events after routine immunizations.

Adverse Drug Reaction Reporting Systems↗
PubMed2002

Funding source, trial outcome and reporting quality: are they related? Results of a pilot study.

BACKGROUND: There has been increasing concern regarding the potential effects of the commercialization of research. METHODS: In order to examine the relationships between funding source, trial outcome and reporting quality, recent issues of five peer-reviewed, high impact factor, general medical journals were hand-searched to identify a sample of 100 randomized controlled trials (20 trials/journal). Relevant data, including funding source (industry/not-for-profit/mixed/not reported) and statistical significance of primary outcome (favouring new treatment/favouring conventional treatment/neutral/unclear), were abstracted. Quality scores were assigned using the Jadad scale and the adequacy of allocation concealment. RESULTS: Sixty-six percent of trials received some industry funding. Trial outcome was not associated with funding source (p=.461). There was a preponderance of favourable statistical conclusions among published trials with 67% reporting results that favored a new treatment whereas 6% favoured the conventional treatment. Quality scores were not associated with funding source or trial outcome. CONCLUSIONS: It is not known whether the absence of significant associations between funding source, trial outcome and reporting quality reflects a true absence of an association or is an artefact of inadequate statistical power, reliance on voluntary disclosure of funding information, a focus on trials recently published in the top medical journals, or some combination thereof. Continued and expanded monitoring of potential conflicts is recommended, particularly in light of new guidelines for disclosure that have been endorsed by the ICMJE.

Bibliometrics↗
PubMed2002

Shorter courses of parenteral antibiotic therapy do not appear to influence response rates for children with acute hematogenous osteomyelitis: a systematic review.

BACKGROUND: Acute hematogenous osteomyelitis (AHO) occurs primarily in children and is believed to evolve from bacteremia followed by localization of infection to the metaphysis of bones. Currently, there is no consensus on the route and duration of antimicrobial therapy to treat AHO. METHODS: We conducted a systematic review of a short versus long course of treatment for AHO due primarily to Staphylococcus aureus in children aged 3 months to 16 years. We searched Medline, Embase and the Cochrane trials registry for controlled trials. Clinical cure rate at 6 months was the primary outcome variable, and groups receiving less than 7 days of intravenous therapy were compared with groups receiving one week or longer of intravenous antimicrobials. RESULTS: 12 eligible prospective studies, one of which was randomized, were identified. The overall cure rate at 6 months for the short course of intravenous therapy was 95.2% (95% CI = 90.4 - 97.7) compared to 98.8% (95% CI = 93.6, 99.8) for the longer course of therapy. There was no significant difference in the duration of oral therapy between the two groups. CONCLUSIONS: Given the potential increased morbidity and cost associated with longer courses of intravenous therapy, this finding should be confirmed through a randomized controlled equivalence trial

Acute Disease↗