Can economic evaluations be made more transferable?

Abstract

Several commentators have identified the lack of generalisability and transferability of economic evaluation results. The aims of this study were: (a) to develop a checklist to assess the level of generalisability and transferability of economic evaluations; (b) to assess the generalisability and transferability of economic evaluations between the UK and France using the checklist; (c) to identify reasons for any lack of transferability and generalisability; (d) to assess how the transferability and generalisability of economic evaluations can be improved; and (e) to outline ways in which databases of economic evaluations and journals can assist in this area. The checklist was developed using previous work and the templates of the NHS EED and CODECS databases. A sub-checklist of essential items was then derived. Validation of the two checklists was undertaken with Health Economists participating in the EURONHEED project. Economic evaluations involving the UK and France were then located and assessed using the checklist. A summary score for each study was calculated based on the percentage of correctly reported (applicable) points, and the results in the empirical analysis compared to identify differences. The extended checklist includes 42 items, and the sub-checklist 16 items. Twenty-five economic evaluations met the inclusion criteria for the empirical analysis. In the extended checklist the mean score was 66.9+/-13.6%. The results for the sub-checklist were very similar. The analysis revealed that costing, assessments of generalisability by the author(s), assessment of data variability, discounting, study population, and the reporting of effectiveness are areas that need more attention. Differences in cost-effectiveness results are often accounted for by price or organisational differences. The developed checklists are useful in assessing the generalisability and transferability of economic evaluations. In order to improve the generalisability and transferability of economic evaluations authors need to be more explicit and detailed in describing and reporting their studies. If they are to provide added value to their users, international databases of economic evaluations should systematically assess the generalisability and transferability of studies. Further research is in progress on producing a weighted version of the checklist.