Cited by 366Health Systems, Economic Evaluations, Quality of LifeMeta-analysis and systematic reviewsDelphi Technique in Research

Examining the Value and Quality of Health Economic Analyses: Implications of Utilizing the QHES

Open access
Ofman, Joshua J., Sullivan, Sean D., Neumann, Peter J., Chiou, Chiun-Fang, Henning, James M., Wade, Sally W., Hay, Joel W.·2003·Journal of Managed Care Pharmacy

Abstract

OBJECTIVE: To examine the increasing use of health economic studies and practical implications of evaluating their quality utilizing the Quality of Health Economic Studies (QHES) instrument. METHODS: We first reviewed secondary references to examine ways in which health economic analyses are used in different health care settings, the manner in which these data are appraised and evaluated, and their relevance and value in decision making. The QHES, a new instrument designed to support fast, accurate initial assessments of study quality, was then introduced and validated. A case study was performed using the QHES to score the quality of 30 cost-effectiveness studies in gastroesophageal reflux disease (GERD) published since 1985. Areas where additional research could guide efforts to identify and enhance the use of higher-quality cost-effectiveness studies were suggested. RESULTS: Results from the published validation study of the QHES demonstrated the validity of this new instrument. The resulting QHES scores in the case study of GERD papers ranged from 43 to 91 with a mean of 63.6 (SD=14.7). Approximately 27% of the studies rated had scores less than 50, and 27% had scores above or equal to 75. All 30 studies made conclusions and recommendations and justified them based on their study results. Most studies used appropriate cost and health outcome measures. Very few studies stated the perspective of their analysis and reasons for its selection. The majority of the studies did not perform incremental analysis. CONCLUSION: An examination of the QHES validation study and the case study in GERD suggests that there is a rationale and potential utility to use a quality scoring system for cost-effectiveness studies. The QHES may play an important role in discriminating higher-quality cost-effectiveness information to enhance decision making. The QHES can also serve as a guideline for conducting and reporting future cost-effectiveness studies, as an aid in the editorial process, and for stratification in systematic reviews. Complex decisions regarding resource allocation rarely rely solely on economic considerations but do increasingly use health economic analyses. To the extent that such analyses are used, the QHES may help ensure that higher-quality analyses receive more analytic attention and greater weight in the decision-making process.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18553/jmcp.2003.9.1.53

Cites

74 of 74 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 76 references couldn’t be matched to a known paper.

Research works printed but not linked: 19

  1. Shaneyfelt TM, Mayo-Smith MF, Rothwangl J. Are guidelines following guide- lines? The methodological quality of clinical practice guidelines in the peer- reviewed medical literature. JAMA. 1999;281:1900-05.
  2. Drummond MF, Richardson WS, O'Brien BJ, et al. User' s guide to the medical literature. XIII. How to use an article on economic analysis of clinical practice. A. Are the results of the study valid? Evidence-Based Medicine Working Group. JAMA. 1997; 277:1552-57.
  3. O'Brien B, Heyland D, Richardson WS, et al. User' s guide to the medical litera- ture. XIII. How to use an article on economic analysis of clinical practice. B. What are the results and will they help me in caring for my patients? JAMA.1997; 277:1802-06.
  4. Sonnenberg A, Inadomi JM, Becker LA. Economic analysis of step-wise treat- ment of gastroesophageal reflux disease. Aliment Pharmacol Ther. 1999;13:1003-13.
  5. Stalhammar NO. Assessing the cost-effectiveness of medical treatments in Examining the Value and Quality of Health Economic Analyses: Implications of Utilizing the QHES acid-related diseases. The Markov chain approach applied to a comparison between intermittent and maintenance treatment of reflux esophagitis. Scand J Gastroenterol Suppl. 1993;199:8-13.
  6. Bate C, Richardson P. Cost-effectiveness of omeprazole in the management of gastroesophageal reflux disease in clinical practice. Br J Med Econ. 1994;7:81-97.
  7. Bate C, Hungin A, Wilcock C. Cost-effective management of gastroesophageal reflux disease in general practice. Br J Med Econ. 1993;6:81-90.
  8. Bate C, Green J, Taylor M. Cost-effective prophylaxis against the recurrence of benign oesophageal stricture. Br J Med Econ. 1995;8:97-107.
  9. Bate C, Richardson P. A one-year model for the cost-effectiveness of treating reflux oesophagitis. Br J Med Econ. 1992;2:5-11.
  10. Bate C. Cost-effectiveness of omeprazole in the treatment of reflux oesophagi- tis. Br J Med Econ. 1991;1:53-61.
  11. Bate C, Richardson P. Symptomatic assessment and cost effectiveness of treat- ments for reflux oesophagitis: comparisons of omeprazole and histamine H2- receptor antagonists. Br J Med Econ. 1992;2:37-48.
  12. Green J, Bate C, Copeman M. A comparison of the cost-effectiveness of omeprazole and ranitidine in reflux oesophagitis. Br J Med Econ. 1995;8:37-48.
  13. Jonsson B, Stalhammar NO. The cost-effectiveness of omeprazole and raniti- dine in intermittent and maintenance treatment of reflux oesophagitis-the case of Sweden. Br J Med Econ. 1993;6:111-26.
  14. Phillips C, Moore A. Trial and error-an expensive luxury: economic analysis of effectiveness of proton pump inhibitors and histamine antagonists in treating reflux disease. Br J Med Econ. 1997;11:55-63.
  15. Bate C, Richardson P. Cost-effectiveness of 20 mg and 40 mg of omeprazole in oesophageal reflux disease. Br J Med Econ. 1993;6:59-66.
  16. Torrance GW, Blaker D, Detsky A, et al. Canadian guidelines for economic evaluation of pharmaceuticals. Canadian Collaborative Workshop for Pharmacoeconomics. Pharmacoeconomics. 1996;9:535-59.
  17. Economic analysis of health care technology. A report on principles. Task Force on Principles for Economic Analysis of Health Care Technology. Ann Intern Med. 1995;123:61-70.
  18. Drummond M, O'Brien B, Stoddart G, Torrance GW. Critical Assessment of Economic Evaluation. Methods for the Economic Evaluation of Health Care Programmes. Oxford, England: Oxford Medical Publications; 1997:27-51.
  19. Drummond MF, Jefferson TO. Guidelines for authors and peer reviewers of economic submissions to the BMJ. BMJ. 1996;313:275-83.

Cited by

Sorted by citations

Authors
Ofman, J. J., Sullivan, S. D., Neumann, P. J., Chiou, C.-F., Henning, J. M., Wade, S. W., & Hay, J. W.
Venue
Journal of Managed Care Pharmacy
Published
2003-01
Volume
9
Issue
1
Pages
53-61
ISSN
  • 1083-4087 (ISSN-L)
  • 1944-706X
OpenAlex
W2130921523
Cited by
366
References
76
Citations by year
2026: 14 · 2025: 18 · 2024: 18 · 2023: 26 · 2022: 25 · 2021: 39 · 2020: 27 · 2019: 35 · 2018: 17 · 2017: 20 · 2016: 16 · 2015: 21 · 2014: 24 · 2013: 18 · 2012: 11
FWCI
9.62
Type
journal article
Language
en
Open access
Locations
  • Journal of Managed Care Pharmacy (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords
instrument validation, gastroesophageal reflux disease, healthcare decision-making, resource allocation, reporting guidelines, systematic reviews
MeSH terms
Cost-Benefit Analysis, Delivery of Health Care, Humans, United States, Economics, Pharmaceutical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review