The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Good practices for real‐world data studies of treatment and/or comparative effectiveness: Recommendations from the joint ISPOR‐ISPE Special Task Force on real‐world evidence in health care decision making
Open accessAbstract
Purpose: Real‐world evidence (RWE) includes data from retrospective or prospective observational studies and observational registries and provides insights beyond those addressed by randomized controlled trials. RWE studies aim to improve health care decision making. Methods: The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the International Society for Pharmacoepidemiology (ISPE) created a task force to make recommendations regarding good procedural practices that would enhance decision makers' confidence in evidence derived from RWD studies. Peer review by ISPOR/ISPE members and task force participants provided a consensus‐building iterative process for the topics and framing of recommendations. Results: The ISPOR/ISPE Task Force recommendations cover seven topics such as study registration, replicability, and stakeholder involvement in RWE studies. These recommendations, in concert with earlier recommendations about study methodology, provide a trustworthy foundation for the expanded use of RWE in health care decision making. Conclusion: The focus of these recommendations is good procedural practices for studies that test a specific hypothesis in a specific population. We recognize that some of the recommendations in this report may not be widely adopted without appropriate incentives from decision makers, journal editors, and other key stakeholders.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613
SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials
Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Laupacis, A., Gøtzsche, P. C., Krleža-Jerić, K., Hróbjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-3-201302050-00583 · Cited by 7,363
Self-citationSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Benchimol, E. I., Smeeth, L., Guttmann, A., Harron, K., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E., Langan, S. M., & RECORD Working Committee (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001885 · Cited by 5,749
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“Threats to the validity of RWD studies of the effects of interventions include unmeasured confounding, measurement error, missing data, model misspecification, selection bias, and fraud.(51) Scholarly journals publish many observational studies, often without requiring the authors to report a thorough exploration of t…”
BackgroundReal-World Evidence — What Is It and What Can It Tell Us?
Sherman, R. E., Anderson, S. A., Dal Pan, G. J., Gray, G. W., Gross, T., Hunter, N. L., LaVange, L., Marinac-Dabic, D., Marks, P. W., Robb, M. A., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmsb1609216 · Cited by 2,063
Ford, I., & Norrie, J. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1510059 · Cited by 1,405
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042 · cited 1×
“[34] Wagenmakers EJ, Wetzels R, Borsboom D, et al.”
BackgroundGarrison, L. P., Neumann, P. J., Erickson, P., Marshall, D., & Mullins, C. D. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00186.x · Cited by 700
Berger, M. L., Sox, H., Willke, R. J., Brixner, D. L., Eichler, H., Goettsch, W., Madigan, D., Makady, A., Schneeweiss, S., Tarricone, R., et al. (2017) · Value in Health · doi:10.1016/j.jval.2017.08.3019 · Cited by 456
Self-citationWhy most published research findings are false
Brooks, J. (2008) · Urologic Oncology: Seminars and Original Investigations · doi:10.1016/j.urolonc.2008.07.015 · Cited by 423
Motheral, B., Brooks, J., Clark, M. A., Crown, W. H., Davey, P., Hutchins, D., Martin, B. C., & Stang, P. (2003) · Value in Health · doi:10.1046/j.1524-4733.2003.00242.x · Cited by 412
Berger, M. L., Mamdani, M., Atkins, D., & Johnson, M. L. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00600.x · Cited by 409
Self-citationWhat Is Real-World Data? A Review of Definitions Based on Literature and Stakeholder Interviews
Makady, A., de Boer, A., Hillege, H., Klungel, O., & Goettsch, W. (2017) · Value in Health · doi:10.1016/j.jval.2017.03.008 · Cited by 374
Self-citationGarrison, L. P., Towse, A., Briggs, A., de Pouvourville, G., Grueger, J., Mohr, P. E., Severens, J. L. (., Siviero, P., & Sleeper, M. (2013) · Value in Health · doi:10.1016/j.jval.2013.04.011 · Cited by 314
Cox, E., Martin, B. C., Van Staa, T., Garbe, E., Siebert, U., & Johnson, M. L. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00601.x · Cited by 307
Johnson, M. L., Crown, W., Martin, B. C., Dormuth, C. R., & Siebert, U. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00602.x · Cited by 285
Guidelines for good pharmacoepidemiology practice (GPP)
Public Policy Committee, I. S. O. P. (2016) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3891 · Cited by 285
Observational Studies: Getting Clear about Transparency
Editors, T. P. M. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001711 · Cited by 246
Economic Evaluation for Devices and Drugs—Same or Different?
Drummond, M., Griffin, A., & Tarricone, R. (2009) · Value in Health · doi:10.1111/j.1524-4733.2008.00476_1.x · Cited by 237
Self-citationDistinguishing between exploratory and confirmatory preclinical research will improve translation
Kimmelman, J., Mogil, J. S., & Dirnagl, U. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001863 · Cited by 236
Emerging Guidelines for Patient Engagement in Research
Kirwan, J. R., de Wit, M., Frank, L., Haywood, K. L., Salek, S., Brace-McDonnell, S., Lyddiatt, A., Barbic, S. P., Alonso, J., Guillemin, F., et al. (2017) · Value in Health · doi:10.1016/j.jval.2016.10.003 · Cited by 219
Makady, A., Ham, R. T., de Boer, A., Hillege, H., Klungel, O., & Goettsch, W. (2017) · Value in Health · doi:10.1016/j.jval.2016.12.003 · Cited by 206
Self-citationEichler, H., Baird, L., Barker, R., Bloechl‐Daum, B., Børlum‐Kristensen, F., Brown, J., Chua, R., Del Signore, S., Dugan, U., Ferguson, J., et al. (2015) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.59 · Cited by 196
Self-citationBerger, M. L., Dreyer, N., Anderson, F., Towse, A., Sedrakyan, A., & Normand, S.-L. (2012) · Value in Health · doi:10.1016/j.jval.2011.12.010 · Cited by 189
Self-citationWang, S. V., Schneeweiss, S., Berger, M. L., Brown, J., de Vries, F., Douglas, I., Gagne, J. J., Gini, R., Klungel, O., Mullins, C. D., et al. (2017) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4295 · Cited by 182
Self-citationEvaluating the Impact of Database Heterogeneity on Observational Study Results
Madigan, D., Ryan, P. B., Schuemie, M., Stang, P. E., Overhage, J. M., Hartzema, A. G., Suchard, M. A., DuMouchel, W., & Berlin, J. A. (2013) · American Journal of Epidemiology · doi:10.1093/aje/kwt010 · Cited by 181
Self-citationHill, A. B. (1953) · New England Journal of Medicine · doi:10.1056/nejm195306112482401 · Cited by 174
Berger, M. L., Martin, B. C., Husereau, D., Worley, K., Allen, J. D., Yang, W., Quon, N. C., Mullins, C. D., Kahler, K. H., & Crown, W. H. (2014) · Value in Health · doi:10.1016/j.jval.2013.12.011 · Cited by 136
Self-citationDeclaring and Diagnosing Research Designs
Blair, G., Cooper, J., Coppock, A., & Humphreys, M. (2019) · American Political Science Review · doi:10.1017/s0003055419000194 · Cited by 112
Stakeholder-Driven Comparative Effectiveness Research
Selby, J. V., Forsythe, L. P., & Sox, H. C. (2015) · JAMA · doi:10.1001/jama.2015.15139 · Cited by 89
Self-citationPatient, caregiver and clinician views on engagement in comparative effectiveness research
Forsythe, L. P., Frank, L. B., Workman, T. A., Hilliard, T. S., Harwell, D., & Fayish, L. (2017) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2016-0062 · Cited by 40
Orthogonal predictions: follow‐up questions for suggestive data
Walker, A. M. (2010) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1929 · Cited by 22
Health researcher views on comparative effectiveness research and research engagement
Forsythe, L. P., Frank, L. B., Workman, T. A., Borsky, A. E., Hilliard, T. S., Harwell, D., & Fayish, L. (2017) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2016-0063 · Cited by 19
Standardizing Quality Assessment of Observational Studies for Decision Making in Health Care
Brixner, D. L., Holtorf, A.-P., Neumann, P. J., Malone, D. C., & Watkins, J. B. (2009) · Journal of Managed Care Pharmacy · doi:10.18553/jmcp.2009.15.3.275 · Cited by 17
Self-citationUsing Certification to Promote Uptake of Real-World Evidence by Payers
Segal, J. B., Kallich, J. D., Oppenheim, E. R., Garrison, L. P., Iqbal, S. U., Kessler, M., & Alexander, G. C. (2016) · Journal of Managed Care & Specialty Pharmacy · doi:10.18553/jmcp.2016.22.3.191 · Cited by 10
Frank, L. B., Forsythe, L. P., Workman, T. A., Hilliard, T. S., Lavelle, M., Harwell, D., & Fayish, L. (2017) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2016-0061 · Cited by 8
Cited by
Registries for Evaluating Patient Outcomes: A User’s Guide
(2020) · doi:10.23970/ahrqepcregistries4 · Cited by 960
Franklin, J. M., Patorno, E., Desai, R. J., Glynn, R. J., Martin, D., Quinto, K., Pawar, A., Bessette, L. G., Lee, H., Garry, E. M., et al. (2021) · Circulation · doi:10.1161/circulationaha.120.051718 · Cited by 299
Self-citationFranklin, J. M., Pawar, A., Martin, D., Glynn, R. J., Levenson, M., Temple, R., & Schneeweiss, S. (2020) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1633 · Cited by 119
Self-citationGao, J., Gong, Z., Montesano, D., Glazer, E., & Liegner, K. (2020) · Antibiotics · doi:10.3390/antibiotics9120868 · Cited by 23
Makady, A., van Acker, S., Nijmeijer, H., de Boer, A., Hillege, H., Klungel, O., & Goettsch, W. (2019) · Value in Health · doi:10.1016/j.jval.2018.11.016 · Cited by 22
Self-citation
Metadata
- Authors
- Berger, M. L., Sox, H., Willke, R. J., Brixner, D. L., Eichler, H., Goettsch, W., Madigan, D., Makady, A., Schneeweiss, S., Tarricone, R., Wang, S. V., Watkins, J., & Daniel Mullins, C.
- Venue
- Pharmacoepidemiology and Drug Safety
- Publisher
- Wiley
- Published
- 2017-09
- Volume
- 26
- Issue
- 9
- Pages
- 1033-1039
- ISSN
- 1053-8569 (ISSN-L)
- 1099-1557
- OpenAlex
- W4252553827
- Cited by
- 344
- References
- 38
- FWCI
- 21.48
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.