Cited by 285Advanced Causal Inference TechniquesStatistical Methods in EpidemiologyMeta-analysis and systematic reviews

The DOI matches its Crossref record; 75 of the 77 references it cites were found in a registry or an index.

Good Research Practices for Comparative Effectiveness Research: Analytic Methods to Improve Causal Inference from Nonrandomized Studies of Treatment Effects Using Secondary Data Sources: The ISPOR Good Research Practices for Retrospective Database Analysis Task Force Report—Part III

Open access

Johnson, Michael L., Crown, William, Martin, Bradley C., Dormuth, Colin R., Siebert, Uwe·2009·Value in Health

DOI 10.1111/j.1524-4733.2009.00602.x

Open this paper in CoChat — free account

Abstract

Objectives Most contemporary epidemiologic studies require complex analytical methods to adjust for bias and confounding. New methods are constantly being developed, and older more established methods are yet appropriate. Careful application of statistical analysis techniques can improve causal inference of comparative treatment effects from nonrandomized studies using secondary databases. A Task Force was formed to offer a review of the more recent developments in statistical control of confounding. Methods The Task Force was commissioned and a chair was selected by the ISPOR Board of Directors in October 2007. This Report, the third in this issue of the journal, addressed methods to improve causal inference of treatment effects for nonrandomized studies. Results The Task Force Report recommends general analytic techniques and specific best practices where consensus is reached including: use of stratification analysis before multivariable modeling, multivariable regression including model performance and diagnostic testing, propensity scoring, instrumental variable, and structural modeling techniques including marginal structural models, where appropriate for secondary data. Sensitivity analyses and discussion of extent of residual confounding are discussed. Conclusions Valid findings of causal therapeutic benefits can be produced from nonrandomized studies using an array of state-of-the-art analytic techniques. Improving the quality and uniformity of these studies will impr…

Integrity signals

Registry

Crossref · 10.1111/j.1524-4733.2009.00602.x

Cites

75 of 75 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Applied logistic regression
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Sample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779
Untitled work
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Applied Logistic Regression
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
Regression Modeling Strategies
Harrell, F. E. (2001) · Springer series in statistics · doi:10.1007/978-1-4757-3462-1 · Cited by 9,270
Applied Regression Analysis and Other Multivariable Methods
Walker, E., Kleinbaum, D. G., Kupper, L. L., & Muller, K. E. (1989) · Technometrics · doi:10.2307/1270375 · Cited by 8,538
Instrumental Variables Regression with Weak Instruments
Staiger, D., & Stock, J. H. (1997) · Econometrica · doi:10.2307/2171753 · Cited by 7,081
Analysis of Longitudinal Data
Everitt, B. S. (2001) · Psychology Press eBooks · doi:10.4324/9781410605542-11 · Cited by 6,877

Show all 77 references

Research works printed but not linked: 2

Berger, 2009, Good research practices for comparative effectiveness research: defining, reporting and interpreting non-randomized studies of treatment effects using secondary data sources. ISPOR TF Report 2009—Part I, Value Health
Montaquila JM., Ponikowski CH. An evaluation of alternative imputation methods. Proceedings of the Section on Survey Research Methods, American Statistical Association, 1995.

Sorted by citations

State-Transition Modeling: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-3
Siebert, U., Alagoz, O., Bayoumi, A. M., Jahn, B., Owens, D. K., Cohen, D. J., & Kuntz, K. M. (2012) · Value in Health · doi:10.1016/j.jval.2012.06.014 · Cited by 495
Self-citation
Good Practices for Real‐World Data Studies of Treatment and/or Comparative Effectiveness: Recommendations from the Joint ISPOR‐ISPE Special Task Force on Real‐World Evidence in Health Care Decision Making
Berger, M. L., Sox, H. C., Willke, R. J., Brixner, D. L., Eichler, H., Goettsch, W., Madigan, D., Makady, A., Schneeweiß, S., Tarricone, R., et al. (2017) · Value in Health · doi:10.1016/j.jval.2017.08.3019 · Cited by 464
Good Research Practices for Comparative Effectiveness Research: Defining, Reporting and Interpreting Nonrandomized Studies of Treatment Effects Using Secondary Data Sources: The ISPOR Good Research Practices for Retrospective Database Analysis Task Force Report—Part I
Berger, M. L., Mamdani, M., Atkins, D. C., & Johnson, M. L. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00600.x · Cited by 408
Self-citation
Long-acting injectable versus oral antipsychotics for the maintenance treatment of schizophrenia: a systematic review and comparative meta-analysis of randomised, cohort, and pre-post studies
Kishimoto, T., Hagi, K., Kurokawa, S., Kane, J. M., & Correll, C. U. (2021) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00039-0 · Cited by 369
State-Transition Modeling: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force–3
Siebert, U., Alagoz, O., Bayoumi, A. M., Jahn, B., Owens, D. K., Cohen, D. J., & Kuntz, K. M. (2012) · Medical Decision Making · doi:10.1177/0272989x12455463 · Cited by 348
Self-citation
Good practices for real‐world data studies of treatment and/or comparative effectiveness: Recommendations from the joint ISPOR‐ISPE Special Task Force on real‐world evidence in health care decision making
Berger, M. L., Sox, H. C., Willke, R. J., Brixner, D. L., Eichler, H., Goettsch, W., Madigan, D., Makady, A., Schneeweiß, S., Tarricone, R., et al. (2017) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4297 · Cited by 355
Quasi-experimental design
Maciejewski, M. L. (2018) · Biostatistics & Epidemiology · doi:10.1080/24709360.2018.1477468 · Cited by 406
Performance-Based Risk-Sharing Arrangements—Good Practices for Design, Implementation, and Evaluation: Report of the ISPOR Good Practices for Performance-Based Risk-Sharing Arrangements Task Force
Garrison, L. P., Towse, A., Briggs, A. H., de Pouvourville, G., Grueger, J., Mohr, P. E., Severens, J. L., Siviero, P. D., & Sleeper, M. (2013) · Value in Health · doi:10.1016/j.jval.2013.04.011 · Cited by 316
Good Research Practices for Comparative Effectiveness Research: Approaches to Mitigate Bias and Confounding in the Design of Nonrandomized Studies of Treatment Effects Using Secondary Data Sources: The International Society for Pharmacoeconomics and Outcomes Research Good Research Practices for Retrospective Database Analysis Task Force Report—Part II
Cox, E., Martin, B. C., Van Staa, T., Garbe, E., Siebert, U., & Johnson, M. L. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00601.x · Cited by 307
Self-citation
Nurse staffing and patient outcomes: Strengths and limitations of the evidence to inform policy and practice. A review and discussion paper based on evidence reviewed for the National Institute for Health and Care Excellence Safe Staffing guideline development
Griffiths, P., Ball, J., Drennan, J., Dall’Ora, C., Jones, J., Maruotti, A., Pope, C. J., Recio‐Saucedo, A., & Simon, M. (2016) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2016.03.012 · Cited by 284
Agreement of treatment effects for mortality from routinely collected data and subsequent randomized trials: meta-epidemiological survey
Hemkens, L. G., Contopoulos‐Ioannidis, D. G., & Ioannidis, J. P. A. (2016) · BMJ · doi:10.1136/bmj.i493 · Cited by 220
IDEAL framework for surgical innovation 2: observational studies in the exploration and assessment stages
Ergina, P., Barkun, J. S., McCulloch, P. G., Cook, J. A., Altman, D. G., & On behalf of the IDEAL group (2013) · BMJ · doi:10.1136/bmj.f3011 · Cited by 213
Why Observational Studies Should Be Among The Tools Used In Comparative Effectiveness Research
Dreyer, N. A., Tunis, S., Berger, M. L., Ollendorf, D., Mattox, P. W., & Gliklich, R. E. (2010) · Health Affairs · doi:10.1377/hlthaff.2010.0666 · Cited by 203
Transparency and Reproducibility of Observational Cohort Studies Using Large Healthcare Databases.
Wang, S., Verpillat, P., Rassen, J. A., Patrick, A., Garry, E., & Bartels, D. (2015) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.329 · Cited by 201
Prospective Observational Studies to Assess Comparative Effectiveness: The ISPOR Good Research Practices Task Force Report
Berger, M. L., Dreyer, N. A., Anderson, F. A., Towse, A., Sedrakyan, A., & Normand, S. T. (2012) · Value in Health · doi:10.1016/j.jval.2011.12.010 · Cited by 191
Propensity score matching and inverse probability of treatment weighting to address confounding by indication in comparative effectiveness research of oral anticoagulants
Allan, V., Ramagopalan, S. V., Mardekian, J., Jenkins, A. K., Li, X., Pan, X., & Luo, X. (2020) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2020-0013 · Cited by 186
A review of causal inference for biomedical informatics
Kleinberg, S., & Hripcsak, G. M. (2011) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.07.001 · Cited by 173
Questionnaire to Assess Relevance and Credibility of Modeling Studies for Informing Health Care Decision Making: An ISPOR-AMCP-NPC Good Practice Task Force Report
Jaime, J., Eddy, D. M., Kan, H. J., Kaltz, C., Patel, B. V., Eldessouki, R., & Briggs, A. H. (2014) · Value in Health · doi:10.1016/j.jval.2014.01.003 · Cited by 167
GRACE principles: recognizing high-quality observational studies of comparative effectiveness.
Dreyer, N. A., Schneeweiß, S., McNeil, B. J., Berger, M. L., Walker, A. M., Ollendorf, D. A., & Gliklich, R. E. (2010) · PubMed · Cited by 156
Quality Standards for Real-World Research. Focus on Observational Database Studies of Comparative Effectiveness
Roche, N., Reddel, H. K., Martin, R. J., Brusselle, G., Papi, A. A., Thomas, M. D., Postma, D., Thomas, V., Rand, C., Chisholm, A., et al. (2014) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201309-300rm · Cited by 148
When Do We Know Enough to Recommend Action on the Social Determinants of Health?
Braveman, P., Egerter, S. A., Woolf, S. H., & Marks, J. S. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2010.09.026 · Cited by 149
Potential Bias of Instrumental Variable Analyses for Observational Comparative Effectiveness Research
Garabedian, L. F., Chu, P., Toh, S., Zaslavsky, A. M., & Soumerai, S. B. (2014) · Annals of Internal Medicine · doi:10.7326/m13-1887 · Cited by 133
The GRACE Checklist: A Validated Assessment Tool for High Quality Observational Studies of Comparative Effectiveness
Dreyer, N. A., Bryant, A., & Velentgas, P. (2016) · Journal of Managed Care & Specialty Pharmacy · doi:10.18553/jmcp.2016.22.10.1107 · Cited by 133
Comparative Effectiveness Research in Oncology Methodology: Observational Data
Hershman, D. L., & Wright, J. D. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2012.41.6701 · Cited by 132
A Questionnaire to Assess the Relevance and Credibility of Observational Studies to Inform Health Care Decision Making: An ISPOR-AMCP-NPC Good Practice Task Force Report
Berger, M. L., Martin, B. C., Husereau, D., Worley, K., Allen, J. D., Yang, W., Quon, N. C., Mullins, C. D., Kahler, K. H., & Crown, W. H. (2014) · Value in Health · doi:10.1016/j.jval.2013.12.011 · Cited by 135
Self-citation
Value of Information Analytical Methods: Report 2 of the ISPOR Value of Information Analysis Emerging Good Practices Task Force
Rothery, C., Strong, M., Koffijberg, H., Basu, A., Ghabri, S., Knies, S., Murray, J. F., Sanders, G. D., Steuten, L., & Fenwick, E. A. L. (2020) · Value in Health · doi:10.1016/j.jval.2020.01.004 · Cited by 130
Improving Transparency to Build Trust in Real-World Secondary Data Studies for Hypothesis Testing—Why, What, and How: Recommendations and a Road Map from the Real-World Evidence Transparency Initiative
Orsini, L. S., Berger, M. L., Crown, W. H., Daniel, G. W., Eichler, H., Goettsch, W., Graff, J. S., Guerino, J., Jonsson, P. F., Lederer, N. M., et al. (2020) · Value in Health · doi:10.1016/j.jval.2020.04.002 · Cited by 127
Self-citation
Observational Methods in Comparative Effectiveness Research
Concato, J., Lawler, E. V., Lew, R., Gaziano, J. M., Aslan, M., & Huang, G. D. (2010) · The American Journal of Medicine · doi:10.1016/j.amjmed.2010.10.004 · Cited by 129
Framework for the synthesis of non-randomised studies and randomised controlled trials: a guidance on conducting a systematic review and meta-analysis for healthcare decision making
Sarri, G., Patorno, E., Yuan, H., Guo, J., Bennett, D., Wen, X., Zullo, A. R., Largent, J. A., Panaccio, M. P., Gokhale, M., et al. (2020) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2020-111493 · Cited by 121
A General Framework for Considering Selection Bias in EHR-Based Studies: What Data are Observed and Why?
Haneuse, S., & Daniels, M. J. (2016) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1203 · Cited by 118
HARmonized Protocol Template to Enhance Reproducibility of hypothesis evaluating real‐world evidence studies on treatment effects: A good practices report of a joint ISPE/ISPOR task force
Wang, S. V., Pottegård, A., Crown, W. H., Arlett, P. R., Ashcroft, D. M., Benchimol, E. I., Berger, M. L., Crane, G., Goettsch, W., Hua, W., et al. (2022) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.5507 · Cited by 114
Self-citation
Untapped Potential of Observational Research to Inform Clinical Decision Making: American Society of Clinical Oncology Research Statement
Visvanathan, K., Levit, L. A., Raghavan, D., Hudis, C. A., Wong, S. L., Dueck, A. C., & Lyman, G. H. (2017) · Journal of Clinical Oncology · doi:10.1200/jco.2017.72.6414 · Cited by 112
Cardiovascular Risk in Rheumatoid Arthritis: Comparing TNF-α Blockade with Nonbiologic DMARDs
Solomon, D. H., Curtis, J. R., Saag, K. G., Lii, J., Chen, L., Harrold, L. R., Herrinton, L. J., Graham, D. J., Kowal, M. K., Kuriya, B., et al. (2013) · The American Journal of Medicine · doi:10.1016/j.amjmed.2013.02.016 · Cited by 111
Facts, Fallacies, and Politics of Comparative Effectiveness Research: Part I. Basic Considerations
Manchikanti, L. (2010) · Pain Physician · doi:10.36076/ppj.2010/13/e23 · Cited by 111
Generating Evidence From Computerized Healthcare Utilization Databases
Corrao, G., & Mancia, G. (2015) · Hypertension · doi:10.1161/hypertensionaha.114.04858 · Cited by 105
Carrying out streamlined routine data analyses with reports for observational studies: introduction to a series of generic SAS® macros
Liu, Y., Nickleach, D. C., Zhang, C., Switchenko, J. M., & Kowalski, J. (2018) · F1000Research · doi:10.12688/f1000research.16866.2 · Cited by 104
Concepts of ‘Personalization’ in Personalized Medicine: Implications for Economic Evaluation
Rogowski, W. H., Payne, K., Schnell‐Inderst, P., Manca, A., Rochau, U., Jahn, B., Alagöz, O., Leidl, R., & Siebert, U. (2014) · PharmacoEconomics · doi:10.1007/s40273-014-0211-5 · Cited by 98
Self-citation
Causality, Probability, and Time
Kleinberg, S. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139207799 · Cited by 85
Standards should be applied in the prevention and handling of missing data for patient-centered outcomes research: a systematic review and expert consensus
Li, T., Hutfless, S. M., Scharfstein, D. O., Daniels, M. J., Hogan, J. W., Little, R. J. A., Roy, J. A., Law, A. H., & Dickersin, K. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.08.013 · Cited by 79
Real-World Evidence, Causal Inference, and Machine Learning
Crown, W. H. (2019) · Value in Health · doi:10.1016/j.jval.2019.03.001 · Cited by 80
Self-citation
The Signals that Potential Contributors Look for When Choosing Open-source Projects
Qiu, H. S., Li, Y. L., Padala, S., Sarma, A., & Vasilescu, B. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359224 · Cited by 75
Considerations for Observational Research Using Large Data Sets in Radiation Oncology
Jagsi, R., Bekelman, J. E., Chen, A. B., Chen, R. C., Hoffman, K. E., Shih, Y. T., Smith, B. D., & Yu, J. B. (2014) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2014.05.013 · Cited by 72
Statins and Risk of Cancer
Marelli, C., Gunnarsson, C., Ross, S. D., Haas, S., Stroup, D. F., Cload, P., Clopton, P., & DeMaria, A. N. (2011) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2011.04.015 · Cited by 72
Propensity-Score Matching in Economic Analyses: Comparison with Regression Models, Instrumental Variables, Residual Inclusion, Differences-in-Differences, and Decomposition Methods
Crown, W. H. (2014) · Applied Health Economics and Health Policy · doi:10.1007/s40258-013-0075-4 · Cited by 71
Self-citation
Real-World Evidence: Useful in the Real World of US Payer Decision Making? How? When? And What Studies?
Malone, D. C., Brown, M., Hurwitz, J. T., Peters, L., & Graff, J. S. (2017) · Value in Health · doi:10.1016/j.jval.2017.08.3013 · Cited by 70
Emulating a Randomised Controlled Trial With Observational Data: An Introduction to the Target Trial Framework
Kutcher, S., Brophy, J. M., Banack, H. R., Kaufman, J. S., & Samuel, M. (2021) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2021.05.012 · Cited by 71
Real World Data in Adaptive Biomedical Innovation: A Framework for Generating Evidence Fit for Decision‐Making
Schneeweiß, S., Eichler, H., García‐Altés, A., Chinn, C., Eggimann, A., Garner, S., Goettsch, W., Lim, R. R., Löbker, W., Martin, D., et al. (2016) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.512 · Cited by 64
Comparison of Long-term Survival of Patients With Early-Stage Non–Small Cell Lung Cancer After Surgery vs Stereotactic Body Radiotherapy
Chi, A., Fang, W., Sun, Y., & Wen, S. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.15724 · Cited by 60
Heart failure risk among patients with rheumatoid arthritis starting a TNF antagonist
Solomon, D. H., Rassen, J. A., Kuriya, B., Chen, L., Harrold, L. R., Graham, D. J., Lewis, J. D., Lii, J., Liu, L., Griffin, M. R., et al. (2012) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2012-202136 · Cited by 59
Utilization of health care databases for pharmacoepidemiology
Takahashi, Y., Nishida, Y., & Asai, S. (2011) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-011-1088-2 · Cited by 58
The use of complementary and integrative health approaches for chronic musculoskeletal pain in younger US Veterans: An economic evaluation
Herman, P. M., Yuan, A. H., Cefalu, M. S., Chu, K., Zeng, Q. T., Marshall, N. J., Lorenz, K., & Taylor, S. L. (2019) · PLoS ONE · doi:10.1371/journal.pone.0217831 · Cited by 57
Organized structure of real-world evidence best practices: moving from fragmented recommendations to comprehensive guidance
Jaksa, A. A., Wu, J. J., Jonsson, P. F., Eichler, H., Vititoe, S. E., & Gatto, N. M. (2021) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2020-0228 · Cited by 58
Clinical Research Informatics and Electronic Health Record Data
Horvath, M. M., Rusincovitch, S. A., & Richesson, R. (2014) · Yearbook of Medical Informatics · doi:10.15265/iy-2014-0009 · Cited by 59
HARmonized Protocol Template to Enhance Reproducibility of Hypothesis Evaluating Real-World Evidence Studies on Treatment Effects: A Good Practices Report of a Joint ISPE/ISPOR Task Force
Wang, S. V., Pottegård, A., Crown, W. H., Arlett, P. R., Ashcroft, D. M., Benchimol, E. I., Berger, M. L., Crane, G., Goettsch, W., Hua, W., et al. (2022) · Value in Health · doi:10.1016/j.jval.2022.09.001 · Cited by 54
Self-citation
Guidance on the use of complex systems models for economic evaluations of public health interventions
Breeze, P. R., Squires, H., Ennis, K., Meier, P. S., Hayes, K., Lomax, N., Shiell, A., Kee, F., de Vocht, F., O’Flaherty, M., et al. (2023) · Health Economics · doi:10.1002/hec.4681 · Cited by 54
Self-citation
A model for incorporating patient and stakeholder voices in a learning health care network: Washington State's Comparative Effectiveness Research Translation Network
Devine, E. B., Alfonso‐Cristancho, R., Devlin, A. B., Edwards, T. C., Farrokhi, E. T., Kessler, L. G., Lavallee, D. C., Patrick, D. L., Sullivan, S. D., Tarczy-Hornoch, P. Z., et al. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.04.007 · Cited by 48
Incidence and costs of cardiac device infections: retrospective analysis using German health claims data
Ludwig, S., Theis, C., Brown, B., Witthohn, A., Lux, W., & Goette, A. (2017) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2017-0080 · Cited by 47
Surgical preference regarding different materials for custom-made allograft cranioplasty in patients with calvarial defects: Results from an internal audit covering the last 20 years
Ganau, M., Cébula, H., Fricia, M., Zaed, I., Todeschi, J., Scibilia, A., GALLINARO, P., Coca, A. H., Chaussemy, D., Ollivier, I., et al. (2020) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2020.01.087 · Cited by 46
Biostatistical Considerations When Using RWD and RWE in Clinical Studies for Regulatory Purposes: A Landscape Assessment
Levenson, M. S., He, W., Chen, J., Fang, Y., Faries, D. E., Goldstein, B. A., Ho, M., Lee, K., Mishra-Kalyani, P. S., Rockhold, F. W., et al. (2021) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2021.1883473 · Cited by 46
Standards and guidelines for observational studies: quality is in the eye of the beholder
Morton, S. C., Costlow, M. R., Graff, J. S., & Dubois, R. W. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.10.014 · Cited by 43
What type of clinical evidence is needed to assess medical devices?
Tarricone, R., Boscolo, P. R., & Armeni, P. (2016) · European Respiratory Review · doi:10.1183/16000617.0016-2016 · Cited by 43
The European Network of Centres for Pharmacoepidemiology and Pharmacovigilance (ENCePP)
Wharf, C., & London, E. (2012) · Cited by 43
The Current Landscape in Biostatistics of Real-World Data and Evidence: Clinical Study Design and Analysis
Chen, J., Ho, M., Lee, K., Song, Y., Fang, Y., Goldstein, B. A., He, W., Irony, T., Jiang, Q., van der Laan, M. J., et al. (2021) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2021.1883474 · Cited by 41
Use of Real-World Evidence in US Payer Coverage Decision-Making for Next-Generation Sequencing–Based Tests: Challenges, Opportunities, and Potential Solutions
Deverka, P. A., Douglas, M. P., & Phillips, K. A. (2020) · Value in Health · doi:10.1016/j.jval.2020.02.001 · Cited by 39
Differential long-term retention of biological disease-modifying antirheumatic drugs in patients with rheumatoid arthritis by age group from the FIRST registry
Kawabe, A., Nakano, K., Kubo, S., Asakawa, T., & Tanaka, Y. (2020) · Arthritis Research & Therapy · doi:10.1186/s13075-020-02233-9 · Cited by 38
An Evaluation Toolkit to Guide Model Selection and Cohort Definition in Causal InferencePreprint
Shimoni, Y., Karavani, E., Ravid, S., Bak, P., Ng, T. H., Alford, S. H., Meade, D., & Goldschmidt, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00442 · Cited by 49
Value-Based Care for Musculoskeletal Pain: Are Physical Therapists Ready to Deliver?
Lentz, T. A., Goode, A. P., Thigpen, C. A., & George, S. Z. (2019) · Physical Therapy · doi:10.1093/ptj/pzz171 · Cited by 38
The use and effectiveness of rituximab maintenance in patients with follicular lymphoma diagnosed between 2004 and 2007 in the United States
Nastoupil, L. J., Sinha, R., Byrtek, M., Zhou, X., Taylor, M. D., Friedberg, J. W., Link, B. K., Cerhan, J. R., Dawson, K. L., & Flowers, C. R. (2014) · Cancer · doi:10.1002/cncr.28659 · Cited by 35
Editorial Commentary: Linezolid vs Daptomycin for Vancomycin-Resistant Enterococci: The Evidence Gap Between Trials and Clinical Experience
McKinnell, J. A., & Arias, C. A. (2015) · Clinical Infectious Diseases · doi:10.1093/cid/civ449 · Cited by 35
Impact of Nonadherence to Inhaled Corticosteroid/LABA Therapy on COPD Exacerbation Rates and Healthcare Costs in a Commercially Insured US Population.
Davis, J. R., Wu, B., Kern, D. M., Tunceli, O., Fox, K. M., Horton, J., Legg, R. F., & Trudo, F. J. (2017) · Europe PMC (PubMed Central) · Cited by 34
A Systematic Review and Meta-Analysis of the Data Behind Current Recommendations for Corticosteroids in Non–HIV-Related PCP: Knowing When You Are on Shaky Foundations
Injean, P. A., Eells, S. J., Wu, H., McElroy, I. E., Gregson, A. L., & McKinnell, J. A. (2017) · Transplantation Direct · doi:10.1097/txd.0000000000000642 · Cited by 34
Bladder antimuscarinics and cognitive decline in elderly patients
Moga, D. C., Abner, E. L., Wu, Q., & Jicha, G. A. (2017) · Alzheimer s & Dementia Translational Research & Clinical Interventions · doi:10.1016/j.trci.2017.01.003 · Cited by 36
GlycA and hsCRP are independent and additive predictors of future cardiovascular events among patients undergoing angiography: The intermountain heart collaborative study
Muhlestein, J. B., May, H. T., Galenko, O., Knowlton, K. U., Otvos, J. D., Connelly, M. A., LAPPE, D. L., & Anderson, J. L. (2018) · American Heart Journal · doi:10.1016/j.ahj.2018.04.003 · Cited by 33
Toward a better understanding about real-world evidence
Liu, M., Qi, Y., Wang, W., & Sun, X. (2021) · European Journal of Hospital Pharmacy · doi:10.1136/ejhpharm-2021-003081 · Cited by 34
Effectiveness Research in Inflammatory Bowel Disease: A Necessity and a Methodological Challenge
Salleron, J., Danese, S., D’Agay, L., & Peyrin‐Biroulet, L. (2016) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjw068 · Cited by 33
Criteria and Process for Initiating and Developing an ISPOR Good Practices Task Force Report
Malone, D. C., Ramsey, S. D., Patrick, D. L., Johnson, F. R., Mullins, C. D., Roberts, M. S., Willke, R. J., & Marshall, D. A. (2020) · Value in Health · doi:10.1016/j.jval.2020.03.001 · Cited by 32
A Real-World Observational Study of Hospitalization and Health Care Costs Among Nonvalvular Atrial Fibrillation Patients Prescribed Oral Anticoagulants in the U.S. Medicare Population
Amin, A., Keshishian, A. V., Trocio, J. N., Dina, O., Le, H., Rosenblatt, L. C., Liu, X., Mardekian, J., Zhang, Q., Başer, O., et al. (2018) · Journal of Managed Care & Specialty Pharmacy · doi:10.18553/jmcp.2018.24.9.911 · Cited by 32
A Pharmacoepidemiologic Analysis of the Impact of Calendar Packaging on Adherence to Self-Administered Medications for Long-Term Use
Zedler, B. K., Joyce, A., Murrelle, L., Kakad, P. P., & Harpe, S. E. (2011) · Clinical Therapeutics · doi:10.1016/j.clinthera.2011.04.020 · Cited by 32
Effect of candesartan monotherapy on lipid metabolism in patients with hypertension: a retrospective longitudinal survey using data from electronic medical records
Nishida, Y., Takahashi, Y., Nakayama, T., Soma, M., Kitamura, N., & Asai, S. (2010) · Cardiovascular Diabetology · doi:10.1186/1475-2840-9-38 · Cited by 31
Effectiveness of two‐drug therapy versus monotherapy as initial regimen in hypertension: A propensity score‐matched cohort study in the UK Clinical Practice Research Datalink
Marinier, K., Macouillard, P., Champvallins, M. D., Deltour, N., Poulter, N. R., & Mancia, G. (2019) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4884 · Cited by 31
A Targeted Review of Worldwide Indirect Treatment Comparison Guidelines and Best Practices
Tanaka, S., Igarashi, A., Moor, R. D., Li, N., Yoneyama-Hirozane, M., Hong, L. W., Wu, D. B.-C., Yu, D. Y., Hashim, M., Hutton, B., et al. (2024) · Value in Health · doi:10.1016/j.jval.2024.05.015 · Cited by 30
Evaluation of Healthcare Interventions and Big Data: Review of Associated Data Issues
Asche, C. V., Seal, B. S., Kahler, K. H., Oehrlein, E. M., & Baumgartner, M. G. (2017) · PharmacoEconomics · doi:10.1007/s40273-017-0513-5 · Cited by 30
Gender differences in the real-world effectiveness of smoking cessation medications: Findings from the 2010–2011 Tobacco Use Supplement to the Current Population Survey
Smith, P. H., Ju, Z., Weinberger, A. H., Mazure, C. M., & McKee, S. A. (2017) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2017.05.046 · Cited by 30
Cost-effectiveness of a multifactorial fall prevention program in nursing homes
Heinrich, S., Rapp, K., Stuhldreher, N., Rißmann, U., Becker, C., & König, H. (2012) · Osteoporosis International · doi:10.1007/s00198-012-2075-x · Cited by 29
Health-related quality of life, work productivity and costs related to patients with inflammatory bowel disease in Austria
Walter, E., Hausberger, S., Gross, E., & Siebert, U. (2020) · Journal of Medical Economics · doi:10.1080/13696998.2020.1801187 · Cited by 29
Self-citation
Is Propensity Score Analysis a Valid Surrogate of Randomization for the Avoidance of Allocation Bias?
Ríos, J., Sáez‐Peñataro, J., Pontes, C., & Torres, F. (2017) · Seminars in Liver Disease · doi:10.1055/s-0037-1606213 · Cited by 29
A Review of the Challenges of Using Biomedical Big Data for Economic Evaluations of Precision Medicine
Fahr, P., Buchanan, J., & Wordsworth, S. (2019) · Applied Health Economics and Health Policy · doi:10.1007/s40258-019-00474-7 · Cited by 28
A Checklist for Ascertaining Study Cohorts in Oncology Health Services Research Using Secondary Data: Report of the ISPOR Oncology Good Outcomes Research Practices Working Group
Schulman, K. L., Berenson, K., Shih, Y. T., Foley, K. A., Ganguli, A. X., de Souza, J., Yaghmour, N. A., & Shteynshlyuger, A. (2013) · Value in Health · doi:10.1016/j.jval.2013.02.006 · Cited by 27
Current use of routinely collected health data to complement randomized controlled trials: a meta-epidemiological survey
Hemkens, L. G., Contopoulos‐Ioannidis, D. G., & Ioannidis, J. P. A. (2016) · CMAJ Open · doi:10.9778/cmajo.20150036 · Cited by 27
Angiotensin Receptor Blockers and Risk of Prostate Cancer Among United States Veterans
Rao, G., Mann, J. R., Bottai, M., Uemura, H., Burch, J. B., Bennett, C. L., Haddock, K. S., & Hébert, J. R. (2013) · The Journal of Clinical Pharmacology · doi:10.1002/jcph.98 · Cited by 27
Making Observational Studies Count
Dreyer, N. A. (2011) · Epidemiology · doi:10.1097/ede.0b013e3182126569 · Cited by 27
Comparison of the effectiveness of frontline chemoimmunotherapy regimens for follicular lymphoma used in the United States
Nastoupil, L. J., Sinha, R., Byrtek, M., ZIEMIECKI, R. M., Taylor, M., Friedberg, J. W., Koff, J. L., Link, B. K., Cerhan, J. R., Dawson, K. L., et al. (2014) · Leukemia & lymphoma/Leukemia and lymphoma · doi:10.3109/10428194.2014.953144 · Cited by 26
A bias‐adjusted evidence synthesis of RCT and observational data: the case of total hip replacement
Schnell‐Inderst, P., Iglesias, C. P., Arvandi, M., Ciani, O., Gothe, R. M., Peters, J., Blom, A. W., Taylor, R. S., & Siebert, U. (2017) · Health Economics · doi:10.1002/hec.3474 · Cited by 26
Self-citation
The relative impact of brief treatment versus brief intervention in primary health‐care screening programs for substance use disorders
Aldridge, A., Dowd, W., & Bray, J. (2017) · Addiction · doi:10.1111/add.13653 · Cited by 25
Improving transparency to build trust in real‐world secondary data studies for hypothesis testing—Why, what, and how: recommendations and a road map from the real‐world evidence transparency initiative
Orsini, L. S., Monz, B. U., Mullins, C. D., Brunt, D. V., Daniel, G. W., Eichler, H., Graff, J. S., Guerino, J., Berger, M. L., Lederer, N. M., et al. (2020) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.5079 · Cited by 25
Self-citation
Quality standards in respiratory real-life effectiveness research: the REal Life EVidence AssessmeNt Tool (RELEVANT): report from the Respiratory Effectiveness Group—European Academy of Allergy and Clinical Immunology Task Force
Roche, N., Campbell, J. D., Krishnan, J. A., Brusselle, G., Chisholm, A., Bjermer, L. H., Thomas, M. D., Ganse, E. H. V., van den Berge, M., Christoff, G., et al. (2019) · Clinical and Translational Allergy · doi:10.1186/s13601-019-0255-x · Cited by 25
Statistical Issues with the Analysis of Nonrandomized Studies in Comparative Effectiveness Research
Alemayehu, D., Alvir, J. M. J., Jones, B. C., & Willke, R. J. (2011) · Journal of Managed Care Pharmacy · doi:10.18553/jmcp.2011.17.s9-a.s22 · Cited by 24
Building reliable evidence from real-world data: Needs, methods, cautiousness and recommendations
Corrao, G., & Cantarutti, A. (2018) · Pulmonary Pharmacology & Therapeutics · doi:10.1016/j.pupt.2018.09.009 · Cited by 24
Does statin-treated hyperlipidemia affect rotator cuff healing or muscle fatty infiltration after rotator cuff repair?
Amit, P., Kuiper, J. H., James, S., & Snow, M. (2021) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2021.05.014 · Cited by 24
Comparative effectiveness for oral anti-diabetic treatments among newly diagnosed type 2 diabetics: data-driven predictive analytics in healthcare
Maguire, J., & Dhar, V. (2012) · Health Systems · doi:10.1057/hs.2012.20 · Cited by 23

Authors: Johnson, M. L., Crown, W., Martin, B. C., Dormuth, C. R., & Siebert, U.
Affiliations: University of Houston (US)
University of Arkansas for Medical Sciences (US)
University of British Columbia (CA)
Harvard University (US)
Corresponding author: Johnson, Michael L.
ORCID: Johnson, Michael L.
Crown, William
Martin, Bradley C.
Dormuth, Colin R.
Siebert, Uwe
Venue: Value in Health
Publisher: Elsevier BV
Published: 2009-11
Volume: 12
Issue: 8
Pages: 1062-1073
ISSN: 1098-3015 (ISSN-L)
DOI: 10.1111/j.1524-4733.2009.00602.x
OpenAlex: W2153012086
Cited by: 285
References: 77
Citations by year: 2026: 2 · 2025: 6 · 2024: 10 · 2023: 10 · 2022: 18 · 2021: 14 · 2020: 25 · 2019: 19 · 2018: 11 · 2017: 30 · 2016: 30 · 2015: 17 · 2014: 19 · 2013: 24 · 2012: 16
FWCI: 13.87
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/open-access/userlicense/1.0/ (vor, 1353 d)
Locations: Value in Health (publishedVersion)
PubMed (publishedVersion)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords: comparative effectiveness research, causal inference, non-randomized studies, secondary data sources, confounding adjustment, propensity scoring, instrumental variables, marginal structural models, structural equation modeling, stratified analysis, multivariable regression, residual confounding, sensitivity analysis, good scientific practice
MeSH terms: Data Interpretation, Statistical, Decision Making, Epidemiologic Methods, Health Policy, Humans, Regression Analysis, Retrospective Studies, ROC Curve, Selection Bias, Causality, Confounding Factors, Epidemiologic, Multivariate Analysis, Databases, Factual, Outcome Assessment, Health Care, Economics, Pharmaceutical, Internationality, Comparative Effectiveness Research, Drug-Related Side Effects and Adverse Reactions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Good Research Practices for Comparative Effectiveness Research: Analytic Methods to Improve Causal Inference from Nonrandomized Studies of Treatment Effects Using Secondary Data Sources: The ISPOR Good Research Practices for Retrospective Database Analysis Task Force Report—Part III

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks