The development of CHAMP: a checklist for the appraisal of moderators and predictors
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Personalized healthcare relies on the identification of factors explaining why individuals respond differently to the same intervention. Analyses identifying such factors, so called predictors and moderators, have their own set of assumptions and limitations which, when violated, can result in misleading claims, and incorrect actions. The aim of this study was to develop a checklist for critically appraising the results of predictor and moderator analyses by combining recommendations from published guidelines and experts in the field. METHODS: Candidate criteria for the checklist were retrieved through systematic searches of the literature. These criteria were evaluated for appropriateness using a Delphi procedure. Two Delphi rounds yielded a pilot checklist, which was tested on a set of papers included in a systematic review on reinforced home-based palliative care. The results of the pilot informed a third Delphi round, which served to finalize the checklist. RESULTS: Forty-nine appraisal criteria were identified in the literature. Feedback was obtained from fourteen experts from (bio)statistics, epidemiology and other associated fields elicited via three Delphi rounds. Additional feedback from other researchers was collected in a pilot test. The final version of our checklist included seventeen criteria, covering the design (e.g. a priori plausibility), analysis (e.g. use of interaction tests) and results (e.g. complete reporting) of moderator and predictor analysis, together with the transferability of the results (e.g. clinical importance). There are criteria both for individual papers and for bodies of evidence. CONCLUSIONS: The proposed checklist can be used for critical appraisal of reported moderator and predictor effects, as assessed in randomized or non-randomized studies using individual participant or aggregate data. This checklist is accompanied by a user's guide to facilitate implementation. Its future use across a wide variety of research domains and study types will provide insights about its usability and feasibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Moons, K. G. M., de Groot, J. A. H., Bouwmeester, W., Vergouwe, Y., Mallett, S., Altman, D. G., Reitsma, J. B., & Collins, G. S. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001744 · Cited by 2,018
Sanderson, S., Tatt, I. D., & Higgins, J. P. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym018 · Cited by 1,531 · cited 1×
“systematic reviews [22, 23]) to appraise the overall risk of bias for the main effect in any given study.”
BackgroundPocock, S. J., Assmann, S. E., Enos, L. E., & Kasten, L. E. (2002) · Statistics in Medicine · doi:10.1002/sim.1296 · Cited by 1,077
Yusuf, S. (1991) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1991.03470010097038 · Cited by 1,014 · cited 1×
“Individuals receiving the same or a similar treatment may show widely differing responses due to differences in treatment dosage or administration, or differences in patient-level characteristics such as age and genetic makeup [2, 3].”
BackgroundIs a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses
Sun, X., Briel, M., Walter, S. D., & Guyatt, G. H. (2010) · BMJ · doi:10.1136/bmj.c117 · Cited by 808
Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal
Kent, D. M., Rothwell, P. M., Ioannidis, J. P., Altman, D. G., & Hayward, R. A. (2010) · Trials · doi:10.1186/1745-6215-11-85 · Cited by 504
Get real in individual participant data (IPD) meta‐analysis: a review of the methodology
Debray, T. P. A., Moons, K. G. M., van Valkenhoef, G., Efthimiou, O., Hummel, N., Groenwold, R. H. H., Reitsma, J. B., & on behalf of the GetReal methods review group (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1160 · Cited by 348
Self-citationDettori, J. (2011) · Evidence-Based Spine-Care Journal · doi:10.1055/s-0030-1267080 · Cited by 336
Pincus, T., Miles, C., Froud, R., Underwood, M., Carnes, D., & Taylor, S. J. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-14 · Cited by 161
Self-citation
Cited by
Keynejad, R. C., Hanlon, C., & Howard, L. M. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30510-3 · Cited by 114
Alrashdi, D. H., Chen, K. K., Meyer, C., & Gould, R. L. (2023) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-023-00321-6 · Cited by 50
Probst, T., Baumeister, H., McCracken, L. M., & Lin, J. (2018) · Journal of Clinical Medicine · doi:10.3390/jcm8010024 · Cited by 38
Thomson, Z. O., Kelly, J. T., Sainsbury, A., & Reeves, M. M. (2021) · Menopause · doi:10.1097/gme.0000000000001684 · Cited by 13
Vousoura, E., Gergov, V., Tulbure, B. T., Camilleri, N., Saliba, A., Garcia-Lopez, L., Podina, I. R., Prevendar, T., Löffler-Stastka, H., Chiarenza, G. A., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01788-1 · Cited by 11
“As advised by van Hoorn and colleagues [56], quality appraisal of predictors and moderators will not yield a total numeric score, but an overall qualitative assessment.”
Background
Metadata
- Authors
- van Hoorn, R., Tummers, M., Booth, A., Gerhardus, A., Rehfuess, E., Hind, D., Bossuyt, P. M., Welch, V., Debray, T. P. A., Underwood, M., Cuijpers, P., Kraemer, H., van der Wilt, G. J., & Kievit, W.
- Venue
- BMC Medical Research Methodology
- Published
- 2017-12
- Volume
- 17
- Issue
- 1
- Pages
- 173-173
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2775861707
- Cited by
- 28
- References
- 11
- FWCI
- 2.65
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The development of CHAMP: a checklist for the appraisal of moderators and predictors. https://app.cochat.ai/papers/10.1186/s12874-017-0451-0
- The paper
- van Hoorn, R., Tummers, M., Booth, A., Gerhardus, A., Rehfuess, E., Hind, D., Bossuyt, P. M., Welch, V., Debray, T. P. A., Underwood, M., Cuijpers, P., Kraemer, H., van der Wilt, G. J., & Kievit, W. (2017). The development of CHAMP: a checklist for the appraisal of moderators and predictors. BMC Medical Research Methodology. https://doi.org/10.1186/s12874-017-0451-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.