Hasty generalizations and generics in medical research: A systematic review
Open accessThe DOI matches its Crossref record; 41 of the 42 references it cites were found in a registry or an index; 14 of the 67 sources its claims cite were checked for support.
Abstract
It is unknown to what extent medical researchers generalize study findings beyond their samples when their sample size, sample diversity, or knowledge of conditions that support external validity do not warrant it. It is also unknown to what extent medical researchers describe their results with precise quantifications or unquantified generalizations, i.e., generics, that can obscure variations between individuals. We therefore systematically reviewed all prospective studies (n = 533) published in the top four highest ranking medical journals, Lancet, New England Journal of Medicine (NEJM), Journal of the American Medical Association (JAMA), and the British Medical Journal (BMJ), from January 2022 to May 2023. We additionally reviewed all NEJM Journal Watch clinical research summaries (n = 143) published during the same time. Of all research articles reporting prospective studies, 52.5% included generalizations beyond specific national study populations, with the numbers of articles with generics varying significantly between journals (JAMA = 12%; Lancet = 77%) (p < 0.001, V = 0.48). There was no evidence that articles containing broader generalizations or generics were correlated with larger or more nationally diverse samples. Moreover, only 10.2% of articles with generalizations beyond specific national populations reported external validity strengthening factors that could potentially support such extrapolations. There was no evidence that original research articles and NEJM Journal Watch summaries intended for practitioners differed in their use of broad generalizations, including generics. Finally, from the journal with the highest citation impact, articles containing broader conclusions were correlated with more citations. Since there was no evidence that studies with generalizations beyond specific national study populations or with generics were associated with larger, more nationally diverse samples, or with reports of population similarity that may permit extensions of conclusions, our findings suggest that the generalizations in many articles were insufficiently supported. Caution against overly broad generalizations in medical research is warranted.
Overview
CoChat Summary
TL;DR
This systematic review of 533 prospective studies published in the four highest-impact medical journals (2022–2023) found that 52.5% contained result claims or recommendations generalizing beyond the specific national population sampled, with no evidence that such articles had larger or more nationally diverse samples. Generics appeared in 46.2% of all articles and varied sharply by journal (Lancet ~77% vs. JAMA ~12%), and the authors conclude that many of these generalizations were insufficiently supported.
Key findings
- Of 533 articles, 285 (53.5%) were coded as generalized; 246 contained generics (86.3% of generalized articles, 46.2% of all 533). Only 5 of the 285 generalized articles mentioned sample country or region in their generalized claims, so 52.5% (n = 280) of all articles contained claims not limited to a specific national sample.
- Journal differences were large and significant: generalized articles ranged from Lancet 83.7% to JAMA 19.1% (χ²(3) = 119.99, p < 0.001, V = 0.47); articles with generics ranged from Lancet 76.6% to JAMA 11.8% (χ²(3) = 120.87, p < 0.001, V = 0.48). Lancet vs. JAMA odds ratio for generalized scope was 21.74 (95% CI 11.32–41.75).
- No evidence that generalized articles or articles with generics had larger samples (r = −0.09, p = 0.08; r = −0.06, p = 0.22) or higher country/region counts (r = −0.05, p = 0.29; r = −0.03, p = 0.52). Of 285 generalized articles, 201 (70.5%) had only Western or only non-Western samples, and in 194 of these (68.1%) conclusions were not limited accordingly.
- Only 78 (27.4%) of generalized articles reported external validity strengthening factors, and only 29 (10.2%) concerned factors supporting generalization across nationalities; thus in 251 (88.1%) of generalized articles (47.1% of all 533) no reasons were offered for national similarity. Citation impact: generalized articles were only marginally higher overall (p = 0.049, r = −0.10), but for NEJM generalized articles had significantly higher impact (p = 0.005, r = −0.22) and more generalized claims correlated with higher impact (rs = 0.18, p = 0.005). NEJM Journal Watch summaries did not differ significantly from primary articles in generalized claims (χ²(1) = 0.14, p = 0.71) or generics (χ²(1) = 0.20, p = 0.66).
Methods
- Systematic review reported per PRISMA and preregistered on OSF; included all prospective studies published January 1, 2022–May 22, 2023 in Lancet, NEJM, JAMA, and BMJ (533 articles), plus all NEJM Journal Watch summaries of prospective studies from those journals (143 summaries across 35 issues). Retrospective studies, meta-analyses, systematic reviews, and guidelines were excluded.
- Three coders extracted title, journal, Google Scholar citation count, sample size, and sample country/region (categorized Western/non-Western), and identified all result claims across the entire article (title, highlights, abstract, introduction, discussion, conclusion), classifying each as restricted or generalized (unrestricted, hedged, or practice-related), with generics as a subset.
- Inter-rater agreement was substantial to high (Cohen's κ = 0.80–0.97; project-naïve coders on 25% of data: κ = 0.88–0.89). Non-parametric tests (χ², Kruskal-Wallis H, Mann-Whitney U, rank-biserial correlation, Spearman correlation, ϕ) were used; impact was analyzed via Relative Citation Rate; α = 0.05, two-tailed, in JASP and SPSS 29.0.
Limitations
- Stated: the analysis only captured whether generalizability strengthening factors were *reported*, not whether authors held relevant implicit background knowledge; only nationality was coded, not gender or age; only generalized claims (not all result claims) were counted, so restricted-vs-generalized claim proportions cannot be presented; only four top journals were included, so results may not generalize to the broader medical literature (though the authors argue estimates are likely conservative); country/region as a proxy for national diversity ignores expatriates, mixed demographics, and other diversity dimensions, and some Western countries are themselves highly diverse.
- Evident from the text: the citation-impact analysis relies on Google Scholar counts normalized as RCR, and the overall generalized-vs-restricted impact difference was only marginally significant (p = 0.049), with the association driven by NEJM alone; the study is observational and correlational, so no causal claims about editorial policy effects on generalization use can be established (the authors themselves call for further research on this).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
9 Valid · 0 Not valid · 32 Not checked · 103 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“while homogenous samples can be preferable to better control for confounders in research aiming to identify causal mechanisms [6]”
§ Hasty generalizations and generics in medical research: A systematic review > Introduction
What the sources say
- Supportedcites [6] KJ Rothman, 2013, Why Representativeness Should Be Avoided, Int J Epidemiol source
The paper's Design example (option A, enrol subjects aged 40-49) states that restricting to a narrow, homogeneous age band 'will greatly limit age imbalances that could confound the results, thereby enhancing the study validity' (p. 1012-1014 section, passage 4). Passage 5 makes the homogeneity point explicitly: immunologists 'select hamsters that are extremely unrepresentative because they are homogeneous, having identical genes, living in identical circumstances, and fed identical diets,' so that by controlling characteristics inferences generalize. Passage 6 ties this to causal mechanisms: 'the main road to general statements on nature is through studies that control skillfully for confounding variables and thereby advance our understanding of causal mechanisms.' Together these support the paraphrased claim. (LLM, conf=0.90)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“For instance, studies found that clopidogrel was less effective in Pacific Islanders [26]”
§ Hasty generalizations and generics in medical research: A systematic review > Discussion
What the sources say
- Partly supportedcites [26] NA Helsby, 2016, CYP2C19 and CYP2D6 genotypes in Pacific peoples, Brit J Clin Pharm sourceExperimental — accuracy not yet measured
Helsby's review does report that 'Maori and Pacific Island patients do appear to have a significantly higher rate of "high on clopidogrel platelet reactivity" compared to New Zealand Europeans (57% vs. 35.9%)' and that they 'have a higher rate of myocardial infarction and cardiovascular death on clopidogrel treatment than European patients' — but both are relayed from other studies (refs 18, 19) in New Zealand ACS cohorts, not measured by this author. Crucially, the same paper argues the opposite of a general efficacy claim: it finds 'no CYP2C19*2 gene dose association ... for rates of stent thrombosis across these ethnicities (event rates: 0.3%, 0.3% and 0.2% for European, Maori and Pacific Islanders)', attributes poor control to comorbidities such as diabetes rather than ethnicity, and labels statements that 'the standard 75 mg dose of clopidogrel is not efficacious for Hawaiians' as 'apocryphal' and 'not supported by the current literature' (Abstract, Conclusions, and the Hawai'i/clopidogrel paragraph). So the source supports only the narrower, NZ-restricted observation of suboptimal platelet response/outcomes, not the blanket statement that studies found clopidogrel less effective in Pacific Islanders. (LLM, conf=0.72)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, only 10.2% of articles with generalizations beyond specific national populations reported external validity strengthening factors that could potentially support such extrapolations.”
§ Hasty generalizations and generics in medical research: A systematic review > Abstract
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There was no evidence that articles containing broader generalizations or generics were correlated with larger or more nationally diverse samples.”
§ Hasty generalizations and generics in medical research: A systematic review > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finally, from the journal with the highest citation impact, articles containing broader conclusions were correlated with more citations.”
§ Hasty generalizations and generics in medical research: A systematic review > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
82 more claims
Create a free account to see all 144 claims and to verify the 53 references still open.
- Probably not a substantial claim. 33
- It may state two separate claims as one. 32
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Several recent studies found that scientists and science reporters also frequently overgeneralized or exaggerated scientific findings in their writings [16–18].”
From Generalization bias in large language model summarization of scientific research (2025) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Preference for past tense reporting is already common in top medical journals and has also been recommended for human science communicators [18,54].”
From Generalization bias in large language model summarization of scientific research (2025) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Relatedly, recent research found that generalizations of study results beyond the evidence provided by a given study were common in scientific articles across different disciplines [16–18].”
From Generalization bias in large language model summarization of scientific research (2025) · cites this paper as [18]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Result claims in past tense have a more limited generalization scope than present tense result claims because they refer to a particular sample and do not extend findings to the here and now [18].”
From Generalization bias in large language model summarization of scientific research (2025) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“Generics are known to obscure differences between individuals of a reference class since they are semantically underdetermined (e.g. the generic ‘children like sweets’ may refer to some, most, or all children) [18,26].”
From Generalization bias in large language model summarization of scientific research (2025) · cites this paper as [18]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentχ²(3) = 119.99reported p < .001 · recomputed p < .001
“χ2 (3) = 119.99, p < .001”
- Consistentχ²(3) = 120.87reported p < .001 · recomputed p < .001
“χ2 (3) = 120.87, p < .001”
- Consistentz = -1.97reported p = .049 · recomputed p = .049
“z =-1.97, p = .049”
- Consistentz = -0.311reported p = .75 · recomputed p = .756
“z =-0.311, p = .75”
The paper states an exact rank test
- Consistentz = -0.13reported p = .9 · recomputed p = .897
“z =-0.13, p = .90”
9 more recomputed tests
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Overlapping DRESS and Stevens-Johnson Syndrome: Case Report and Review of the Literature
Casagranda, A., Suppa, M., Dehavay, F., & del Marmol, V. (2017) · Case Reports in Dermatology · doi:10.1159/000475802 · Cited by 1,466
Lack of group-to-individual generalizability is a threat to human subjects research
Fisher, A. J., Medaglia, J. D., & Jeronimus, B. F. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711978115 · Cited by 1,099
Many Labs 2: Investigating variation in replicability across samples and settings
Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams, R. B., Alper, S., Aveyard, M., Axt, J. R., Babalola, M. T., Bahník, Š., et al. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918810225 · Cited by 944
Why Representativeness Should Be Avoided
Rothman, K. J., Gallacher, J. E., & Hatch, E. E. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dys223 · Cited by 861
Trial of Endovascular Treatment of Acute Basilar-Artery Occlusion
Tao, C., Nogueira, R. G., Zhu, Y., Sun, J., Han, H., Yuan, G., Wen, C., Zhou, P., Chen, W., Zeng, G., et al. (2022) · New England Journal of Medicine · doi:10.1056/nejmoa2206317 · Cited by 699
Google Scholar as a new source for citation analysis
Harzing, A., & van der Wal, R. (2008) · Ethics in Science and Environmental Politics · doi:10.3354/esep00076 · Cited by 673
Cultural Diversity and Mental Health: Considerations for Policy and Practice
Gopalkrishnan, N. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00179 · Cited by 518
Sumner, P., Vivian-Griffiths, S., Boivin, J., Williams, A., Venetis, C. A., Davies, A., Ogden, J., Whelan, L., Hughes, B., Dalton, B., et al. (2014) · BMJ · doi:10.1136/bmj.g7015 · Cited by 489
Why clinical trial outcomes fail to translate into benefits for patients
Heneghan, C., Goldacre, B., & Mahtani, K. R. (2017) · Trials · doi:10.1186/s13063-017-1870-2 · Cited by 404
A Concise Introduction to Logic
O’Regan, G. (2018) · World of Computing · doi:10.1007/978-3-319-75844-2_6 · Cited by 401
Takahashi, H., Wilkinson, G. R., Nutescu, E. A., Morita, T., Ritchie, M. D., Scordo, M. G., Pengo, V., Barban, M., Padrini, R., Ieiri, I., et al. (2006) · Pharmacogenetics and Genomics · doi:10.1097/01.fpc.0000184955.08453.a8 · Cited by 376
AMA manual of style: a guide for authors and editors
(2007) · Choice Reviews Online · doi:10.5860/choice.45-1788 · Cited by 329
Assessing the generalizability of randomized trial results to target populations
Stuart, E. A., Bradshaw, C. P., & Leaf, P. J. (2015) · Prevention Science · doi:10.1007/s11121-014-0513-z · Cited by 296
Tangamornsuksan, W., Chaiyakunapruk, N., Somkrua, R., Lohitnavy, M., & Tassaneeyakul, W. (2013) · JAMA Dermatology · doi:10.1001/jamadermatol.2013.4114 · Cited by 263
Nakachi, K., Ikeda, M., Konishi, M., Nomura, S., Katayama, H., Kataoka, T., Todaka, A., Yanagimoto, H., Morinaga, S., Kobayashi, S., et al. (2023) · The Lancet · doi:10.1016/s0140-6736(22)02038-4 · Cited by 258
Mitchell, P. J., Yan, B., Churilov, L., Dowling, R. J., Bush, S. J., Bivard, A., Huo, X. C., Wang, G., Zhang, S. Y., Ton, M. D., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(22)00564-5 · Cited by 229
Gender differences in how scientists present the importance of their research: observational study
Lerchenmueller, M. J., Sorenson, O., & Jena, A. B. (2019) · BMJ · doi:10.1136/bmj.l6573 · Cited by 211
Target Validity and the Hierarchy of Study Designs
Westreich, D., Edwards, J. K., Lesko, C. R., Cole, S. R., & Stuart, E. A. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwy228 · Cited by 165
Generic language in scientific communication
DeJesus, J. M., Callanan, M. A., Solis, G., & Gelman, S. A. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1817706116 · Cited by 157
McCollum, A. D. (2002) · CancerSpectrum Knowledge Environment · doi:10.1093/jnci/94.15.1160 · Cited by 146
Clinical Trial Generalizability Assessment in the Big Data Era: A Review
He, Z., Tang, X., Yang, X., Guo, Y., George, T. J., Charness, N., Quan Hem, K. B., Hogan, W., & Bian, J. (2020) · Clinical and Translational Science · doi:10.1111/cts.12764 · Cited by 130
A bibliometric analysis of topic modelling studies (2000–2017)
Li, X., & Lei, L. (2019) · Journal of Information Science · doi:10.1177/0165551519877049 · Cited by 130 · cited 1×
“For the impact analysis, we followed previous studies, identified each article’s online publication date, and normalized the article’s total citation count by calculating the Relative Citation Rate (RCR) [25], before using the RCR as a continuous dependent variable.”
MethodImproving diversity in medical research
Sharma, A., & Palaniappan, L. (2021) · Nature Reviews Disease Primers · doi:10.1038/s41572-021-00316-8 · Cited by 107
The language of generalization
Tessler, M. H., & Goodman, N. D. (2019) · Psychological Review · doi:10.1037/rev0000142 · Cited by 101
AMA Manual of Style Committee (2020) · doi:10.1093/jama/9780190246556.001.0001 · Cited by 65
Generalization Bias in Science
Peters, U., Krauss, A., & Braganza, O. (2022) · Cognitive Science · doi:10.1111/cogs.13188 · Cited by 63 · cited 3×
“But, if, as a result, their use in science is incentivized, this can have the unintended consequence of promoting overgeneralizations [38].”
BackgroundSelf-citationLiao, K., Liu, Y., Ai, C.-Z., Yu, X., & Li, W. (2018) · Int. Journal of Clinical Pharmacology and Therapeutics · doi:10.5414/cp203083 · Cited by 41
Hanin, L. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0399-0 · Cited by 32
The link between intuitive thinking and social conservatism is stronger in WEIRD societies
Yilmaz, O., & Alper, S. (2019) · Judgment and Decision Making · doi:10.1017/s1930297500003399 · Cited by 27
CYP2C19 and CYP2D6 genotypes in Pacific peoples
Helsby, N. A. (2016) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.13045 · Cited by 20
Jafrin, S., Naznin, N. E., Reza, M. S., Aziz, M. A., & Islam, M. S. (2021) · European Journal of Internal Medicine · doi:10.1016/j.ejim.2021.05.022 · Cited by 17
Science Communication and the Problematic Impact of Descriptive Norms
Peters, U. (2023) · The British Journal for the Philosophy of Science · doi:10.1086/715001 · Cited by 13
Self-citationDeJesus, J. M., Callanan, M. A., Umscheid, V. A., & Gelman, S. A. (2023) · Journal of Cognition and Development · doi:10.1080/15248372.2023.2290504 · Cited by 13
Okhuijsen‐Pfeifer, C., Ayhan, Y., Lin, B. D., van Eijk, K. R., Bekema, E., Kool, L., Bogers, J. P. A. M., Müderrisoğlu, A., Babaoglu, M. O., Assche, E. V., et al. (2020) · Schizophrenia Bulletin Open · doi:10.1093/schizbullopen/sgaa024 · Cited by 8
Hasty Generalizations Are Pervasive in Experimental Philosophy: A Systematic Analysis
Peters, U., & Lemeire, O. (2023) · Philosophy of Science · doi:10.1017/psa.2023.109 · Cited by 7
Self-citationGeneralisation and extrapolation of study results
Sedgwick, P. (2013) · BMJ · doi:10.1136/bmj.f3022 · Cited by 4
Generalizations in Clinical Trials—Do Generics Help Or Harm?
Chin-Yee, B. (2023) · Kennedy Institute of Ethics Journal · doi:10.1353/ken.2023.a931051 · Cited by 4
Self-citation(1884) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1884.02390590016003 · Cited by 1
Research works printed but not linked: 4
- M Krifka, 1995, The Generic Book
- K. Vela, 2023, NEJM Journal Watch, J Electron Resour Medical Libr, 20, 33
- JAMA Network. Instructions for Authors. JAMA. 2024; https://jamanetwork.com/journals/jama/pages/instructions-for-authors. Accessed April 5, 2024.
- The Lancet. Randomised Controlled Trials Guidelines. 2024; https://www.thelancet.com/pb/assets/raw/Lancet/authors/RCTguidelines-1668613849943.pdf. Accessed April 5, 2024.
Cited by
Generalization bias in large language model summarization of scientific research
Peters, U., & Chin-Yee, B. (2025) · Royal Society Open Science · doi:10.1098/rsos.241776 · Cited by 126
Self-citationPeters, U., Bertazzoli, A., DeJesus, J. M., van der Velden, G. J., & Chin-Yee, B. H. (2026) · Public Understanding of Science · doi:10.1177/09636625261425891 · Cited by 4
“…of a kind (people, statins, etc.) (Cimpian et al., 2010), corpus analyses found that many scientists used them to describe findings even when they were based on small, unrepresentative samples that did not justify such broad claims (DeJesus et al., 2019; Peters et al., 2024; Rad et al., 2018).”
Self-citationHidden processes of workflow in cognitive developmental psychology
Girouard‐Hallam, L. N., & Gelman, S. A. (2026) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2024.0611 · Cited by 2
Fernandez-Agudo, A., Lester, H., Tarazona, J. V., & Rivero‐Pino, F. (2026) · Frontiers in Toxicology · doi:10.3389/ftox.2026.1829326
“For example, results derived from specific subgroups may not capture variability across the general population or may lack sufficient detail to inform subgroup-specific risk assessments, highlighting the need for careful interpretation rather than direct generalization (Peters et al., 2024).”
Chen, Y., Ou, Z., Deng, Y., Luo, A., Li, X., Yang, Y., Yang, Q., Wu, X., & Zhou, M. (2026) · Journal of Medical Internet Research · doi:10.2196/83821 · Cited by 4
“However, due to the limited number and potential representativeness concerns [136], the generalizability of this finding requires cautious interpretation.”
Metadata
- Authors
- Peters, U., Sherling, H. R., & Chin-Yee, B.
- Affiliations
- Utrecht University (NL)
- University of Cambridge (GB)
- Western University (CA)
- Corresponding author
- Peters, Uwe
- Sherling, Henrik Røed
- Chin-Yee, Benjamin
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2024-07-05
- Volume
- 19
- Issue
- 7
- Pages
- e0306749
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC11226088
- OpenAlex
- W4400350189
- Cited by
- 11
- References
- 42
- Citations by year
- 2026: 8 · 2025: 3
- FWCI
- 1.38
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- PhilPapers (PhilPapers Foundation) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- overgeneralization, generalizability, sample size, sample diversity, population similarity, prospective study, medical journal articles, citation impact, reporting quality
- MeSH terms
- Humans, Periodicals as Topic, Prospective Studies, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.