Do changes in health reveal the possibility of undiagnosed pancreatic cancer? Development of a risk-prediction model based on healthcare claims data
Open accessAbstract
BACKGROUND AND OBJECTIVE: Early detection methods for pancreatic cancer are lacking. We aimed to develop a prediction model for pancreatic cancer based on changes in health captured by healthcare claims data. METHODS: We conducted a case-control study on 29,646 Medicare-enrolled patients aged 68 years and above with pancreatic ductal adenocarcinoma (PDAC) reported to the Surveillance Epidemiology an End Results (SEER) tumor registries program in 2004-2011 and 88,938 age and sex-matched controls. We developed a prediction model using multivariable logistic regression on Medicare claims for 16 risk factors and pre-diagnostic symptoms of PDAC present within 15 months prior to PDAC diagnosis. Claims within 3 months of PDAC diagnosis were excluded in sensitivity analyses. We evaluated the discriminatory power of the model with the area under the receiver operating curve (AUC) and performed cross-validation by bootstrapping. RESULTS: The prediction model on all cases and controls reached AUC of 0.68. Excluding the final 3 months of claims lowered the AUC to 0.58. Among new-onset diabetes patients, the prediction model reached AUC of 0.73, which decreased to 0.63 when claims from the final 3 months were excluded. Performance measures of the prediction models was confirmed by internal validation using the bootstrap method. CONCLUSION: Models based on healthcare claims for clinical risk factors, symptoms and signs of pancreatic cancer are limited in classifying those who go on to diagnosis of pancreatic cancer and those who do not, especially when excluding claims that immediately precede the diagnosis of PDAC.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Several studies show that the probability PDAC development can be further increased by including additional factors such as weight change, ethnicity, and lifestyle factors that are commonly contained in electronic medical records.
“Of note, several studies show that the probability PDAC development can be further increased by including additional factors such as weight change, ethnicity, and lifestyle factors that are commonly contained in electronic medical records.171–178”
From Artificial Intelligence and Early Detection of Pancreatic Cancer: 2020 Summative Review (2021) · cites this paper as [176]
The Methods and Results include weight loss and race in analyses of PDAC risk. The Discussion says lifestyle data were unavailable in this claims-based study and that their availability would have improved its models; it does not demonstrate that adding those factors increased predictive performance or establish that they are commonly recorded in electronic medical records. Our copy provides no page numbers for these passages. (LLM, conf=0.84)
Experimental — accuracy not yet measuredA Medicare claims model for new-onset diabetes, applied to people aged 68 years or older, identified a 3.5% predicted risk of pancreatic ductal adenocarcinoma over 1 year (AUC 0.73).
“This model has been applied to an older population (≥68 years) with new-onset diabetes, and identified people at 3·5% predicted risk of pancreatic ductal adenocarcinoma over 1 year (AUC 0·73).106”
From Early detection of pancreatic cancer (2020) · cites this paper as [106]
Further insurance-claim models have been developed and have poor diagnostic performance (AUC 0.73).
“Further models based on insurance claims have been developed, with poor diagnostic performance (AUC 0·73).106,107”
From Early detection of pancreatic cancer (2020) · cites this paper as [106]
Parametric models have been developed to identify high risk of pancreatic ductal adenocarcinoma among people with new-onset diabetes or pre-diabetes, with varying predictive performance.
“Parametric models that can identify high risk for pancreatic ductal adenocarcinoma among individuals with new-onset diabetes, or new-onset pre-diabetes, have been developed, with varying predictive performances.103–106”
From Early detection of pancreatic cancer (2020) · cites this paper as [106]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020 · see citing works
Rahib, L., Smith, B. D., Aizenberg, R., Rosenzweig, A. B., Fleshman, J. M., & Matrisian, L. M. (2014) · Cancer Research · doi:10.1158/0008-5472.can-14-0155 · Cited by 7,094 · see citing works
PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies
Wolff, R. F., Moons, K. G. M., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group† (2019) · Annals of Internal Medicine · doi:10.7326/m18-1376 · Cited by 2,984 · see citing works
Akaike's Information Criterion in Generalized Estimating Equations
Pan, W. (2001) · Biometrics · doi:10.1111/j.0006-341x.2001.00120.x · Cited by 2,507 · see citing works
Generalized Estimating Equations
Hardin, J. W., & Hilbe, J. M. (2002) · doi:10.1201/9781420035285 · Cited by 1,766 · see citing works
Warren, J. L., Klabunde, C. N., Schrag, D., Bach, P. B., & Riley, G. F. (2002) · PubMed · doi:10.1097/01.mlr.0000020942.47004.03 · Cited by 1,719 · see citing works
Type-II diabetes and pancreatic cancer: a meta-analysis of 36 studies
Huxley, R., Ansary-Moghaddam, A., Berrington de González, A., Barzi, F., & Woodward, M. (2005) · British Journal of Cancer · doi:10.1038/sj.bjc.6602619 · Cited by 1,105 · see citing works
Scott, T. L., Gazmararian, J. A., Williams, M. V., & Baker, D. W. (2002) · Medical Care · doi:10.1097/00005650-200205000-00005 · Cited by 743 · see citing works
Diabetes mellitus and risk of pancreatic cancer: A meta-analysis of cohort studies
Ben, Q., Xu, M., Ning, X., Liu, J., Hong, S., Huang, W., Zhang, H., & Li, Z. (2011) · European Journal of Cancer · doi:10.1016/j.ejca.2011.03.003 · Cited by 685 · see citing works
Sauver, J. L. S., Grossardt, B. R., Yawn, B. P., Melton, L. J., & Rocca, W. A. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq482 · Cited by 649 · see citing works
Probability of Pancreatic Cancer Following Diabetes: A Population-Based Study
Chari, S. T., Leibson, C. L., Rabe, K. G., Ransom, J., de Andrade, M., & Petersen, G. M. (2005) · Gastroenterology · doi:10.1053/j.gastro.2005.05.007 · Cited by 603 · see citing works
New-onset diabetes: a potential clue to the early diagnosis of pancreatic cancer
Pannala, R., Basu, A., Petersen, G. M., & Chari, S. T. (2008) · The Lancet Oncology · doi:10.1016/s1470-2045(08)70337-1 · Cited by 562 · see citing works
Model to determine risk of pancreatic cancer in patients with new-onset diabetes
Sharma, A., Kandlakunta, H., Nagpal, S. J. S., Feng, Z., Hoos, W., Petersen, G. M., & Chari, S. T. (2018) · Gastroenterology · doi:10.1053/j.gastro.2018.05.023 · Cited by 394 · see citing works
A Stepwise AIC Method for Variable Selection in Linear Regression
Yamashita, T., Yamashita, K., & Kamimura, R. (2007) · Communication in Statistics- Theory and Methods · doi:10.1080/03610920701215639 · Cited by 322 · see citing works
Bosetti, C., Rosato, V., Li, D., Silverman, D. T., Petersen, G. M., Bracci, P. M., Neale, R. Ε., Muscat, J. E., Anderson, K. E., Gallinger, S., et al. (2014) · Annals of Oncology · doi:10.1093/annonc/mdu276 · Cited by 289 · see citing works
Duell, E. J., Lucenteforte, E., Olson, S. H., Bracci, P. M., Li, D., Risch, H. A., Silverman, D. T., Ji, B., Gallinger, S., Holly, E. A., et al. (2012) · Annals of Oncology · doi:10.1093/annonc/mds140 · Cited by 267 · see citing works
Self-citationLucenteforte, E., Vecchia, C. L., Silverman, D. T., Petersen, G. M., Bracci, P. M., Ji, B.-T., Bosetti, C., Li, D., Gallinger, S., Miller, A. B., et al. (2011) · Annals of Oncology · doi:10.1093/annonc/mdr120 · Cited by 241 · see citing works
Boursi, B., Finkelman, B., Giantonio, B. J., Haynes, K., Rustgi, A. K., Rhim, A. D., Mamtani, R., & Yang, Y.-X. (2017) · Gastroenterology · doi:10.1053/j.gastro.2016.11.046 · Cited by 202 · see citing works
Stapley, S., Peters, T. J., Neal, R. D., Rose, P. W., Walter, F. M., & Hamilton, W. (2012) · British Journal of Cancer · doi:10.1038/bjc.2012.190 · Cited by 183 · see citing works
Utility of the SEER-Medicare data to identify chemotherapy use.
Warren, J. L., Harlan, L. C., Fahey, A., et al. (2002) · PubMed · doi:10.1097/01.mlr.0000020944.17670.d7 · Cited by 170 · see citing works
Hebert, P. L., Frick, K. D., Kane, R. L., et al. (2005) · PubMed · doi:10.1111/j.1475-6773.2005.00370.x · Cited by 157 · see citing works
United Kingdom: Health System Review.
Cylus, J., Richardson, E., Findley, L. R., Longley, M. J., O’Neill, C., & Steel, D. (2015) · PubMed · Cited by 157 · see citing works
Alsamarrai, A., Das, S. L. M., Windsor, J. A., & Petrov, M. S. (2014) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2014.01.038 · Cited by 149 · see citing works
Klein, A. P., Lindström, S., Mendelsohn, J. B., Steplowski, E., Arslan, A. A., Bueno-de-Mesquita, H. B., Fuchs, C. S., Gallinger, S., Gross, M., Helzlsouer, K., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072311 · Cited by 148 · see citing works
Self-citationEngels, E. A., Pfeiffer, R. M., Ricker, W., Wheeler, W., Parsons, R., & Warren, J. L. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr146 · Cited by 144 · see citing works
Weight Loss, Diabetes, Fatigue, and Depression Preceding Pancreatic Cancer
Olson, S. H., Xu, Y., Herzog, K., Saldia, A., DeFilippis, E. M., Li, P. C.-W., Allen, P. J., O'Reilly, E. M., & Kurtz, R. C. (2015) · Pancreas · doi:10.1097/mpa.0000000000000590 · Cited by 85 · see citing works
Keane, M. G., Horsfall, L., Rait, G., & Pereira, S. P. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-005720 · Cited by 81 · see citing works
Risch, H. A., Yu, H., Lu, L., & Kidd, M. S. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwv026 · Cited by 62 · see citing works
Self-citationDiabetes and Pancreatic Cancer: Both Cause and Effect
Risch, H. A. (2018) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djy093 · Cited by 45 · see citing works
Self-citationDevelopment and Validation of a Prediction Model to Estimate Individual Risk of Pancreatic Cancer
Yu, A., Woo, S. M., Joo, J., Yang, H.-R., Lee, W. J., Park, S.-J., & Nam, B.-H. (2016) · PLOS ONE · doi:10.1371/journal.pone.0146473 · Cited by 28 · see citing works
Association between family cancer history and risk of pancreatic cancer
Schulte, A., Pandeya, N., Fawcett, J., Fritschi, L., Klein, K., Risch, H. A., Webb, P. M., Whiteman, D. C., & Neale, R. Ε. (2016) · Cancer Epidemiology · doi:10.1016/j.canep.2016.10.005 · Cited by 24 · see citing works
Self-citationHarrell, F., Jr. (1996) · doi:10.1002/(sici)1097-0258(19960229)15:4
Flagged first, then by citations
Research works printed but not linked: 3
- [24]Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, et al Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010; 21(1): 128– 38. 10.1097/EDE.0b013e3181c30fb2 20010215 PMC3575184 · DOI · Paper page
- [25]Harrell FE. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. New York: Springer; 2001 xxii, 568 p. p.
- [27]Steyerberg EW, Harrell FE Jr., Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol. 2001; 54(8): 774– 81.. 11470385
Cited by
Sorted by citations
Early detection of pancreatic cancer
Pereira, S. P., Oldfield, L., Ney, A., Hart, P. A., Keane, M. G., Pandol, S. J., Li, D., Greenhalf, W., Jeon, C. Y., Koay, E. J., et al. (2020) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(19)30416-9 · Cited by 482 · see citing works
Self-citationArtificial Intelligence and Early Detection of Pancreatic Cancer: 2020 Summative Review
Kenner, B., Chari, S. T., Kelsen, D., Klimstra, D. S., Pandol, S. J., Rosenthal, M., Rustgi, A. K., Taylor, J. A., Yala, A., Abul-Husn, N., et al. (2021) · Pancreas · doi:10.1097/mpa.0000000000001762 · Cited by 158 · see citing works
Self-citation
- Authors
- Baecker, A., Kim, S., Risch, H. A., Nuckols, T. K., Wu, B. U., Hendifar, A. E., Pandol, S. J., Pisegna, J. R., & Jeon, C. Y.
- Affiliations
- University of California, Los Angeles (US)
- Cedars-Sinai Medical Center (US)
- Yale University (US)
- Kaiser Permanente (US)
- VA Greater Los Angeles Healthcare System (US)
- Corresponding author
- Jeon, Christie Y.
- ORCID
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-06-25
- Volume
- 14
- Issue
- 6
- Pages
- e0218580
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC6592596
- OpenAlex
- W2954988597
- Cited by
- 31
- References
- 32
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 4 · 2023: 7 · 2022: 5 · 2021: 4 · 2020: 5
- FWCI
- 1.46
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship (California Digital Library) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- Funders
- National Cancer Institute (US) (R21CA220073)
- National Institute of Diabetes and Digestive and Kidney Diseases (U01DK108314)
- Topics
- Health Sciences › Medicine › Oncology › Pancreatic and Hepatic Oncology Research
- Health Sciences › Medicine › Oncology › Global Cancer Incidence and Screening
- Health Sciences › Medicine › Surgery › Pancreatitis Pathology and Treatment
- Keywords
- pancreatic ductal adenocarcinoma, risk prediction model, health insurance claims data, Medicare claims data, pre-diagnostic symptoms, new-onset diabetes, older adults
- MeSH terms
- Administrative Claims, Healthcare, Undiagnosed Diseases, Adenocarcinoma, Aged, Aged, 80 and over, Female, Health Status, Humans, Male, Pancreatic Neoplasms, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review