A Joint Model for Multistate Disease Processes and Random Informative Observation Times, with Applications to Electronic Medical Records Data
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Summary: Multistate models are used to characterize individuals’ natural histories through diseases with discrete states. Observational data resources based on electronic medical records pose new opportunities for studying such diseases. However, these data consist of observations of the process at discrete sampling times, which may either be pre-scheduled and non-informative, or symptom-driven and informative about an individual's underlying disease status. We have developed a novel joint observation and disease transition model for this setting. The disease process is modeled according to a latent continuous-time Markov chain; and the observation process, according to a Markov-modulated Poisson process with observation rates that depend on the individual's underlying disease status. The disease process is observed at a combination of informative and non-informative sampling times, with possible misclassification error. We demonstrate that the model is computationally tractable and devise an expectation-maximization algorithm for parameter estimation. Using simulated data, we show how estimates from our joint observation and disease transition model lead to less biased and more precise estimates of the disease rate parameters. We apply the model to a study of secondary breast cancer events, utilizing mammography and biopsy records from a sample of women with a history of primary breast cancer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cancer treatment and survivorship statistics, 2016
Miller, K. D., Siegel, R. L., Lin, C. C., Mariotto, A. B., Kramer, J. L., Rowland, J. H., Stein, K. D., Alteri, R., & Jemal, A. (2016) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21349 · Cited by 6,066
Research works printed but not linked: 55
- Aalen, 1995, Phase type distributions in survival analysis, Scandinavian Journal of Statistics, 22, 447
- Andersen, 2002, Multi-state models for event history analysis, Statistical Methods in Medical Research, 11, 91, 10.1191/0962280202SM276ra · DOI · Paper page
- Andreetta, 2007, Adjuvant endocrine therapy for early breast cancer, Cancer Letters, 251, 17, 10.1016/j.canlet.2006.10.021 · DOI
- Baum, 1970, A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains, Annals of Mathematical Statistics, 41, 164, 10.1214/aoms/1177697196 · DOI · Paper page
- Boer, 2004, Diversity of model approaches for breast cancer screening: A review of model assumptions by the Cancer Intervention and Surveillance Network (CISNET) Breast Cancer Groups, Statistical Methods in Medical Research, 13, 525, 10.1191/0962280204sm381ra · doi:10.1191/0962280204sm381ra
- Buist, 2010, Diagnosis of second breast cancer events after initial diagnosis of early stage breast cancer, Breast Cancer Research and Treatment, 124, 863, 10.1007/s10549-010-1106-6 · DOI
- Buist, 2013, Long-term surveillance mammography and mortality in older women with a history of early stage invasive breast cancer, Breast Cancer Research and Treatment, 142, 153, 10.1007/s10549-013-2720-x · DOI
- Chapman, 1999, Competing risks analyses for recurrence from primary breast cancer, British Journal of Cancer, 79, 1508, 10.1038/sj.bjc.6690240 · doi:10.1038/sj.bjc.6690240
- Chen, 2010, Analysis of interval-censored disease progression data via multi-state models under a nonignorable inspection process, Statistics in Medicine, 29, 1175, 10.1002/sim.3804 · DOI
- Chen, 2011, Non-homogeneous Markov process models with informative observations with an application to Alzheimer's disease, Biometrical Journal, 53, 444, 10.1002/bimj.201000122 · DOI
- Chen, 2013, A correlated random effects model for non-homogeneous Markov processes with nonignorable missingness, Journal of Multivariate Analysis, 117, 1, 10.1016/j.jmva.2013.01.009 · DOI
- Chen, 2004, Semi-Markov models for multistate data analysis with periodic observations, Communications in Statistics—Theory and Methods, 33, 475, 10.1081/STA-120028679 · doi:10.1081/sta-120028679
- Cumani, 1982, On the canonical representation of homogeneous Markov processes modelling failure-time distributions, Microelectronics and Reliability, 22, 583, 10.1016/0026-2714(82)90033-6 · DOI · Paper page
- Daley, 2003, An Introduction to the Theory of Point Processes
- de Bock, 2006, Isolated loco-regional recurrence of breast cancer is more common in young patients and following breast conserving therapy: Long-term results of European Organisation for Research and Treatment of Cancer studies, European Journal of Cancer, 42, 351, 10.1016/j.ejca.2005.10.006 · DOI · Paper page
- Dean, 2009, Use of electronic medical records for health outcomes research: A literature review, Medical Care Research and Review, 66, 611, 10.1177/1077558709332440 · DOI · Paper page
- Demicheli, 1996, Time distribution of the recurrence risk for breast cancer patients undergoing masectomy: Further support about the concept of tumor dormancy, Breast Cancer Research and Treatment, 41, 177, 10.1007/BF01807163 · DOI · Paper page
- Dempster, 1977, Maximum likelihood from incomplete data via the EM algorithm, Journal of the Royal Statistical Society, 39, 1, 10.1111/j.2517-6161.1977.tb01600.x · DOI · Paper page
- Diggle, 2010, Geostatistical inference under preferential sampling, Journal of the Royal Statistical Society, Series C, 59, 191, 10.1111/j.1467-9876.2009.00701.x · DOI · Paper page
- Dillon, 2005, The accuracy of ultrasound, stereotactic, and clinical core biopsies in the diagnosis of breast cancer, with an analysis of false-negative cases, Annals of Surgery, 242, 701, 10.1097/01.sla.0000186186.05971.e0 · doi:10.1097/01.sla.0000186186.05971.e0
- Etzioni, 1997, Estimating asymptomatic duration in cancer: The AIDS connection, Statistics in Medicine, 16, 627, 10.1002/(SICI)1097-0258(19970330)16:6<627::AID-SIM438>3.0.CO;2-7 · doi:10.1002/(sici)1097-0258(19970330)16:6<627::aid-sim438>3.0.co;2-7
- Fassil, 2014, Approaches for classifying the indications for colonoscopy using detailed clinical data, BioMed Central Cancer, 14
- Fearnhead, 2006, An exact Gibbs sampler for the Markov-modulated Poisson process, Journal of the Royal Statistical Society, 68, 767, 10.1111/j.1467-9868.2006.00566.x · doi:10.1111/j.1467-9868.2006.00566.x
- Fenton, 2014, Distinguishing screening from diagnostic mammograms using medicare claims data, Medical Care, 52, 44, 10.1097/MLR.0b013e318269e0f5 · doi:10.1097/mlr.0b013e318269e0f5
- Freed, 1982, A Poisson process whose rate is a hidden Markov process, Advances in Applied Probability, 14, 21, 10.2307/1426731 · doi:10.2307/1426731
- Geiger, 2007, Recurrences and second primary breast cancers in older women with initial early-stage disease, Cancer, 109, 966, 10.1002/cncr.22472 · DOI · Paper page
- Gerhard, 2011, Apply the multivarate time-rescaling theorem to neural population models, Neural Computation, 23, 1452, 10.1162/NECO_a_00126 · DOI
- Gilbert, 2012, numDeriv: Accurate Numerical Derivatives
- Gruger, 1991, The validity of inferences based on incomplete observations in disease state models, Biometrics, 47, 595, 10.2307/2532149 · DOI
- Houssami, 2011, Accuracy and outcomes of screening mammography in women with a personal history of early-stage breast cancer, Journal of the American Medical Association, 305, 790, 10.1001/jama.2011.188 · doi:10.1001/jama.2011.188
- Hubbard, 2008, Modeling nonhomogeneous Markov processes via time transformation, Biometrics, 64, 843, 10.1111/j.1541-0420.2007.00932.x · doi:10.1111/j.1541-0420.2007.00932.x
- Kalbfleisch, 1985, The analysis of panel data under a Markov assumption, Journal of the American Statistical Association, 80, 863, 10.1080/01621459.1985.10478195 · DOI · Paper page
- Kang, 2007, Statistical methods for panel data from a semi-Markov process, with application to HPV, Biostatistics, 8, 252, 10.1093/biostatistics/kxl006 · DOI
- Kay, 1986, A Markov model for analysing cancer markers and disease states in survival studies, Biometrics, 42, 855, 10.2307/2530699 · DOI · Paper page
- Lange, 2013, Fitting and interpreting continuous-time latent Markov models for panel data, Statistics in Medicine, 32, 4581, 10.1002/sim.5861 · doi:10.1002/sim.5861
- Li, 2013, Semiparametric transformation models for panel count data with correlated observation and follow-up times, Statistics in Medicine, 32, 3039, 10.1002/sim.5724 · doi:10.1002/sim.5724
- Lindqvist, 2013, Proceedings of the 59th ISI World Statistics Congress, 25
- Longini, 1989, Statistical analysis of the stages of HIV infection using a Markov model, Statistics in Medicine, 8, 831, 10.1002/sim.4780080708 · DOI · Paper page
- Lu, 2012, Markov modulated Poisson process associated with state-dependent marks and its applications to the deep earthquakes, Annals of the Institute of Statistical Mathematics, 64, 87, 10.1007/s10463-010-0302-9 · doi:10.1007/s10463-010-0302-9
- Mark, 2013, An EM algorithm for continuous-time bivariate Markov chains, Computational Statistics & Data Analysis, 57, 504, 10.1016/j.csda.2012.07.017 · DOI
- Meira-Machodo, 2009, Multi-state models for the analysis of time-to-event data, Statistical Methods in Medical Research, 18, 195, 10.1177/0962280208092301 · DOI · Paper page
- Meyer, 1971, Démonstration simplifiée d'un théorème de Knight, Séminaire de probabilités de Strasbourg, 5, 191
- Moran, 2008, Long-term outcomes and clinicopathologic differences of African-American versus white patients treated with breast conservation therapy for early-stage breast cancer, Cancer, 113, 2565, 10.1002/cncr.23881 · doi:10.1002/cncr.23881
- R Core Team, 2013, R: A Language and Environment for Statistical Computing
- Robertson, 2011, Surveillance mammography for detecting ipsilateral breast tumour recurrence and metachronous contralateral breast cancer: A systematic review, European Radiology, 21, 2484, 10.1007/s00330-011-2226-z · doi:10.1007/s00330-011-2226-z
- Ryden, 1996, An EM algorithm for estimation in Markov-modulated Poisson processes, Computational Statistics & Data Analysis, 21, 431, 10.1016/0167-9473(95)00025-9 · DOI · Paper page
- Saint-Pierre, 2003, The analysis of asthma control under a Markov assumption with use of covariates, Statistics in Medicine, 22, 3755, 10.1002/sim.1680 · DOI
- Steele, 2010, Frontiers of Statistical Decision Making and Bayesian Analysis, 113
- Sun, 2005, Semiparametric regression analysis of longitudinal data with informative observation times, Journal of the American Statistical Association, 100, 882, 10.1198/016214505000000060 · DOI
- Sundberg, 1973, Maximum likelihood theory for incomplete data from an exponential family, Scandinavian Journal of Statistics, 1, 49
- Sweeting, 2010, Multi-state Markov models for disease progression in the presence of informative examination times: An application to hepatitis C, Statistics in Medicine, 29, 1161, 10.1002/sim.3812 · DOI
- Titman, 2011, Flexible nonhomogeneous Markov models for panel observed data, Biometrics, 67, 780, 10.1111/j.1541-0420.2010.01550.x · DOI
- Titman, 2008, A general goodness-of-fit test for Markov and hidden Markov models, Statistics in Medicine, 27, 2177, 10.1002/sim.3033 · DOI
- Titman, 2010, Semi-Markov models with phase-type sojourn distributions, Biometrics, 66, 742, 10.1111/j.1541-0420.2009.01339.x · DOI
- Wirtz, 2014, Factors associated with long-term adherence to annual surveillance mammography among breast cancer survivors, Breast Cancer Research and Treatment, 143, 541, 10.1007/s10549-013-2816-3 · DOI
Cited by
(2016) · PubMed · Cited by 576
Informative presence bias in analyses of electronic health records-derived data: a cautionary note
Harton, J., Mitra, N., & Hubbard, R. A. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac050 · Cited by 29
Self-citationApplied Methods for Estimating Transition Probabilities from Electronic Health Record Data
Rodriguez, P. J., Ward, Z. J., Long, M. W., Austin, S. B., & Wright, D. R. (2021) · Medical Decision Making · doi:10.1177/0272989x20985752 · Cited by 10
“Methods have been proposed to address informative sampling times by jointly modeling the observation process and the disease process.(37) The joint modeling method uses information on whether visits were scheduled in advance or initiated by patients because of disease symptoms.”
Method
Metadata
- Authors
- Lange, J. M., Hubbard, R. A., Inoue, L. Y. T., & Minin, V. N.
- Venue
- Biometrics
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-10-15
- Volume
- 71
- Issue
- 1
- Pages
- 90-101
- ISSN
- 0006-341X
- 1541-0420
- Cited by
- 49
- References
- 1
- Language
- en
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Funders
- NIH (R01-AI107034, R01-CA160239, U01-CA063731)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Joint Model for Multistate Disease Processes and Random Informative Observation Times, with Applications to Electronic Medical Records Data. https://app.cochat.ai/papers/10.1111/biom.12252
- The paper
- Lange, J. M., Hubbard, R. A., Inoue, L. Y. T., & Minin, V. N. (2015). A Joint Model for Multistate Disease Processes and Random Informative Observation Times, with Applications to Electronic Medical Records Data. Biometrics. https://doi.org/10.1111/biom.12252
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.