Generating Digital Twins with Multiple Sclerosis Using Probabilistic Neural Networks
Open accessAbstract
Multiple Sclerosis (MS) is a neurodegenerative disorder characterized by a complex set of clinical assessments. We use an unsupervised machine learning model called a Conditional Restricted Boltzmann Machine (CRBM) to learn the relationships between covariates commonly used to characterize subjects and their disease progression in MS clinical trials. A CRBM is capable of generating digital twins, which are simulated subjects having the same baseline data as actual subjects. Digital twins allow for subject-level statistical analyses of disease progression. The CRBM is trained using data from 2395 subjects enrolled in the placebo arms of clinical trials across the three primary subtypes of MS. We discuss how CRBMs are trained and show that digital twins generated by the model are statistically indistinguishable from their actual subject counterparts along a number of measures.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Unlearn.AI has developed and tested digital twin models that leverage diverse sets of clinical data to enhance clinical trials for Alzheimer's disease and multiple sclerosis.
“From a commercial point of view, Unlearn.AI has developed and tested digital twin models that leverage diverse sets of clinical data to enhance clinical trials for Alzheimer's disease and multiple sclerosis 70,71 .”
From Multimodal biomedical AI (2022) · cites this paper as [71]
The Abstract and Discussion report that the authors developed and statistically tested digital twins using varied clinical data from multiple-sclerosis trials, and describe potential uses in trial analysis. The Discussion mentions earlier work by the authors on Alzheimer’s disease, but this paper does not itself describe or test that model. It also presents trial enhancement as a potential application, not a demonstrated outcome. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928 · see citing works
Rating neurologic impairment in multiple sclerosis: An expanded disability status scale (EDSS)
Kurtzke, J. F. (1983) · Neurology · doi:10.1212/wnl.33.11.1444 · Cited by 15,011 · see citing works
A learning algorithm for Boltzmann machines
Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985) · Cognitive Science · doi:10.1207/s15516709cog0901_7 · Cited by 3,402 · see citing works
Estimates of the Regression Coefficient Based on Kendall's Tau
Sen, P. K. (1968) · Journal of the American Statistical Association · doi:10.2307/2285891 · Cited by 1,695 · see citing works
Metalearners for estimating heterogeneous treatment effects using machine learning
Künzel, S. R., Sekhon, J. S., Bickel, P. J., & Yu, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1804597116 · Cited by 1,064 · see citing works
Modeling Human Motion Using Binary Latent Variables
Taylor, G. W., Hinton, G. E., & Roweis, S. T. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0173 · Cited by 708 · see citing works
On the evaluation of disability in multiple sclerosis
Kurtzke, J. F. (1961) · Neurology · doi:10.1212/wnl.11.8.686 · Cited by 330 · see citing works
Direct and Indirect Causal Effects via Potential Outcomes*
Rubin, D. B. (2004) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2004.02-123.x · Cited by 324 · see citing works
Further notes on disability evaluation in multiple sclerosis, with scale modifications
Kurtzke, J. F. (1965) · Neurology · doi:10.1212/wnl.15.7.654 · Cited by 309 · see citing works
Age and disability accumulation in multiple sclerosis
Scalfari, A., Neuhaus, A., Daumer, M., Ebers, G. C., & Muraro, P. A. (2011) · Neurology · doi:10.1212/wnl.0b013e318230a17d · Cited by 279 · see citing works
New perspectives in the natural history of multiple sclerosis
Tremlett, H. L., Zhao, Y., Rieckmann, P., & Hutchinson, M. (2010) · Neurology · doi:10.1212/wnl.0b013e3181e3973f · Cited by 260 · see citing works
Autoregressive gamma processes
Gouriéroux, C., & Jasiak, J. (2006) · Journal of Forecasting · doi:10.1002/for.978 · Cited by 200 · see citing works
Clinical Trial Simulation: A Review
Holford, N. H. G., Ma, S. C., & Ploeger, B. A. (2010) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2010.114 · Cited by 192 · see citing works
Natural history of multiple sclerosis: risk factors and prognostic indicators
Vukusic, S., & Confavreux, C. (2007) · Current Opinion in Neurology · doi:10.1097/wco.0b013e32812583ad · Cited by 137 · see citing works
Emergence of Compositional Representations in Restricted Boltzmann Machines
Tubiana, J., & Monasson, R. (2017) · Physical Review Letters · doi:10.1103/physrevlett.118.138301 · Cited by 124 · see citing works
Conditional Restricted Boltzmann Machines for Structured Output PredictionPreprint
Mnih, V., Larochelle, H., & Hinton, G. E. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.3748 · Cited by 123 · see citing works
Carrigan, G. J., Whipple, S., Capra, W. B., Taylor, M. D., Brown, J. S., Lu, M. W., Arnieri, B., Copping, R., & Rothman, K. J. (2019) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1586 · Cited by 100 · see citing works
Palace, J. A., Bregenzer, T., Tremlett, H. L., Oger, J., Zhu, F., Boggild, M., Duddy, M., & Dobson, C. W. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-004073 · Cited by 94 · see citing works
Imbens, G. W., & Rubin, D. B. (2010) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230280816_28 · Cited by 81 · see citing works
Ethics of placebo-controlled clinical trials in multiple sclerosis
Polman, C. H., Reingold, S. C., Barkhof, F., Calabresi, P. A., Clanet, M., Cohen, J. A., Cutter, G., Freedman, M. S., Kappos, L., LUBLIN, F. D., et al. (2008) · Neurology · doi:10.1212/01.wnl.0000306410.84794.4d · Cited by 70 · see citing works
LaRocca, N. G., Hudson, L. D., Rudick, R. A., Amtmann, D., Balcer, L. J., Benedict, R. H. B., Bermel, R. A., Chang, I., Chiaravalloti, N. D., Chin, P., et al. (2017) · Multiple Sclerosis Journal · doi:10.1177/1352458517723718 · Cited by 64 · see citing works
Law, M., Traboulsee, A. L., Li, D. K. B., et al. (2019) · Multiple Sclerosis Journal - Experimental Translational and Clinical · doi:10.1177/2055217319885983 · Cited by 62 · see citing works
Evolution of clinical trials in multiple sclerosis
Zhang, Y., Salter, A. R., Wallström, E., Cutter, G., & Stüve, O. (2019) · Therapeutic Advances in Neurological Disorders · doi:10.1177/1756286419826547 · Cited by 59 · see citing works
Predicting short-term disability in multiple sclerosis
Gauthier, S. A., Mandel, M., Guttmann, C. R. G., Glanz, B. I., Khoury, S. J., Betensky, R. A., & Weiner, H. L. (2007) · Neurology · doi:10.1212/01.wnl.0000264890.97479.b1 · Cited by 50 · see citing works
The changing face of multiple sclerosis clinical trial populations
Uitdehaag, B. M. J., Barkhof, F., Coyle, P. K., et al. (2011) · Current Medical Research and Opinion · doi:10.1185/03007995.2011.591370 · Cited by 46 · see citing works
Placebo‐controlled clinical trials in multiple sclerosis: Ethical considerations
LUBLIN, F. D., & Reingold, S. C. (2001) · Annals of Neurology · doi:10.1002/ana.1025 · Cited by 46 · see citing works
A longitudinal model for disease progression was developed and applied to multiple sclerosis
Lawton, M., Tilling, K. M., Robertson, N., Tremlett, H. L., Zhu, F., Harding, K. E., Oger, J. J.-F., & Ben‐Shlomo, Y. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.05.003 · Cited by 26 · see citing works
Natural Course of Clinically Isolated Syndrome: A Longitudinal Analysis Using a Markov Model
Hou, Y., Jia, Y., & Hou, J.-T. (2018) · Scientific Reports · doi:10.1038/s41598-018-29206-y · Cited by 25 · see citing works
Longitudinal disability curves for predicting the course of relapsing-remitting multiple sclerosis
Achiron, A., Barak, Y., & Rotstein, Z. (2003) · Multiple Sclerosis Journal · doi:10.1191/1352458503ms945oa · Cited by 24 · see citing works
Genome-wide human brain eQTLs: In-depth analysis and insights using the UKBEC dataset
Sng, L. M. F., Thomson, P. C., & Trabzuni, D. (2019) · Scientific Reports · doi:10.1038/s41598-019-55590-0 · Cited by 16 · see citing works
Global Standards to Expedite Learning From Medical Research Data
Hudson, L. D., Kush, R. D., Almario, E. N., et al. (2018) · Clinical and Translational Science · doi:10.1111/cts.12556 · Cited by 12 · see citing works
Boltzmann Encoded Adversarial MachinesPreprint
Fisher, C. K., Smith, A. M., & Walsh, J. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.08682 · Cited by 9 · see citing works
Self-citationPredicting the course of relapsing-remitting MS using longitudinal disability curves
Achiron, A. (2004) · Journal of Neurology · doi:10.1007/s00415-004-1510-0 · Cited by 8 · see citing works
Flagged first, then by citations
Research works printed but not linked: 24
- N. Holford, S. Ma, and B. Ploeger, Clinical Pharmacology & Therapeutics 88, 166 (2010).
- C. K. Fisher, A. M. Smith, and J. R. Walsh, Scientific Reports 9, 1 (2019). · DOI · Paper page
- G. Carrigan, S. Whipple, W. B. Capra, M. D. Taylor, J. S. Brown, M. Lu, B. Arnieri, R. Cop- ping, and K. J. Rothman, Clinical Pharmacology & Therapeutics 107, 369 (2020).
- C. H. Polman, S. Reingold, F. Barkhof, P. Calabresi, M. Clanet, J. Cohen, G. Cutter, M. Freed- man, L. Kappos, F. Lublin, et al., Neurology 70, 1134 (2008).
- B. M. Uitdehaag, F. Barkhof, P. K. Coyle, J. D. Gardner, D. R. Jeffery, and D. D. Mikol, Current medical research and opinion 27, 1529 (2011).
- M. Grieves and J. Vickers, in Transdisciplinary Perspectives on Complex Systems: New Find- ings and Approaches, edited by F.-J. Kahlen, S. Flumerfelt, and A. Alves (Springer, 2016).
- G. W. Taylor and G. E. Hinton, in Proceedings of the 26th Annual International Conference on Machine Learning, ICML '09 (ACM, New York, NY, USA, 2009) pp. 1025-1032, event-place: Montreal, Quebec, Canada. · DOI
- G. W. Taylor, G. E. Hinton, and S. T. Roweis, in Advances in Neural Information Processing Systems 19 , edited by B. Schölkopf, J. C. Platt, and T. Hoffman (MIT Press, 2007) pp. 1345-1352.
- M. M. Goldenberg, Pharmacy and Therapeutics 37, 175 (2012).
- D. H. Ackley, G. E. Hinton, and T. J. Sejnowski, Cognitive science 9, 147 (1985).
- G. E. Hinton and R. R. Salakhutdinov, Science 313, 504 (2006).
- R. Salakhutdinov and G. Hinton, in Artificial Intelligence and Statistics (2009) pp. 448-455.
- G. Hinton, Momentum 9, 926 (2010).
- I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, in Advances in neural information processing systems (2014) pp. 2672-2680.
- W. R. Kubick, S. Ruberg, and E. Helton, Drug Information Journal (2016). · DOI
- H. Wickham et al., Journal of Statistical Software 59, 1 (2014).
- H. Theil, Nederl. Akad. Wetensch., Proc. 53, 386 (1950).
- P. K. Sen, Journal of the American Statistical Association 63, 1379 (1968). · DOI
- D. B. Rubin, Scandinavian Journal of Statistics 31, 161 (2004).
- G. W. Imbens and D. B. Rubin, in Microeconometrics (Springer, 2010) pp. 229-241.
- S. R. Künzel, J. S. Sekhon, P. J. Bickel, and B. Yu, Proceedings of the national academy of sciences 116, 4156 (2019).
- C. Gouriéroux and J. Jasiak, Journal of Forecasting 25, 129.
- G. Desjardins, A. Courville, Y. Bengio, P. Vincent, and O. Delalleau, in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (MIT Press Cam- bridge, MA, 2010) pp. 145-152.
- G. Desjardins, A. Courville, Y. Bengio, P. Vincent, and O. Delalleau, in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (2010) pp. 145- 152.
Cited by
Sorted by citations
Acosta, J. N., Falcone, G. J., Rajpurkar, P., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-022-01981-2 · Cited by 1,365 · see citing works
Digital Twins: From Personalised Medicine to Precision Public Health
Kamel Boulos, M. N., & Zhang, P. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11080745 · Cited by 530 · see citing works
Generative artificial intelligence empowers digital twins in drug discovery and clinical trials
Bordukova, M., Makarov, N., Rodriguez-Esteban, R., Schmich, F., & Menden, M. P. (2024) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2023.2273839 · Cited by 235 · see citing works
- Authors
- Walsh, J. R., Smith, A. M., Pouliot, Y., Li-Bland, D., Loukianov, A., Fisher, C. K., & for the Multiple Sclerosis Outcome Assessments Consortium
- Corresponding author
- Walsh, Jonathan R.
- Venue
- bioRxiv (Cold Spring Harbor Laboratory)
- Publisher
- openRxiv
- Published
- 2020-02-05
- OpenAlex
- W3004601859
- Cited by
- 40
- References
- 34
- Citations by year
- 2026: 6 · 2025: 4 · 2024: 5 · 2023: 10 · 2022: 5 · 2021: 3 · 2020: 7
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Licence
- Locations
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- Topics
- Health Sciences › Medicine › Pathology and Forensic Medicine › Multiple Sclerosis Research Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- multiple sclerosis, digital twin, conditional restricted Boltzmann machine, probabilistic neural network, disease progression simulation, unsupervised learning, neurodegenerative diseases
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review