Cross-Validation of a Glucose-Insulin-Glucagon Pharmacodynamics Model for Simulation Using Data From Patients With Type 1 Diabetes
Open accessAbstract
Background: Currently, no consensus exists on a model describing endogenous glucose production (EGP) as a function of glucagon concentrations. Reliable simulations to determine the glucagon dose preventing or treating hypoglycemia or to tune a dual-hormone artificial pancreas control algorithm need a validated glucoregulatory model including the effect of glucagon. Methods: Eight type 1 diabetes (T1D) patients each received a subcutaneous (SC) bolus of insulin on four study days to induce mild hypoglycemia followed by a SC bolus of saline or 100, 200, or 300 µg of glucagon. Blood samples were analyzed for concentrations of glucagon, insulin, and glucose. We fitted pharmacokinetic (PK) models to insulin and glucagon data using maximum likelihood and maximum a posteriori estimation methods. Similarly, we fitted a pharmacodynamic (PD) model to glucose data. The PD model included multiplicative effects of insulin and glucagon on EGP. Bias and precision of PD model test fits were assessed by mean predictive error (MPE) and mean absolute predictive error (MAPE). Results: Assuming constant variables in a subject across nonoutlier visits and using thresholds of ±15% MPE and 20% MAPE, we accepted at least one and at most three PD model test fits in each of the seven subjects. Thus, we successfully validated the PD model by leave-one-out cross-validation in seven out of eight T1D patients. Conclusions: The PD model accurately simulates glucose excursions based on plasma insulin and glucagon concentrations. The reported PK/PD model including equations and fitted parameters allows for in silico experiments that may help improve diabetes treatment involving glucagon for prevention of hypoglycemia.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Other whole-body models were complex and included several parameters hard to assess in the single individual, thus useful for simulation purposes rather than for clinical applications.
“Other models were developed for whole-body analyses, but they were complex and with the inclusion of several parameters hard to assess in the single individual, thus useful for simulation purposes rather than for clinical applications (22, 23).”
From Mathematical Model of Glucagon Kinetics for the Assessment of Insulin-Mediated Glucagon Inhibition During an Oral Glucose Tolerance Test (2021) · cites this paper as [22]
The Model Fitting section (page unavailable) describes a simulation model with numerous parameters, some estimated using literature-informed priors because the data were insufficient. The Discussion (page unavailable) also notes limits on applying the model outside the hospital. Neither passage establishes that other whole-body models are generally too complex for clinical applications. (LLM, conf=0.78)
Experimental — accuracy not yet measuredSome mathematical models exist in the literature describing postprandial endogenous glucose production suppression as a function of plasma glucose, insulin, and glucagon.
“Some mathematical models exist in the literature describing the postprandial EGP suppression as a function of plasma glucose, insulin [10, 11], and glucagon [12–15].”
From Modeling the effect of glucagon on endogenous glucose production in healthy individuals under meal-like conditions (2025) · cites this paper as [13]
The Discussion describes models of glucagon’s effect on glucose production, supporting the citation’s glucagon-related point. But the Data Collection section says this model was tested in fasting patients during insulin-induced hypoglycemia, not after meals; our copy does not establish that it describes postprandial EGP suppression. Page numbers are unavailable in the indexed passages. (LLM, conf=0.86)
Experimental — accuracy not yet measuredMost existing mathematical models of postprandial endogenous glucose production suppression use plasma glucose and not endogenous glucose production as the variable to fit.
“However, most of them use plasma glucose and not EGP as a variable to fit.”
From Modeling the effect of glucagon on endogenous glucose production in healthy individuals under meal-like conditions (2025) · cites this paper as [13]
The Model Fitting section says this paper’s pharmacodynamic model was fitted with a glucose output, supporting the distinction between fitting glucose and fitting EGP for this model. The copy does not establish that most existing models of postprandial EGP suppression do so; the Discussion discusses limitations of some previous models but gives no such comparison. No page number is available in our copy. (LLM, conf=0.82)
Experimental — accuracy not yet measuredIn these experimental conditions, this model and the other models of the literature are still suboptimal because they do not account for the glucagon evanescent effect visible in the data.
“Nonetheless, in our experimental conditions, this [11] and the other models of the literature [10, 12–15] are still suboptimal since they do not account for the glucagon evanescent effect visible in the data (Fig. 1, Panel D).”
From Modeling the effect of glucagon on endogenous glucose production in healthy individuals under meal-like conditions (2025) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(1993) · New England Journal of Medicine · doi:10.1056/nejm199309303291401 · Cited by 24,667 · see citing works
Proceedings of the 2004 American Control Conference
(2004) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.2004.1383555 · Cited by 2,605 · see citing works
Nonlinear model predictive control of glucose concentration in subjects with type 1 diabetes
Hovorka, R., Canonico, V., Chassin, L. J., Haueter, U., Massi-Benedetti, M., Federici, M. O., Pieber, T. R., Schaller, H. C., Schaupp, L., Vering, T., et al. (2004) · Physiological Measurement · doi:10.1088/0967-3334/25/4/010 · Cited by 1,274 · see citing works
The UVA/PADOVA Type 1 Diabetes Simulator: New Features
Man, C. D., Micheletto, F., Lv, D., Breton, M., Kovatchev, B., & Cobelli, C. (2014) · Journal of Diabetes Science and Technology · doi:10.1177/1932296813514502 · Cited by 791 · cited 2× · see citing works
“The ability of insulin to suppress the glycogenolytic response to glucagon at high insulin concentration is not reflected in previously published models of glucose-glucagon dynamics [18-20].”
Background<i>In Silico</i> Preclinical Trials: A Proof of Concept in Closed-Loop Control of Type 1 Diabetes
Kovatchev, B. P., Breton, M., Dalla Man, C., & Cobelli, C. (2009) · Journal of Diabetes Science and Technology · doi:10.1177/193229680900300106 · Cited by 760 · see citing works
Pharmacokinetic/pharmacodynamic data analysis : concepts and applications
Gabrielsson, J., & Weiner, D. (2002) · Cited by 704 · see citing works
Dose-response characteristics for effects of insulin on production and utilization of glucose in man
Rizza, R. A., Mandarino, L. J., & Gerich, J. E. (1981) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.1981.240.6.e630 · Cited by 703 · see citing works
DeFronzo, R. A., Simonson, D. C., & Ferrannini, E. (1982) · Diabetologia · doi:10.1007/bf00253736 · Cited by 539 · see citing works
Partitioning glucose distribution/transport, disposal, and endogenous production during IVGTT
Hovorka, R., Shojaee-Moradie, F., Carroll, P. V., Chassin, L. J., Gowrie, I. J., Jackson, N. C., Tudor, R. S., Umpleby, A. M., & Jones, R. H. (2002) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.00304.2001 · Cited by 393 · see citing works
Parameter estimation in stochastic grey-box models
Kristensen, N. R., Madsen, H., & Jørgensen, S. B. (2003) · Automatica · doi:10.1016/j.automatica.2003.10.001 · Cited by 349 · see citing works
Self-citationIntroduction to General and Generalized Linear Models
Madsen, H., & Thyregod, P. (2010) · CRC Press eBooks · doi:10.1201/9781439891148 · Cited by 247 · see citing works
Self-citationAlbrechtsen, N. J. W., Hartmann, B., Veedfald, S., Windeløv, J. A., Plamboeck, A., Bojsen-Møller, K. N., Idorn, T., Feldt‐Rasmussen, B., Knop, F. K., Vilsbøll, T., et al. (2014) · Diabetologia · doi:10.1007/s00125-014-3283-z · Cited by 185 · see citing works
Self-citationRussell, S. J., HILLARD, M. A., BALLIRO, C. A., Magyar, K. L., SELAGAMSETTY, R., Sinha, M., GRENNAN, K. B., Mondesir, D., Ekhlaspour, L., Zheng, H., et al. (2016) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(15)00489-1 · Cited by 182 · see citing works
Profile likelihood in systems biology
Kreutz, C., Raue, A., Kaschek, D., & Timmer, J. (2013) · FEBS Journal · doi:10.1111/febs.12276 · Cited by 179 · see citing works
Owen, J. S., & Fiedler‐Kelly, J. (2014) · Wiley eBooks · doi:10.1002/9781118784860 · Cited by 163 · see citing works
Nuttall, F. Q., Ngo, A., & Gannon, M. C. (2008) · Diabetes/Metabolism Research and Reviews · doi:10.1002/dmrr.863 · Cited by 146 · see citing works
The Artificial Pancreas: How Closed-Loop Control Is Revolutionizing Diabetes
Haidar, A. (2016) · IEEE Control Systems · doi:10.1109/mcs.2016.2584318 · Cited by 145 · see citing works
Jacobs, P. G., El Youssef, J., Reddy, R., Resalat, N., Branigan, D., Condon, J., Preiser, N., Ramsey, K., Jones, M., Edwards, C., et al. (2016) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.12707 · Cited by 116 · see citing works
Blauw, H., van Bon, A. C., Koops, R., & DeVries, J. H. (2016) · Diabetes Obesity and Metabolism · doi:10.1111/dom.12663 · Cited by 114 · see citing works
Single- and Dual-Hormone Artificial Pancreas for Overnight Glucose Control in Type 1 Diabetes
Haidar, A., RABASA-LHORET, R. P. R., Legault, L., Lovblom, L. E., Rakheja, R., Messier, V., D'Aoust, É., Falappa, C. M., Justice, T. D., Orszag, A., et al. (2015) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2015-3003 · Cited by 89 · see citing works
Adkins, A., Basu, R., Persson, M., Dicke, B. A., Shah, P., Vella, A. V., Schwenk, W. F., & Rizza, R. (2003) · Diabetes · doi:10.2337/diabetes.52.9.2213 · Cited by 67 · see citing works
Hildebrandt, P. R. (1991) · PubMed · Cited by 60 · see citing works
Glucagon in artificial pancreas systems: Potential benefits and safety profile of future chronic use
Taleb, N., Haidar, A., Messier, V., Gingras, V., Legault, L., & RABASA-LHORET, R. P. R. (2016) · Diabetes Obesity and Metabolism · doi:10.1111/dom.12789 · Cited by 59 · see citing works
Arbeláez, A. M., Xing, D., Cryer, P. E., Kollman, C., Beck, R. W., Sherr, J. L., Ruedy, K. J., Tamborlane, W. V., Mauras, N., Tsalikian, E., et al. (2013) · Pediatric Diabetes · doi:10.1111/pedi.12070 · Cited by 56 · see citing works
Herrero, P., Georgiou, P., Oliver, N., Reddy, M., Johnston, D., & Toumazou, C. (2013) · Journal of Diabetes Science and Technology · doi:10.1177/193229681300700416 · Cited by 55 · see citing works
Youssef, J. E., Castle, J. R., Bakhtiani, P. A., Haidar, A., Branigan, D. L., Breen, M. E., & Ward, W. K. (2014) · Diabetes Care · doi:10.2337/dc14-0803 · Cited by 52 · see citing works
Prediction Methods for Blood Glucose Concentration
Kirchsteiger, H., Jørgensen, J. B., Renard, É., & del Re, L. (2015) · Lecture notes in bioengineering · doi:10.1007/978-3-319-25913-0 · Cited by 48 · see citing works
Self-citationPharmacokinetics and pharmacodynamics of various glucagon dosages at different blood glucose levels
Blauw, H., Wendl, I., DeVries, J. H., et al. (2015) · Diabetes Obesity and Metabolism · doi:10.1111/dom.12571 · Cited by 47 · see citing works
Ranjan, A., Schmidt, S., Madsbad, S., Holst, J. J., & Nørgaard, K. (2016) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.12627 · Cited by 39 · see citing works
Self-citationPostprandial and Fasting Hepatic Glucose Fluxes in Long-Standing Type 1 Diabetes
Kacerovsky, M., Jones, J. G., Schmid, A. I., Barosa, C., Lettner, A., Kacerovsky-Bielesz, G., Szendroedi, J., Chmelík, M., Nowotny, P., Chandramouli, V., et al. (2011) · Diabetes · doi:10.2337/db10-1001 · Cited by 37 · see citing works
Castle, J. R., Youssef, J. E., Bakhtiani, P. A., Cai, Y., Stobbe, J. M., Branigan, D. L., Ramsey, K., Jacobs, P. G., Reddy, R. K. K., Woods, M., et al. (2015) · Diabetes Care · doi:10.2337/dc15-0754 · Cited by 35 · see citing works
Control of Glucose Production in vivo by Insulin and Glucagon
Cherrington, A. D. (2001) · Comprehensive physiology · doi:10.1002/cphy.cp070225 · Cited by 32 · see citing works
Pharmacokinetics of Insulin Aspart and Glucagon in Type 1 Diabetes during Closed-Loop Operation
Haidar, A., Duval, C., Legault, L., & RABASA-LHORET, R. P. R. (2013) · Journal of Diabetes Science and Technology · doi:10.1177/193229681300700610 · Cited by 29 · see citing works
Minimizing Morbidity of Hypoglycemia in Diabetes
Chung, S. T., & Haymond, M. W. (2014) · Journal of Diabetes Science and Technology · doi:10.1177/1932296814547518 · Cited by 28 · see citing works
Hinshaw, L., Mallad, A., Man, C. D., Basu, R., Cobelli, C., Carter, R. E., Kudva, Y. C., & Basu, A. (2015) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.00236.2015 · Cited by 28 · see citing works
Modeling Glucagon Action in Patients With Type 1 Diabetes
Emami, A., Youssef, J. E., Rabasa-Lhoret, R., Pineau, J., Castle, J. R., & Haidar, A. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2593630 · Cited by 20 · see citing works
Peng, J. Z., Denney, W. S., Musser, B. J., Liu, R., Tsai, K., Fang, L., Reitman, M. L., Troyer, M. D., Engel, S. S., Xu, L., et al. (2014) · The AAPS Journal · doi:10.1208/s12248-014-9648-x · Cited by 19 · see citing works
Shedding light on grey noise in diabetes modelling
Mansell, E. J., Docherty, P. D., & Chase, J. G. (2016) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2016.06.007 · Cited by 19 · see citing works
Modeling and Prediction Using Stochastic Differential Equations
Juhl, R., Møller, J. K., Jørgensen, J. B., & Madsen, H. (2015) · Lecture notes in bioengineering · doi:10.1007/978-3-319-25913-0_10 · Cited by 13 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- Wendt SL, Møller JK, Haidar A, Knudsen CB, Madsen H, Jørgensen JB. Modelling of glucose-insulin-glucagon pharma- codynamics in man. Paper presented at: IEEE EMBC 2016; August 16-20, 2016; Orlando, FL.
Cited by
Sorted by citations
Morettini, M., Burattini, L., Göbl, C., Pacini, G., Ahrén, B., & Tura, A. (2021) · Frontiers in Endocrinology · doi:10.3389/fendo.2021.611147 · Cited by 27 · see citing works
Mathematical modeling of the glucagon challenge test
Masroor, S., van Dongen, M. G. J., Alvarez-Jimenez, R., Burggraaf, K., Peletier, L. A., & Peletier, M. A. (2019) · Journal of Pharmacokinetics and Pharmacodynamics · doi:10.1007/s10928-019-09655-2 · Cited by 12 · see citing works
Faggionato, E., Tonello, A., Laurenti, M. C., Vella, A., & Dalla Man, C. (2025) · American Journal of Physiology - Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.00172.2025
- Authors
- Wendt, S. L., Ranjan, A., Møller, J. K., Schmidt, S., Knudsen, C. B., Holst, J. J., Madsbad, S., Madsen, H., Nørgaard, K., & Jørgensen, J. B.
- Affiliations
- Zealand Pharma (Denmark) (DK)
- Hvidovre Hospital (DK)
- Technical University of Denmark (DK)
- University of Copenhagen (DK)
- Corresponding author
- Wendt, Sabrina Lyngbye
- ORCID
- Venue
- Journal of Diabetes Science and Technology
- Publisher
- SAGE Publications
- Published
- 2017-02-01
- Volume
- 11
- Issue
- 6
- Pages
- 1101-1111
- ISSN
- 1932-2968 (ISSN-L)
- PMC
- PMC5951032
- OpenAlex
- W2589449235
- Cited by
- 20
- References
- 39
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 3 · 2023: 2 · 2022: 1 · 2021: 3 · 2020: 3 · 2019: 1 · 2018: 3 · 2017: 1
- FWCI
- 1.73
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of Diabetes Science and Technology (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (publishedVersion, other-oa)
- Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) (submittedVersion, other-oa)
- Funders
- Innovation Fund Denmark
- Zealand Pharma A/S
- Danish Diabetes Academy
- Topics
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Diabetes Management and Research
- Health Sciences › Medicine › Surgery › Pancreatic function and diabetes
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Diabetes Treatment and Management
- Keywords
- type 1 diabetes, glucagon, insulin, endogenous glucose production, pharmacodynamics, pharmacokinetics, hypoglycemia prevention, model validation, leave-one-out cross-validation, computer simulation
- MeSH terms
- Adult, Blood Glucose, Computer Simulation, Diabetes Mellitus, Type 1, Female, Glucagon, Humans, Hypoglycemia, Hypoglycemic Agents, Injections, Subcutaneous, Insulin, Male, Middle Aged, Models, Biological, Reproducibility of Results, Biomarkers, Treatment Outcome, Drug Dosage Calculations, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review