The use of reinforcement learning algorithms to meet the challenges of an artificial pancreas
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Blood glucose control, for example, in diabetes mellitus or severe illness, requires strict adherence to a protocol of food, insulin administration and exercise personalized to each patient. An artificial pancreas for automated treatment could boost quality of glucose control and patients' independence. The components required for an artificial pancreas are: i) continuous glucose monitoring (CGM), ii) smart controllers and iii) insulin pumps delivering the optimal amount of insulin. In recent years, medical devices for CGM and insulin administration have undergone rapid progression and are now commercially available. Yet, clinically available devices still require regular patients' or caregivers' attention as they operate in open-loop control with frequent user intervention. Dosage-calculating algorithms are currently being studied in intensive care patients [1] , for short overnight control to supplement conventional insulin delivery [2] , and for short periods where patients rest and follow a prescribed food regime [3] . Fully automated algorithms that can respond to the varying activity levels seen in outpatients, with unpredictable and unreported food intake, and which provide the necessary personalized control for individuals is currently beyond the state-of-the-art. Here, we review and discuss reinforcement learning algorithms, controlling insulin in a closed-loop to provide individual insulin dosing regimens that are reactive to the immediate needs of the patient.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Standards of medical care in diabetes—2011
American Diabetes Association (2011) · Diabetes Care · doi:10.2337/dc11-s011 · Cited by 2,880
Bergman, R. N., Phillips, L. S., & Cobelli, C. (1981) · Journal of Clinical Investigation · doi:10.1172/jci110398 · Cited by 1,640
Nonlinear model predictive control of glucose concentration in subjects with type 1 diabetes
Hovorka, R., Canonico, V., Chassin, L. J., Haueter, U., Massi-Benedetti, M., Federici, M. O., Pieber, T. R., Schaller, H. C., Schaupp, L., Vering, T., et al. (2004) · Physiological Measurement · doi:10.1088/0967-3334/25/4/010 · Cited by 1,274
Artificial Pancreas: Past, Present, Future
Cobelli, C., Renard, E., & Kovatchev, B. (2011) · Diabetes · doi:10.2337/db11-0654 · Cited by 600
A Bihormonal Closed-Loop Artificial Pancreas for Type 1 Diabetes
El-Khatib, F. H., Russell, S. J., Nathan, D. M., Sutherlin, R. G., & Damiano, E. R. (2010) · Science Translational Medicine · doi:10.1126/scitranslmed.3000619 · Cited by 403
A Tale of Two Compartments: Interstitial Versus Blood Glucose Monitoring
Cengiz, E., & Tamborlane, W. V. (2009) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2009.0002 · Cited by 390
Fully Integrated Artificial Pancreas in Type 1 Diabetes
Breton, M., Farret, A., Bruttomesso, D., Anderson, S., Magni, L., Patek, S., Dalla Man, C., Place, J., Demartini, S., Del Favero, S., et al. (2012) · Diabetes · doi:10.2337/db11-1445 · Cited by 315
Technologies for Continuous Glucose Monitoring: Current Problems and Future Promises
Vaddiraju, S., Burgess, D. J., Tomazos, I., Jain, F. C., & Papadimitrakopoulos, F. (2010) · Journal of Diabetes Science and Technology · doi:10.1177/193229681000400632 · Cited by 285
Hovorka, R., Kumareswaran, K., Harris, J., Allen, J. M., Elleri, D., Xing, D., Kollman, C., Nodale, M., Murphy, H. R., Dunger, D. B., et al. (2011) · BMJ · doi:10.1136/bmj.d1855 · Cited by 244
Novel Use of Glucagon in a Closed-Loop System for Prevention of Hypoglycemia in Type 1 Diabetes
Castle, J. R., Engle, J. M., Youssef, J. E., Massoud, R. G., Yuen, K. C. J., Kagan, R., & Ward, W. K. (2010) · Diabetes Care · doi:10.2337/dc09-2254 · Cited by 232
Cited by
Artificial intelligence in surgery: promises and perils
Hashimoto, D. A., Rosman, G., Rus, D., & Meireles, O. R. (2018) · Annals of Surgery · doi:10.1097/sla.0000000000002693 · Cited by 1,468
“One can conceptualize reinforcement learning as the computer science equivalent of operant conditioning(9) and is useful for automated tuning of predictions or actions, such as controlling an artificial pancreas system to fine-tune the measurement and delivery of insulin to diabetic patients.(10) ML is particularly us…”
MethodKomorowski, M., Celi, L. A., Badawi, O., Gordon, A. C., & Faisal, A. A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0213-5 · Cited by 1,290
Self-citationArtificial intelligence, bias and clinical safety
Challen, R., Denny, J., Pitt, M., Gompels, L., Edwards, T., & Tsaneva-Atanasova, K. (2019) · BMJ Quality & Safety · doi:10.1136/bmjqs-2018-008370 · Cited by 956
“…in medicine, but one can imagine a future where ‘closed loop’ applications, such as subcutaneous insulin pumps driven by information from wearable sensors, 33 or automated ventilator control driven by physiological monitoring data in intensive care, 34 are directly controlled by AI algorithms.”
Reinforcement Learning in Healthcare: A Survey
Yu, C., Liu, J., Nemati, S., & Yin, G. (2023) · ACM Computing Surveys · doi:10.1145/3477600 · Cited by 628
Artificial intelligence for diabetes management and decision support: Literature review
Contreras, I., & Vehi, J. (2018) · Journal of Medical Internet Research · doi:10.2196/10775 · Cited by 560
“Another AI method that has been increasingly adopted in the area of control algorithms is the so-called reinforcement algorithm [25].”
Method
Metadata
- Authors
- Bothe, M. K., Dickens, L., Reichel, K., Tellmann, A., Ellger, B., Westphal, M., & Faisal, A. A.
- Venue
- Expert Review of Medical Devices
- Publisher
- Informa UK Limited
- Published
- 2013-09
- Volume
- 10
- Issue
- 5
- Pages
- 661-673
- ISSN
- 1743-4440 (ISSN-L)
- 1745-2422
- OpenAlex
- W2155639879
- Cited by
- 124
- References
- 16
- FWCI
- 1.65
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The use of reinforcement learning algorithms to meet the challenges of an artificial pancreas. https://app.cochat.ai/papers/10.1586/17434440.2013.827515
- The paper
- Bothe, M. K., Dickens, L., Reichel, K., Tellmann, A., Ellger, B., Westphal, M., & Faisal, A. A. (2013). The use of reinforcement learning algorithms to meet the challenges of an artificial pancreas. Expert Review of Medical Devices. https://doi.org/10.1586/17434440.2013.827515
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.