Privacy-Preserving Reinforcement Learning Design for Patient-Centric Dynamic Treatment Regimes
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
In this paper, we propose a privacy-preserving reinforcement learning framework for a patient-centric dynamic treatment regime, which we refer to as Preyer. Using Preyer, a patient-centric treatment strategy can be made spontaneously while preserving the privacy of the patient's current health state and the treatment decision. Specifically, we first design a new storage and computation method to support noninteger processing for multiple encrypted domains. A new secure plaintext length control protocol is also proposed to avoid plaintext overflow after executing secure computation repeatedly. Moreover, we design a new privacy-preserving reinforcement learning framework with experience replay to build the model for secure dynamic treatment policymaking. Furthermore, we prove that Preyer facilitates patient dynamic treatment policymaking without leaking sensitive information to unauthorized parties. We also demonstrate the utility and efficiency of Preyer using simulations and analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A public key cryptosystem and a signature scheme based on discrete logarithms
Elgamal, T. (1985) · IEEE Transactions on Information Theory · doi:10.1109/tit.1985.1057074 · Cited by 8,059 · cited 1×
“Therefore, partial (including additive [39], multiplicative [40] and somewhat [41]) homomorphic encryptions are often considered as the next best solution for PP-ML.”
BackgroundPublic-Key Cryptosystems Based on Composite Degree Residuosity Classes
Paillier, P. (2007) · Lecture Notes in Computer Science · doi:10.1007/3-540-48910-x_16 · Cited by 7,250
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618
Multiparty Computation from Somewhat Homomorphic Encryption
Damgård, I., Pastro, V., Smart, N., & Zakarias, S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-32009-5_38 · Cited by 1,331 · cited 1×
“Therefore, partial (including additive [39], multiplicative [40] and somewhat [41]) homomorphic encryptions are often considered as the next best solution for PP-ML.”
BackgroundCollins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082
Privacy Preserving Data Mining
Lindell, Y., & Pinkas, B. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44598-6_3 · Cited by 1,077
An experimental design for the development of adaptive treatment strategies
Murphy, S. A. (2005) · Statistics in Medicine · doi:10.1002/sim.2022 · Cited by 746 · cited 1×
“Dynamic treatment regimes [1] (DTRs, also known as adaptive interventions [2] and adaptive treatment strategies [3]) operationalize personalized treatment by providing a sequence of treatment strategies tailored to an individual patient ’ s time-varying clinical statuses.”
BackgroundReinforcement Learning and Savings Behavior
CHOI, J. J., LAIBSON, D., MADRIAN, B. C., & METRICK, A. (2009) · The Journal of Finance · doi:10.1111/j.1540-6261.2009.01509.x · Cited by 324 · cited 1×
“Reinforcement learning, a type of machine learning, allows machines to automatically determine the ideal behavior within a speci fi c context to maximize its cumulative reward, which has real-world practical applications in the fi eld of production control [19], fi nance [20], etc.”
BackgroundAdaptive Treatment Strategies in Chronic Disease
Lavori, P. W., & Dawson, R. (2008) · Annual Review of Medicine · doi:10.1146/annurev.med.59.062606.122232 · Cited by 113 · cited 1×
“Such treatment regimes allow the medical practitioner to adopt the treatment (type, dosage, timing) in each stage, according to covariate history [4].”
Background
Cited by
More Than Privacy: Applying Differential Privacy in Key Areas of Artificial Intelligence
Zhu, T., Ye, D., Wang, W., Zhou, W., & Yu, P. S. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3014246 · Cited by 219
XAI-based Clinical Decision Support System: A Systematic Review
Kim, S., Kim, D., Kim, M., Ko, H., & Jeong, O. (2024) · doi:10.20944/preprints202406.0721.v1 · Cited by 72
Boosting Privately: Privacy-Preserving Federated Extreme Boosting for Mobile Crowdsensing
Liu, Y., Ma, Z., Liu, X., Ma, S., Nepal, S., & Deng, R. (2019) · arXiv · doi:10.48550/arxiv.1907.10218 · Cited by 52
“And towards the patient’s medical data privacy protection in e-Health system, X. Liu in [24] advocated a homomorphic encryption based scheme to implement privacy-preserving reinforcement learning scheme for patient-centric dynamic treatment regimes.”
BackgroundSelf-citationCloud-based federated boosting for mobile crowdsensing
Wang, Z., Yang, Y., Liu, Y., Liu, X., Gupta, B. B., & Ma, J. (2020) · arXiv · doi:10.48550/arxiv.2005.05304 · Cited by 6
Self-citation
Metadata
- Authors
- Liu, X., Deng, R. H., Raymond Choo, K.-K., & Yang, Y.
- Venue
- IEEE Transactions on Emerging Topics in Computing
- Published
- 2021-01-01
- Volume
- 9
- Issue
- 1
- Pages
- 456-470
- ISSN
- 2168-6750 (ISSN-L)
- 2376-4562
- OpenAlex
- W2911667635
- Cited by
- 58
- References
- 9
- FWCI
- 3.80
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Privacy-Preserving Reinforcement Learning Design for Patient-Centric Dynamic Treatment Regimes. https://app.cochat.ai/papers/10.1109/tetc.2019.2896325
- The paper
- Liu, X., Deng, R. H., Raymond Choo, K.-K., & Yang, Y. (2021). Privacy-Preserving Reinforcement Learning Design for Patient-Centric Dynamic Treatment Regimes. IEEE Transactions on Emerging Topics in Computing. https://doi.org/10.1109/tetc.2019.2896325
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.