Semi-Cyclic Stochastic Gradient Descent
Open accessAbstract
We consider convex SGD updates with a block-cyclic structure, i.e. where each cycle consists of a small number of blocks, each with many samples from a possibly different, block-specific, distribution. This situation arises, e.g., in Federated Learning where the mobile devices available for updates at different times during the day have different characteristics. We show that such block-cyclic structure can significantly deteriorate the performance of SGD, but propose a simple approach that allows prediction with the same performance guarantees as for i.i.d., non-cyclic, sampling.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
When component distributions truly differ, pluralism can beat the ideal IID baseline.
“When the component distributions are actually different, pluralism can outperform the “ideal” IID baseline.”
From Federated Learning for Healthcare Informatics (2021) · cites this paper as [28]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 25
- Amit, Y., Fink, M., Srebro, N., and Ullman, S. Uncovering shared structures in multiclass classification. In Proceedings of the 24th international conference on Machine learning , pp. 17-24. ACM, 2007.
- Ando, R. K. and Zhang, T. A framework for learning predictive structures from multiple tasks and unlabeled data. Journal of Machine Learning Research , 6(Nov):18171853, 2005.
- Argyriou, A., Evgeniou, T., and Pontil, M. Convex multitask feature learning. Machine Learning , 73(3):243-272, 2008.
- Arjevani, Y. and Shamir, O. Communication complexity of distributed convex learning and optimization. In Advances in neural information processing systems 28 , pp. 1756-1764, 2015.
- Baxter, J. A model of inductive bias learning. Journal of Artificial Intelligence Research , 12:149-198, 2000.
- Ben-David, S. and Schuller, R. Exploiting task relatedness for multiple task learning. In Learning Theory and Kernel Machines , pp. 567-580. Springer, 2003.
- Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konecn´ y, J., Mazzocchi, S., McMahan, H. B., Overveldt, T. V., Petrou, D., Ramage, D., and Roselander, J. Towards federated learning at scale: System design. In Conference on Systems and Machine Learning (SysML) , 2019. URL http://arxiv.org/abs/1902.01046 . · arXiv
- Carmon, Y., Duchi, J. C., Hinder, O., and Sidford, A. Lower bounds for finding stationary points i. arXiv preprint arXiv:1710.11606 , 2017. · arXiv
- Caruana, R. Multitask learning. Machine learning , 28(1): 41-75, 1997.
- Even-Dar, E., Kearns, M., Mansour, Y., and Wortman, J. Regret to the best vs. regret to the average. Machine Learning , 72(1):21-37, Aug 2008. ISSN 15730565. doi: 10.1007/s10994-008-5060-z. URL https: //doi.org/10.1007/s10994-008-5060-z . · DOI
- Evgeniou, T. and Pontil, M. Regularized multi-task learning. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining , pp. 109-117. ACM, 2004.
- Evgeniou, T., Micchelli, C. A., and Pontil, M. Learning multiple tasks with kernel methods. Journal of Machine Learning Research , 6(Apr):615-637, 2005.
- Hard, A., Rao, K., Mathews, R., Beaufays, F., Augenstein, S., Eichner, H., Kiddon, C., and Ramage, D. Federated learning for mobile keyboard prediction. arXiv preprint 1811.03604 , 2018. · arXiv
- Hazan, E. Introduction to online convex optimization. Foundations and Trends R © in Optimization , 2(3-4):157-325, 2016.
- Koneˇ cn´ y, J., McMahan, H. B., Ramage, D., and Richt´ arik, P. Federated optimization: Distributed machine learning for on-device intelligence. arXiv preprint arXiv:1610.02527 , 2016. · arXiv
- Maurer, A. Bounds for linear multi-task learning. Journal of Machine Learning Research , 7(Jan):117-139, 2006.
- McMahan, H. B., Moore, E., Ramage, D., Hampson, S., and y Arcas, B. A. Communication-efficient learning of deep networks from decentralized data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics , pp. 1273-1282, 2017.
- Sani, A., Neu, G., and Lazaric, A. Exploiting easy data in online optimization. In Advances in Neural Information Processing Systems , pp. 810-818, 2014.
- Shalev-Shwartz, S. Online learning and online convex optimization. Foundations and Trends R © in Machine Learning , 4(2):107-194, 2012.
- Shalev-Shwartz, S., Shamir, O., Srebro, N., and Sridharan, K. Stochastic convex optimization. In Proceedings of the 22nd Annual Conference on Learning Theory (COLT) , 2009.
- Turlach, B. A., Venables, W. N., and Wright, S. J. Simultaneous variable selection. Technometrics , 47(3):349-363, 2005.
- Woodworth, B. and Srebro, N. Tight complexity bounds for optimizing composite objectives. In Advances in neural information processing systems , pp. 3639-3647, 2016.
- Woodworth, B. and Srebro, N. Lower bound for randomized first order convex optimization. arXiv preprint arXiv:1709.03594 , 2017. · arXiv
- Woodworth, B., Wang, J., Smith, A., McMahan, B., and Srebro, N. Graph oracle models, lower bounds, and gaps for parallel stochastic optimization. In Advances in Neural Information Processing Systems 31 , pp. 85058515. 2018.
- Zinkevich, M. Online convex programming and generalized infinitesimal gradient ascent. In Proceedings of the 20th International Conference on Machine Learning (ICML) , pp. 928-936, 2003.
Cited by
Sorted by citations
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772 · see citing works
Self-citationFederated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210 · see citing works
A survey on federated learning
Zhang, C., Xie, Y., Bai, H., Yu, B., Li, W., & Gao, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106775 · Cited by 1,899 · see citing works
Federated Learning for Healthcare Informatics
Xu, J., Glicksberg, B. S., Su, C., Walker, P., Bian, J., & Wang, F. (2021) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-020-00082-4 · Cited by 1,542 · see citing works
A Survey on Federated Learning for Resource-Constrained IoT Devices
Imteaj, A., Thakker, U., Wang, S., Li, J., & Amini, M. H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3095077 · Cited by 774 · see citing works
Federated learning with hierarchical clustering of local updates to improve training on non-IID data
Briggs, C., Fan, Z., & András, P. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207469 · Cited by 747 · see citing works
FedMD: Heterogenous Federated Learning via Model DistillationPreprint
Li, D., & Wang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.03581 · Cited by 562 · see citing works
Wahab, O. A., Mourad, A., Otrok, H., & Taleb, T. (2021) · IEEE Communications Surveys and Tutorials · doi:10.1109/comst.2021.3058573 · Cited by 444 · see citing works
Adaptive Personalized Federated LearningPreprint
Deng, Y., Kamani, M. M., & Mahdavi, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.13461 · Cited by 366 · see citing works
Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning
So, J., Guler, B., & Avestimehr, A. S. (2021) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2021.3054610 · Cited by 318 · see citing works
Federated Learning of a Mixture of Global and Local ModelsPreprint
Hanzely, F., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05516 · Cited by 250 · see citing works
Learning to Detect Malicious Clients for Robust Federated LearningPreprint
Li, S., Cheng, Y. J., Wang, W., Liu, Y., & Chen, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.00211 · Cited by 202 · see citing works
Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated LearningPreprint
Yang, H., Fang, M., & Liu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.11203 · Cited by 150 · see citing works
Challenges, Applications and Design Aspects of Federated Learning: A Survey
Rahman, K. M. J., Ahmed, F., Akhter, N., Hasan, M., Amin, R., Aziz, K. E., Islam, A. K. M. M., Mukta, M. S. H., & Islam, A. K. M. N. (2021) · IEEE Access · doi:10.1109/access.2021.3111118 · Cited by 147 · see citing works
FedBCD: A Communication-Efficient Collaborative Learning Framework for Distributed Features
Liu, Y., Zhang, X., Kang, Y., Li, L., Chen, T., Hong, M., & Yang, Q. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3198176 · Cited by 192 · see citing works
Federated Learning With Quantized Global Model UpdatesPreprint
Amiri, M. M., Gündüz, D., Kulkarni, S. R., & Poor, H. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10672 · Cited by 111 · see citing works
A Review of Privacy-Preserving Federated Learning for the Internet-of-Things
Briggs, C., Fan, Z., & Andras, P. (2021) · Studies in Computational Intelligence · doi:10.1007/978-3-030-70604-3_2 · Cited by 101 · see citing works
Lower Bounds and Optimal Algorithms for Personalized Federated LearningPreprint
Hanzely, F., Hanzely, S., Horváth, S., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02372 · Cited by 100 · see citing works
FedScale: Benchmarking Model and System Performance of Federated Learning at ScalePreprint
Lai, F., Dai, Y., Singapuram, S. S. V., Liu, J., Zhu, X., Madhyastha, H. V., & Chowdhury, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.11367 · Cited by 87 · see citing works
Qiao, C., Li, M., Liu, Y., & Tian, Z. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3399612 · Cited by 83 · see citing works
Federated Learning in Health care Using Structured Medical Data
Oh, W., & Nadkarni, G. N. (2023) · Advances in Kidney Disease and Health · doi:10.1053/j.akdh.2022.11.007 · Cited by 85 · see citing works
Federated Learning Under Intermittent Client Availability and Time-Varying Communication Constraints
Ribero, M., Vikalo, H., & Veciana, G. A. D. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3224590 · Cited by 60 · see citing works
Averaging Is Probably Not the Optimum Way of Aggregating Parameters in Federated Learning
Xiao, P., Cheng, S., Stankovic, V., & Vukobratovic, D. (2020) · Entropy · doi:10.3390/e22030314 · Cited by 54 · see citing works
“In [19], they investigate a pluralistic solution to address the cyclic patterns in data samples during federated training.”
BackgroundFedCluster: Boosting the Convergence of Federated Learning via Cluster-Cycling
Chen, C., Chen, Z., Zhou, Y., & Kailkhura, B. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9377960 · Cited by 54 · see citing works
Managing Distributed Machine Learning Lifecycle for Healthcare Data in the Cloud
Zeydan, E., Arslan, Ş. S., & Liyanage, M. (2024) · IEEE Access · doi:10.1109/access.2024.3443520 · Cited by 54 · see citing works
FedPA: An adaptively partial model aggregation strategy in Federated Learning
Liu, J., Wang, J. H., Rong, C., Xu, Y., Yu, T., & Wang, J. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.108468 · Cited by 44 · see citing works
Time-Sensitive Learning for Heterogeneous Federated Edge Intelligence
Xiao, Y., Zhang, X., Li, Y., Shi, G.-M., Krunz, M., Nguyen, D., & Hoang, D. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3237374 · Cited by 39 · see citing works
Federated Learning under Heterogeneous and Correlated Client Availability
Rodio, A., Faticanti, F., Marfoq, O., Neglia, G., & Leonardi, E. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10228876 · Cited by 29 · see citing works
Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated LearningPreprint
So, J., Güler, B., & Avestimehr, A. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04156 · Cited by 28 · see citing works
An Efficient and Robust Aggregation Algorithm for Learning Federated CNN
Lu, Y., & Fan, L. (2020) · doi:10.1145/3432291.3432303 · Cited by 26 · see citing works
Adaptive Batch Homomorphic Encryption for Joint Federated Learning in Cross-Device Scenarios
Han, J., & Li, Y. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3323358 · Cited by 25 · see citing works
TornadoAggregate: Accurate and Scalable Federated Learning via the Ring-Based ArchitecturePreprint
Lee, J., Oh, J., Lim, S., Yun, S.-Y., & Lee, J.-G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03214 · Cited by 23 · see citing works
Wu, L., Guo, S., Hong, Z., Liu, Y., Xu, W., & Zhan, Y. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3317063 · Cited by 22 · see citing works
A Better Alternative to Error Feedback for Communication-Efficient Distributed Learning
Horváth, S., & Richtárik, P. (2020) · King Abdullah University of Science and Technology Repository (King Abdullah University of Science and Technology) · doi:10.48550/arxiv.2006.11077 · Cited by 17 · see citing works
Decision Trees in Federated Learning: Current State and Future Opportunities
Heiyanthuduwage, S. R., Altas, I., Bewong, M., Islam, M. Z., & Deho, O. B. (2024) · IEEE Access · doi:10.1109/access.2024.3440998 · Cited by 18 · see citing works
Federated Learning Under Heterogeneous and Correlated Client Availability
Rodio, A., Faticanti, F., Marfoq, O., Neglia, G., & Leonardi, E. (2023) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2023.3324257 · Cited by 15 · see citing works
Asynchronous Stochastic Gradient Descent Over Decentralized Datasets
Du, Y., & You, K. (2021) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2021.3059848 · Cited by 15 · see citing works
Device Heterogeneity in Federated Learning: A Superquantile Approach
Laguel, Y., Pillutla, K., Malick, J., & Harchaoui, Z. (2020) · arXiv · doi:10.48550/arxiv.2002.11223 · Cited by 15 · see citing works
Federated learning with superquantile aggregation for heterogeneous data
Pillutla, K., Laguel, Y., Malick, J., & Harchaoui, Z. (2023) · Machine Learning · doi:10.1007/s10994-023-06332-x · Cited by 14 · see citing works
A Review of Privacy Preserving Federated Learning for Private IoT Analytics.Preprint
Briggs, C. C., Fan, Z., & András, P. (2020) · arXiv (Cornell University) · Cited by 15 · see citing works
FedEWA: Federated Learning with Elastic Weighted Averaging
Bai, J., Sajjanhar, A., Xiang, Y., Tong, X., & Zeng, S. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892851 · Cited by 13 · see citing works
Yamany, W., Keshk, M., Moustafa, N., & Turnbull, B. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3319039 · Cited by 12 · see citing works
Practical and Bilateral Privacy-preserving Federated LearningPreprint
Feng, Y., Yang, X., Fang, W., Xia, S., & Tang, X. (2020) · arXiv (Cornell University) · Cited by 11 · see citing works
Adaptive Personalized Federated Learning for Non-IID Data with Continual Distribution Shift
Chen, S., Liu, W., Zhang, X., Xu, H., Lin, W., & Chen, X. (2024) · International Workshop on Quality of Service · doi:10.1109/iwqos61813.2024.10682851 · Cited by 8 · see citing works
Exploring Communication-Efficient Federated Learning via Stateless in-Network Aggregation
Xia, J., Cheng, G., Wu, W., Luo, L., & Guo, D. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3551368 · Cited by 8 · see citing works
Distributed Optimization over Block-Cyclic DataPreprint
Ding, Y., Niu, C., Yan, Y., Zheng, Z., Wu, F., Chen, G., Tang, S., & Jia, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07454 · Cited by 8 · see citing works
A reward response game in the blockchain-powered federated learning system
Jiang, S., & Wu, J. (2021) · International Journal of Parallel Emergent and Distributed Systems · doi:10.1080/17445760.2021.2004411 · Cited by 7 · see citing works
FedBroadcast: Exploit Broadcast Channel for Fast Convergence in Wireless Federated Learning
Tian, H., Zhang, H., Jia, J., Dong, M., & Ota, K. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3218729 · Cited by 7 · see citing works
Privacidade do Usuário em Aprendizado Colaborativo: Federated Learning, da Teoria à Prática
Neto, H. C., Mattos, D. M. F., & Fernandes, N. (2020) · doi:10.5753/sbc.8285.6.3 · Cited by 5 · see citing works
DROPFL: Client Dropout Attacks Against Federated Learning Under Communication Constraints
Wenjun, Q., Shen, Q., Xu, H., Huang, X., & Wu, Z. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446609 · Cited by 5 · see citing works
Federated Learning under Restricted user Availability
Theodoropoulos, P., Nikolakakis, K. E., & Kalogerias, D. S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448318 · Cited by 4 · see citing works
Federated Learning at Scale: Addressing Client Intermittency and Resource Constraints
Ribero, M., Vikalo, H., & Veciana, G. A. D. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3430118 · Cited by 4 · see citing works
An Energy Consumption Model for Electrical Vehicle Networks via Extended Federated-learning
Zhang, S. (2021) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv48863.2021.9575223 · Cited by 4 · see citing works
Efficient Federated Learning with Heterogeneous Data and Adaptive Dropout
Liu, J., Ma, B., Yu, Q.-L., Jin, R., Zhou, J.-B., Zhou, Y., Dai, H., Wang, H.-X., Dou, D.-J., & Valduriez, P. (2025) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3749376 · Cited by 7 · see citing works
Privacy Preservation Learning with Deep Cooperative Method for Multimedia Data Analysis
Si, W., & Liu, C. (2022) · Security and Communication Networks · doi:10.1155/2022/8449987 · Cited by 3 · see citing works
Performative Federated Learning: A Solution to Model-Dependent and Heterogeneous Distribution Shifts
Jin, K., Yin, T., Chen, Z., Sun, Z., Zhang, X., Liu, Y., & Liu, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i11.29191 · Cited by 3 · see citing works
Global Multiclass Classification and Dataset Construction via Heterogeneous Local Experts
Ahn, S., Özgür, A., & Pilancı, M. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.3041804 · Cited by 3 · see citing works
FedIM: An Anti-attack Federated Learning Based on Agent Importance Aggregation
Gao, Z., Qiu, C., Chen, Z., Yang, Y., Mo, Z., & Lin, Y. (2021) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom53373.2021.00205 · Cited by 2 · see citing works
Diagnosing Machine Learning Problems in Federated Learning Systems: A Case Study
Bogacka, K., Danilenka, A., & Wasielewska-Michniewska, K. (2023) · Annals of Computer Science and Information Systems · doi:10.15439/2023f722 · Cited by 1 · see citing works
Demystifying the Effects of Non-Independence in Federated LearningPreprint
Arnold, S., & Yesilbas, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11226 · Cited by 1 · see citing works
Global Multiclass Classification from Heterogeneous Local Models.Preprint
Ahn, S., Özgür, A., & Pilancı, M. (2020) · arXiv (Cornell University)
Online Parameter-Free Learning of Multiple Low Variance TasksPreprint
Denevi, G., Stamos, D., & Pontil, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05732
Optimization for Supervised Machine Learning: Randomized Algorithms for Data and ParametersPreprint
Hanzely, F. (2020) · arXiv (Cornell University) · doi:10.25781/kaust-4f2dh
Integration of federated learning paradigms into electronic health record systems
Obakhena, H. I., Imoize, A. L., & Anyasi, F. I. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-13897-3.00017-5
Gradient Scale Monitoring for Federated Learning Systems
Bogacka, K., Danilenka, A., & Wasielewska-Michniewska, K. (2024) · Journal of Automation Mobile Robotics & Intelligent Systems · doi:10.14313/jamris/3-2024/18
Federated Learning Algorithm Based on Adaptive Gradient Fusion
Su, H., Zhu, M., Guo, X. W., Li, G., Zhang, Q., & Shen, T. (2024) · International Conference on Next Generation Data-driven Networks (NGDN) · doi:10.1109/ngdn61651.2024.10744184
- Authors
- Eichner, H., Koren, T., McMahan, H. B., Srebro, N., & Talwar, K.
- Affiliations
- Google (United States) (US)
- Toyota Technological Institute at Chicago (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Pages
- 1764-1773
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1904.10120
- OpenAlex
- W2941142392
- Cited by
- 66
- References
- 0
- Citations by year
- 2025: 2 · 2024: 11 · 2023: 9 · 2022: 5 · 2021: 14 · 2020: 24 · 2019: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- stochastic gradient descent, non-IID data, federated learning, convex optimization, performance guarantees, heterogeneous devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
