TinyFedTL: Federated Transfer Learning on Tiny Devices
Open accessAbstract
TinyML has rose to popularity in an era where data is everywhere. However, the data that is in most demand is subject to strict privacy and security guarantees. In addition, the deployment of TinyML hardware in the real world has significant memory and communication constraints that traditional ML fails to address. In light of these challenges, we present TinyFedTL, the first implementation of federated transfer learning on a resource-constrained microcontroller.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Tiny-FedTL uses Arduino to deploy on top of TensorFlow Lite Micro with an on-device training facility.
“It uses Arduino to deploy the TinyFedTL on top of Tensorflow Lite Micro with an on-device training facility.”
From A review on TinyML: State-of-the-art and prospects (2022) · cites this paper as Kopparapu and Lin, 2021
The Introduction (p. 1) identifies an Arduino implementation, and §4.4.2 (p. 6) reports training on-device. But §3.3 (p. 3) says TensorFlow Lite Micro was incompatible with on-device training, so the authors implemented their own training update in C++; the claim that TinyFedTL was deployed on top of TensorFlow Lite Micro with a training facility is not supported. (LLM, conf=0.88)
Experimental — accuracy not yet measuredThe Tiny-FedTL approach deploys a machine learning model without needing excess memory utilization.
“The implied Tiny-FedTL approach deploys a machine learning model without needing excess memory utilization.”
From A review on TinyML: State-of-the-art and prospects (2022) · cites this paper as Kopparapu and Lin, 2021
Kopparapu and Lin (2021) implement federated learning for IoT-enabled edge devices.
“In (Kopparapu and Lin, 2021), implementation of federated learning is done for IoT-enabled edge devices.”
From A review on TinyML: State-of-the-art and prospects (2022) · cites this paper as Kopparapu and Lin, 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772 · see citing works
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565 · see citing works
TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systems
David, R., Duke, J., Jain, A., Reddi, V. J., Jeffries, N., Li, J., Kreeger, N., Nappier, I., Natraj, M., Regev, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.08678 · Cited by 470 · see citing works
Benchmarking TinyML Systems: Challenges and Direction
Banbury, C. R., Reddi, V. J., Lam, M., Fu, W., Fazel, A., Holleman, J., Huang, X., Hurtado, R., Kanter, D., Lokhmotov, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2003.04821 · Cited by 216 · see citing works
Overcoming Forgetting in Federated Learning on Non-IID DataPreprint
Shoham, N., Avidor, T., Keren, A., Israel, N., Benditkis, D., Mor-Yosef, L., & Zeitak, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.07796 · Cited by 169 · see citing works
Visual Wake Words DatasetPreprint
Chowdhery, A., Warden, P., Shlens, J., Howard, A., & Rhodes, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05721 · Cited by 131 · see citing works
Incremental On-Device Tiny Machine Learning
Disabato, S., & Roveri, M. (2020) · International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things (AIChallengeIoT) · doi:10.1145/3417313.3429378 · Cited by 56 · see citing works
FedCD: Improving Performance in non-IID Federated LearningPreprint
Kopparapu, K., Lin, E., & Zhao, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09637 · Cited by 30 · see citing works
Self-citation
Flagged first, then by citations
1 of the 10 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- [3][3] Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. Communicationefficient learning of deep networks from decentralized data. In Artificial Intelligence and Statistics , pages 12731282. PMLR, 2017. -
- [5][5] Maria Florina Balcan, Avrim Blum, Shai Fine, and Yishay Mansour. Distributed learning, communication complexity and privacy. In Conference on Learning Theory , pages 26-1, 2012. -
- [9][9] Han Cai, Chuang Gan, Ligeng Zhu, and Song Han. Tinytl: Reduce memory, not parameters for efficient ondevice learning. Advances in Neural Information Processing Systems , 33, 2020. -
Cited by
Sorted by citations
A review on TinyML: State-of-the-art and prospects
Ray, P. P. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.11.019 · Cited by 460 · see citing works
Intelligence at the Extreme Edge: A Survey on Reformable TinyML
Rajapakse, V., Karunanayake, I., & Ahmed, N. (2023) · ACM Computing Surveys · doi:10.1145/3583683 · Cited by 129 · see citing works
Tiny Machine Learning for Resource-Constrained Microcontrollers
Immonen, R., & Hämäläinen, T. (2022) · Journal of Sensors · doi:10.1155/2022/7437023 · Cited by 85 · see citing works
On TinyML and Cybersecurity: Electric Vehicle Charging Infrastructure Use Case
Dehrouyeh, F., Yang, L., Ajaei, F. B., & Shami, A. A. (2024) · IEEE Access · doi:10.1109/access.2024.3437192 · Cited by 57 · see citing works
TinyReptile: TinyML with Federated Meta-Learning
Ren, H., Anicic, D., & Runkler, T. A. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191845 · Cited by 46 · see citing works
Comparison of Two Microcontroller Boards for On-Device Model Training in a Keyword Spotting Task
Giménez, N. L., Freitag, F., Lee, J., & Vandierendonck, H. (2022) · Mediterranean Conference on Embedded Computing (MECO) · doi:10.1109/meco55406.2022.9797171 · Cited by 9 · see citing works
TDMiL: Tiny Distributed Machine Learning for Microcontroller-Based Interconnected Devices
Gulati, M., Zandberg, K., Huang, Z., Wunder, G., Adjih, C., & Baccelli, E. (2024) · IEEE Access · doi:10.1109/access.2024.3492921 · Cited by 8 · see citing works
Lite-Agro 2.0: Integrating Federated and TinyML in Pear Disease Classification IoAT-Edge AI
Dockendorf, C., Mitra, A., Mohanty, S. P., & Kougianos, E. (2023) · IEEE International Symposium on Smart Electronic Systems (iSES) · doi:10.1109/ises58672.2023.00096 · Cited by 6 · see citing works
A multi-microcontroller-based hardware for deploying Tiny machine learning model
Nguyen, K., Tran, V.-K., Pham, H. X., Nguyen, V.-M., Nguyen, H.-D., & Nguyen, C.-N. (2023) · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · doi:10.11591/ijece.v13i5.pp5727-5736 · Cited by 5 · see citing works
Distributed TinyML on Resource-Constrained IoT Sensor Networks
Yuan, Z., & Law, K. L. E. (2024) · IEEE World Forum on Internet of Things (WF-IoT) · doi:10.1109/wf-iot62078.2024.10811277 · Cited by 4 · see citing works
FedTM: Memory and Communication Efficient Federated Learning with Tsetlin Machine
How, S. S. Q., Chauhan, J., Merrett, G. V., & Hare, J. S. (2023) · International Symposium on the Tsetlin Machine (ISTM) · doi:10.1109/istm58889.2023.10454982 · Cited by 2 · see citing works
Sriram, S., Hariharathmajan, R. K., Barathi Babu, M., Pradeep, A., & Karthi, R. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.04.065 · Cited by 2 · see citing works
TinyML Applications in Micronutrient Sensing: A Review of Microcontroller DeploymentsPreprint
Moeketsi, D., Mkhantshwa, A., Modise, C., & Mlangeni, N. (2025) · Research Square · doi:10.21203/rs.3.rs-6844555/v1
- Authors
- Kopparapu, K., & Lin, E.
- Affiliations
- Harvard University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2110.01107
- OpenAlex
- W3203576251
- Cited by
- 14
- References
- 10
- Citations by year
- 2025: 1 · 2024: 6 · 2023: 5 · 2022: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- federated transfer learning, TinyML, microcontroller, resource-constrained devices, edge computing, privacy-preserving machine learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review