Cited by 88IoT and Edge/Fog ComputingCloud Computing and Resource ManagementEnergy Efficiency in Computing

On-edge multi-task transfer learning: model and practice with data-driven task allocation

Open access
Chen, Qiong, Zheng, Zimu, Hu, Chuang, Wang, Dan, Liu, Fangming·2020·IEEE Transactions on Parallel and Distributed Systems

Abstract

On edge devices, data scarcity occurs as a common problem where transfer learning serves as a widely-suggested remedy. Nevertheless, transfer learning imposes heavy computation burden to the resource-constrained edge devices. Existing task allocation works usually assume all submitted tasks are equally important, leading to inefficient resource allocation at a task level when directly applied in Multi-task Transfer Learning (MTL). To address these issues, we first reveal that it is crucial to measure the impact of tasks on overall decision performance improvement and quantify task importance. We then show that task allocation with task importance for MTL (TATIM) is a variant of NP-complete Knapsack problem, where the complicated computation to solve this problem needs to be conducted repeatedly under varying contexts. To solve TATIM with high computational efficiency, we propose a Data-driven Cooperative Task Allocation (DCTA) approach. Finally, we evaluate the performance of DCTA by not only a trace-driven simulation, but also a new comprehensive real-world AIOps case study which bridges model and practice via a new architecture and main components design within AIOps system. Extensive experiments show that our DCTA reduces 3.24 times of processing time, and saves 48.4 percent energy consumption compared with the state-of-the-art when solving TATIM.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tpds.2019.2962435

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

5 of the 64 references couldn’t be matched to a known paper.

Research works printed but not linked: 6

  1. [22][22] D. Isele, M. Rostami, and E. Eaton, 'Using task features for zeroshot knowledge transfer in lifelong learning.' in IJCAI , 2016. -
  2. [24][24] H. Hu, L. Chen, B. Gong, and F. Sha, 'Synthesize policies for transfer and adaptation across tasks and environments,' in Advances in Neural Information Processing Systems , 2018, pp. 1176-1185. -
  3. [50][50] K. Hsieh, A. Harlap, N. Vijaykumar et al. , 'Gaia: Geo-distributed machine learning approaching lan speeds.' in NSDI , 2017. -
  4. [54][54] J. H. Ko, T. Na, M. F. Amir, and S. Mukhopadhyay, 'Edge-host partitioning of deep neural networks with feature space encoding for resource-constrained internet-of-things platforms,' arXiv preprint arXiv:1802.03835 , 2018. - · arXiv
  5. [68][68] K. Anderson et al. , 'BLUED: a fully labeled public dataset for Event-Based nilm research,' in ACM SIGKDD Workshop on SustKDD , 2012. -
  6. [69][69] Batra et al. , 'Gemello: Creating a detailed energy breakdown from just the monthly electricity bill,' in ACM SIGKDD , 2016. <!-- image --> Zimu Zheng received his B.Eng. degree (Software Engineering) in South China University of Technology in 2014 and Ph.D degree (Computer Science) in the Hong Kong Polytechnic University in 2019. He is currently a research staff at Cloud BU of Huawei. Zimu has received several awards for outstanding technical contributions in Huawei. He also received the Best Paper Award of ACM e-Energy and the Best Paper Award of ACM BuildSys in 2018. His research interest lies in applied machine learning with IoT Data. <!-- image --> <!-- image --> Qiong Chen received his B.Eng. degree in School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China. He is currently a M.Eng. student in School of Computer Science and Technology, Huazhong University of Science and Technology. His research interests include applied machine learning and edge computing. He received the Best Paper Award of ACM International Conference on Future Energy Systems (ACM e-Energy) in 2018. Chuang Hu received his B.Sc degree and M.Sc degree from the Department of Computing Science, Wuhan University, China, in 2013 and 2016, respectively. He is currently a Ph.D. student in the Department of Computing, Hong Kong Polytechnic University. His research interests include networking, wireless technologies, IoT, cloud computing, and big data. <!-- image --> <!-- image --> Dan Wang (S'05, M'07, SM'13) received his B.Sc degree from Peking University, Beijing, China, in 2000, his M.Sc degree from Case Western Reserve University, Cleveland, Ohio, in 2004, and his Ph.D. degree from Simon Fraser University, Burnaby, British Columbia, Canada, in 2007, all in computer science. He is currently an associate professor at the Department of Computing, Hong Kong Polytechnic University. His research interests include network architecture and QoS, smart buildings and Industry 4.0. Fangming Liu (S'08, M'11, SM'16) received the B.Eng. degree from the Tsinghua University, Beijing, and the Ph.D. degree from the Hong Kong University of Science and Technology, Hong Kong. He is currently a Full Professor with the Huazhong University of Science and Technology, Wuhan, China. His research interests include cloud computing and edge computing, datacenter and green computing, SDN/NFV/5G and applied ML/AI. He received the National Natural Science Fund (NSFC) for Excellent Young Scholars, and the National Program Special Support for Top-Notch Young Professionals. He is a recipient of the Best Paper Award of IEEE/ACM IWQoS 2019, ACM e-Energy 2018 and IEEE GLOBECOM 2011, as well as the First Class Prize of Natural Science of Ministry of Education in China.

Cited by

Sorted by citations

Authors
Chen, Q., Zheng, Z., Hu, C., Wang, D., & Liu, F.
Affiliations
  • Huazhong University of Science and Technology (CN)
  • Huawei Technologies (China) (CN)
  • Hong Kong Polytechnic University (HK)
Venue
IEEE Transactions on Parallel and Distributed Systems
Published
2020-06-01
Volume
31
Issue
6
Pages
1357-1371
ISSN
  • 1045-9219 (ISSN-L)
  • 1558-2183
  • 2161-9883
OpenAlex
W2996942942
Cited by
88
References
64
Citations by year
2026: 5 · 2025: 10 · 2024: 22 · 2023: 14 · 2022: 19 · 2021: 11 · 2020: 7
FWCI
5.06
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Parallel and Distributed Systems (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Natural Science Foundation of China (61722206, 61761136014, 61520106005)
  • NSFC-DFG (392046569)
  • National Key Research and Development (2017YFB1001703)
  • Fundamental Research Funds for the Central Universities (2017KFKJXX009, 3004210116)
  • RGC GRF (PolyU 15210119, CRF C5026-18G, ITF UIM/363, ITF ITS/070/19FP, PolyU 1-ZVPZ)
  • Huawei Collaborative
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
  • Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
  • Physical Sciences › Computer Science › Hardware and Architecture › Energy Efficiency in Computing
Keywords
edge computing, task allocation, task significance, knapsack problem, resource-constrained edge devices, data scarcity, AIOps, energy consumption, trace-driven simulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review