Hypothesis Transfer Learning for Efficient Data Computing in Smart Cities Environments
Open accessAbstract
It is commonly assumed that in a smart city there will be thousands of mostly mobile/wireless smart devices (e.g. sensors, smart-phones, etc.) that will continuously generate big amounts of data. Data will have to be collected and processed in order to extract knowledge out of it, to feed users' and smart city applications. A typical approach to process such big amounts of data is to i) gather all the collected data on the cloud through wireless pervasive networks, and ii) perform data analysis operations exploiting machine learning techniques. However, according to many studies, this centralised cloud-based approach may not be sustainable from a networking point of view. The joint effect of data-intensive users' multimedia applications and smart cities monitoring and control applications may result in severe network congestions making applications hardly usable. To cope with this problem, in this paper we propose a distributed machine learning approach that does not require to move data in a centralised cloud platform, but processes it directly where it is collected. Specifically, we exploit Hypothesis Transfer Learning (HTL) to build a distributed machine learning framework. In our framework we train a series of partial models, each ''residing'' in a location where a subset of the dataset is generated. We then refine the partial models by exchanging them between locations, thus obtaining a unique complete model. Using an activity classification task on a reference dataset as a concrete example, we show that the classification accuracy of the HTL model is comparable with that of a model built out of the complete dataset, but the cost in term of network overhead is dramatically reduced. We then perform a sensitiveness analysis to characterise how the overhead depends on key parameters. It is also worth noticing that the HTL approach is suitable for applications dealing with privacy sensitive data, as data can stay where they are generated, and do not need to be transferred to third parties, i.e., to a cloud provider, to extract knowledge out of it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ML is key to preprocessing large amounts of data in large sensor networks, allowing only relevant data to be transmitted instead of all raw data.
“ML is key to preprocessing large amounts of data in large sensor networks, allowing only what is relevant to be transmitted, instead of all the raw data that is being collected [480,672,804].”
From Tackling climate change with machine learning (2023) · cites this paper as [804]
Cites
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466 · see citing works
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325 · see citing works
Fog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244 · see citing works
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384 · see citing works
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,189 · see citing works
The Internet of Things vision: Key features, applications and open issues
Borgia, E. (2014) · Computer Communications · doi:10.1016/j.comcom.2014.09.008 · Cited by 1,496 · see citing works
Edge-centric Computing: Vision and Challenges
Garcia Lopez, P., Montresor, A., Epema, D., Datta, A., Higashino, T., Iamnitchi, A., Barcellos, M., Felber, P., & Riviere, E. (2015) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2831347.2831354 · Cited by 934 · see citing works
Transition-Aware Human Activity Recognition Using Smartphones
Reyes-Ortiz, J.-L., Oneto, L., Samà, A., Parra, X., & Anguita, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.085 · Cited by 740 · see citing works
(2013) · Cited by 651 · see citing works
Fast Kernel Classifiers With Online And Active Learning
Bordes, A., Ertekin, Ş., Weston, J., & Bottou, L. (2005) · Cited by 622 · see citing works
From opportunistic networks to opportunistic computing
Conti, M., Giordano, S., May, M., & Passarella, A. (2010) · IEEE Communications Magazine · doi:10.1109/mcom.2010.5560597 · Cited by 259 · see citing works
Self-citationUsing and combining predictors that specialize
Freund, Y., Schapire, R. E., Singer, Y., et al. (1997) · ACM Symposium on Theory of Computing (STOC) · doi:10.1145/258533.258616 · Cited by 236 · see citing works
Distributed learning for Random Vector Functional-Link networks
Scardapane, S., Wang, D., Panella, M., & Uncini, A. (2015) · Information Sciences · doi:10.1016/j.ins.2015.01.007 · Cited by 154 · see citing works
Distributed Support Vector Machines
Navia-Vázquez, A., Gutiérrez-González, D., Parrado-Hernández, E., et al. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.875968 · Cited by 105 · see citing works
Distributed machine learning in networks by consensus
Georgopoulos, L., & Hasler, M. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.12.055 · Cited by 77 · see citing works
Transfer Learning Through Greedy Subset Selection
Kuzborskij, I., Orabona, F., & Barbara Caputo, B. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-23231-7_1 · Cited by 23 · see citing works
Let's get physical: Adding physical dimensions to cyber systems
Sangiovanni-Vincentelli, A. L. (2015) · IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped.2015.7273478 · Cited by 19 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Tackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336 · see citing works
Habibzadeh, H., Boggio-Dandry, A., Qin, Z., Soyata, T., Kantarci, B., & Mouftah, H. T. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700304 · Cited by 64 · see citing works
- Authors
- Valerio, L., Passarella, A., & Conti, M.
- Affiliations
- Institute of Informatics and Telematics (IT)
- Venue
- 2016 IEEE International Conference on Smart Computing (SMARTCOMP)
- Publisher
- IEEE
- Published
- 2016-05
- Volume
- 6
- Pages
- 1-8
- OpenAlex
- W2475667482
- Cited by
- 24
- References
- 17
- Citations by year
- 2023: 3 · 2022: 5 · 2021: 2 · 2020: 2 · 2019: 2 · 2018: 3 · 2017: 6 · 2016: 1
- FWCI
- 3.42
- Type
- conference paper
- Language
- en
- Open access
- green
- puma.isti.cnr.it
- Licence
- other-oa
- Locations
- IEEE International Conference on Smart Computing (publishedVersion)
- Funders
- Horizon 2020 Framework Programme
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Information Systems › Internet of Things and AI
- Keywords
- distributed learning, smart cities, edge computing, network congestion, activity classification, network overhead, privacy-sensitive data, wireless sensor networks, big data processing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review