Wireless Image Retrieval at the Edge
Open accessThe DOI matches its Crossref record; 42 of the 44 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
We study the image retrieval problem at the wireless edge, where an edge device captures an image, which is then used to retrieve similar images from an edge server. These can be images of the same person or a vehicle taken from other cameras at different times and locations. Our goal is to maximize the accuracy of the retrieval task under power and bandwidth constraints over the wireless link. Due to the stringent delay constraint of the underlying application, sending the whole image at a sufficient quality is not possible. We propose two alternative schemes based on digital and analog communications, respectively. In the digital approach, we first propose a deep neural network (DNN) aided retrieval-oriented image compression scheme, whose output bit sequence is transmitted over the channel using conventional channel codes. In the analog joint source and channel coding (JSCC) approach, the feature vectors are directly mapped into channel symbols. We evaluate both schemes on image based re-identification (re-ID) tasks under different channel conditions, including both static and fading channels. We show that the JSCC scheme significantly increases the end-to-end accuracy, speeds up the encoding process, and provides graceful degradation with channel conditions. The proposed architecture is evaluated through extensive simulations on different datasets and channel conditions, as well as through ablation studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The analog JSCC approach was presented in [234] to compress and then code the feature vectors, followed by leveraging the received perturbed signal directly for wireless image retrieval at the edge server via a fully-connected neural network.”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [234]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“Following the state-of-the-art retrieval methods [17], [21] we employ the ResNet-50 network [34], pretrained on Ima-”
MethodA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Information Theory and Reliable Communication.
Lee, P. M., & Gallager, R. T. (1970) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344305 · Cited by 5,399
Scalable Person Re-identification: A Benchmark
Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., & Tian, Q. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.133 · Cited by 4,506 · cited 1×
“Market-1501 [40] contains 32217 images of 1501 pedestrians taken from a total of six cameras in front of a”
BackgroundLearning internal representations by error propagation
RUMELHART, D. E., HINTON, G. E., & WILLIAMS, R. J. (1988) · Readings in Cognitive Science · doi:10.1016/b978-1-4832-1446-7.50035-2 · Cited by 3,002 · cited 1×
“More recently, JSCC schemes based on autoencoders [30], which are DNNs aimed at unsupervised data coding, have been introduced [2], [3], [31], [32], and are shown to provide comparable or better performance than state-of-the-art digital schemes.”
BackgroundIn Defense of the Triplet Loss for Person Re-Identification
Hermans, A., Beyer, L., & Leibe, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07737 · Cited by 2,687
DeepReID: Deep Filter Pairing Neural Network for Person Re-identification
Li, W., Zhao, R., Xiao, T., & Wang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.27 · Cited by 2,611 · cited 8×
“In order to measure the performance of the retrieval task, we employ three widely used datasets: CUHK03 [39] is a benchmark for person retrieval that contains 14096 images of 1467 identities taken from two different camera views.”
MethodInfluentialGray, R. M., & Neuhoff, D. L. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720541 · Cited by 1,642
Deep Joint Source-Channel Coding for Wireless Image Transmission
Bourtsoulatze, E., Burth Kurka, D., & Gunduz, D. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2919300 · Cited by 1,476
Learning Discriminative Features with Multiple Granularities for Person Re-Identification
Wang, G., Yuan, Y., Chen, X., Li, J., & Zhou, X. (2018) · Proceedings of the 26th ACM international conference on Multimedia · doi:10.1145/3240508.3240552 · Cited by 1,203
Person Re-identification: Past, Present and Future
Zheng, L., Yang, Y. P., & Hauptmann, A. G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02984 · Cited by 922
A Deep Learning-Based Approach to Progressive Vehicle Re-identification for Urban Surveillance
Liu, X., Liu, W., Mei, T., & Ma, H. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_53 · Cited by 641
Scheduling Policies for Federated Learning in Wireless Networks
Yang, H. H., Liu, Z., Quek, T. Q. S., & Poor, H. V. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2944169 · Cited by 640
Federated Learning Over Wireless Fading Channels
Amiri, M. M., & Gunduz, D. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2974748 · Cited by 625
Pose-Invariant Embedding for Deep Person Re-Identification
Zheng, L., Huang, Y., Lu, H., & Yang, Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2910414 · Cited by 583
ABD-Net: Attentive but Diverse Person Re-Identification
Chen, T., Ding, S., Xie, J., Yuan, Y., Chen, W., Yang, Y., Ren, Z., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00844 · Cited by 561
Multi-level Factorisation Net for Person Re-identification
Chang, X., Hospedales, T. M., & Xiang, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00225 · Cited by 550
Horizontal Pyramid Matching for Person Re-Identification
Fu, Y., Wei, Y., Zhou, Y., Shi, H., Huang, G., Wang, X., Yao, Z., & Huang, T. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018295 · Cited by 473
DeepJSCC-f: Deep Joint Source-Channel Coding of Images With Feedback
Kurka, D. B., & Gunduz, D. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2987203 · Cited by 470
PROVID: Progressive and Multimodal Vehicle Reidentification for Large-Scale Urban Surveillance
Liu, X., Liu, W., Mei, T., & Ma, H. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2751966 · Cited by 444
Deep Learning for Joint Source-Channel Coding of Text
Farsad, N., Rao, M., & Goldsmith, A. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461983 · Cited by 438
Hierarchical Federated Learning ACROSS Heterogeneous Cellular Networks
Abad, M. S. H., Ozfatura, E., GUndUz, D., & Ercetin, O. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054634 · Cited by 424
Joint Autoregressive and Hierarchical Priors for Learned Image Compression
Minnen, D. C., Ballé, J., & Toderici, G. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02736 · Cited by 310
Part-Regularized Near-Duplicate Vehicle Re-Identification
He, B., Li, J., Zhao, Y., & Tian, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00412 · Cited by 310
Viewpoint-Aware Attentive Multi-view Inference for Vehicle Re-identification
Zhouy, Y., & Shao, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00679 · Cited by 297 · cited 2×
“This has been shown to perform well in the re-ID community [16]–[22].”
MethodGunduz, D., de Kerret, P., Sidiropoulos, N. D., Gesbert, D., Murthy, C. R., & van der Schaar, M. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933969 · Cited by 214
BottleNet++: An End-to-End Approach for Feature Compression in Device-Edge Co-Inference Systems
Shao, J., & Zhang, J. (2020) · 2020 IEEE International Conference on Communications Workshops (ICC Workshops) · doi:10.1109/iccworkshops49005.2020.9145068 · Cited by 200 · cited 1×
“Analog schemes based on JSCC have recently been considered in [12], [14], [15], and they were shown to outperform separate approaches, but they focus on the classification task using low-resolution images.”
MethodBottleNet: A Deep Learning Architecture for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Esmaili, A., & Pedram, M. (2019) · 2019 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped.2019.8824955 · Cited by 196
JALAD: Joint Accuracy-And Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution
Li, H., Hu, C., Jiang, J., Wang, Z., Wen, Y., & Zhu, W. (2018) · 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/padsw.2018.8645013 · Cited by 160 · cited 1×
“[11], [13], limit the amount of information (e.”
BackgroundDeep Learning-Constructed Joint Transmission-Recognition for Internet of Things
Lee, C.-H., Lin, J.-W., Chen, P.-H., & Chang, Y.-C. (2019) · IEEE Access · doi:10.1109/access.2019.2920929 · Cited by 126
Vehicle Re-identification: an Efficient Baseline Using Triplet Embedding
Kuma, R., Weill, E., Aghdasi, F., & Sriram, P. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852059 · Cited by 122
Learning Better Lossless Compression Using Lossy Compression
Mentzer, F., Gool, L. V., & Tschannen, M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00667 · Cited by 116
Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
Amiri, M. M., & Gunduz, D. (2019) · 2019 IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2019.8849334 · Cited by 109
Joint Device-Edge Inference over Wireless Links with Pruning
Jankowski, M., Gunduz, D., & Mikolajczyk, K. (2020) · 2020 IEEE 21st International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc48557.2020.9154306 · Cited by 95
Self-citationWireless Network Intelligence at the Edge
Park, J., Samarakoon, S., Bennis, M., & Debbah, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2941458 · Cited by 92
Improving Device-Edge Cooperative Inference of Deep Learning via 2-Step Pruning
Shi, W., Hou, Y., Zhou, S., Niu, Z., Zhang, Y., & Geng, L. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps47286.2019.9093772 · Cited by 85
Deep Joint Source-Channel Coding for Wireless Image Retrieval
Jankowski, M., Gündüz, D., & Mikolajczyk, K. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054078 · Cited by 70
Self-citationJoint Source-Channel Coding for Video Communications
Zhai, F., Eisenberg, Y., & Katsaggelos, A. K. (2005) · Elsevier eBooks · doi:10.1016/b978-012119792-6/50124-8 · Cited by 68
Successive Refinement of Images with Deep Joint Source-Channel Coding
Kurka, D. B., & Gündüz, D. (2019) · 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2019.8815416 · Cited by 67 · cited 1×
“More recently, JSCC schemes based on autoencoders [30], which are DNNs aimed at unsupervised data coding, have been introduced [2], [3], [31], [32], and are shown to provide comparable or better performance than state-of-the-art digital schemes.”
BackgroundJoint source and channel coding for image transmission over lossy packet networks:
Davis, G. M., & Danskin, J. M. (1996) · SPIE Proceedings · doi:10.1117/12.258246 · Cited by 49
Distributed Hypothesis Testing Over Discrete Memoryless Channels
Sreekumar, S., & Gündüz, D. (2019) · IEEE Transactions on Information Theory · doi:10.1109/tit.2019.2953750 · Cited by 46
Joint source/channel coding for wireless channels
Goldsmith, A. (2002) · 1995 IEEE 45th Vehicular Technology Conference. Countdown to the Wireless Twenty-First Century · doi:10.1109/vetec.1995.504941 · Cited by 37
Cited by
Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications
Gunduz, D., Qin, Z., Aguerri, I. E., Dhillon, H. S., Yang, Z., Yener, A., Wong, K. K., & Chae, C.-B. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3223408 · Cited by 776
“A semantic communication system for image retrieval over a wireless channel is considered in [189], which aims to identify the top-k similar images to a query image in a large dataset of images.”
InfluentialEdge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“The analog JSCC approach was presented in [234] to compress and then code the feature vectors, followed by leveraging the received perturbed signal directly for wireless image retrieval at the edge server via a fully-connected neural network.”
MethodXu, W., Yang, Z., Ng, D. W. K., Levorato, M., Eldar, Y. C., & Debbah, M. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3239189 · Cited by 660
“For these computing tasks, it has been shown in [222], [223], [224], [225], [226] that the transmission rate can be further reduced below the entropy of the source and joint source-channel coding can perform better than a conventional separate coding design in terms of computing accuracy and speed.”
Semantic Communication Systems for Speech Transmission
Weng, Z., & Qin, Z. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3087240 · Cited by 663
“Inspired by this, different types of sources have been considered in recent investigation on E2E semantic communication systems, which mainly focus on the image and text transmission [23]–[31].”
BackgroundMethodDistributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
Metadata
- Authors
- Jankowski, M., Gunduz, D., & Mikolajczyk, K.
- Affiliations
- Imperial College London (GB)
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2021-01
- Volume
- 39
- Issue
- 1
- Pages
- 89-100
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W3044258868
- Cited by
- 3
- References
- 44
- Citations by year
- 2025: 2
- FWCI
- 0.10
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Journal on Selected Areas in Communications (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Spiral (Imperial College London) (submittedVersion)
- arXiv (Cornell University)
- Funders
- European Research Council (ERC) through Starting Grant BEACON (677854)
- U.K. Engineering and Physical Sciences Research Council (EP/N007743/1, EP/S032398/1, EP/T023600/1)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Data Compression Techniques
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- edge computing, joint source-channel coding, fading channels, delay-constrained communication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.