Leveraging Content Sensitiveness and User Trustworthiness to Recommend Fine-Grained Privacy Settings for Social Image Sharing
The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Abstract
To configure successful privacy settings for social image sharing, two issues are inseparable: 1) content sensitiveness of the images being shared; and 2) trustworthiness of the users being granted to see the images. This paper aims to consider these two inseparable issues simultaneously to recommend fine-grained privacy settings for social image sharing. For achieving more compact representation of image content sensitiveness (privacy), two approaches are developed: 1) a deep network is adapted to extract 1024-D discriminative deep features; and 2) a deep multiple instance learning algorithm is adopted to identify 280 privacy-sensitive object classes and events. Second, users on the social network are clustered into a set of representative social groups to generate a discriminative dictionary for user trustworthiness characterization. Finally, both the image content sensitiveness and the user trustworthiness are integrated to train a tree classifier to recommend fine-grained privacy settings for social image sharing. Our experimental studies have demonstrated both the efficiency and the effectiveness of our proposed algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 10×
“work are scaled down to 1,024 rather than 4,096 in the AlexNet [39]–[41], e.”
BackgroundMethodInfluentialGradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 3×
“The corresponding gradients for the objective function are calculated as ∂ξ(W,x,y) ∂W , and they are backpropagated [51] through our deep network to fine-tune the kernel weights.”
BackgroundMethodInfluentialGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2014) · Cited by 33,419
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741 · cited 3×
“…object classes and events can characterize the image content sensitiveness effectively, on the other hand, 1000 atomic object classes [39]–[44], that are usually extracted for image semantics interpretation, may not be able to characterize the image content sensitiveness exactly, e.g.,…”
BackgroundConditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479
Generative Adversarial Networks
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2661 · Cited by 4,477
Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2014) · arXiv · doi:10.48550/arxiv.1412.7062 · Cited by 4,213 · cited 1×
“tion by assigning one particular semantic label to every pixel in an image) [45]–[49].”
BackgroundDeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 10×
“work are scaled down to 1,024 rather than 4,096 in the AlexNet [39]–[41], e.”
BackgroundMethodInfluentialSolving the multiple instance problem with axis-parallel rectangles
Dietterich, T. G., Lathrop, R. H., & Lozano-Pérez, T. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(96)00034-3 · Cited by 2,866 · cited 3×
“Multiple instance learning (MIL) [55]–[58] has been used to deal with the issue of coarse labeling by treating each image (which may contain multiple objects) as a bag of instances.”
MethodLearning to Discover Social Circles in Ego Networks
Leskovec, J., & McAuley, J. (2012) · neural information processing systems · Cited by 2,491
Conditional Random Fields as Recurrent Neural Networks
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.179 · Cited by 2,386 · cited 1×
“To extract semantic object regions from the images, we have trained a deep network in an endto-end way to enable pixel-level prediction and classification, and a CRF (conditional random fields) model [50] is further learned to merge the neighboring pixels with the same labels to generate semantic object regions [48].”
MethodHypercolumns for object segmentation and fine-grained localization
Hariharan, B., Arbelaez, P., Girshick, R., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298642 · Cited by 1,511
Network Dissection: Quantifying Interpretability of Deep Visual Representations
Bau, D., Zhou, B., Khosla, A., Oliva, A., & Torralba, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.354 · Cited by 1,389
Large-scale visual sentiment ontology and detectors using adjective noun pairs
Borth, D., Ji, R., Chen, T., Breuel, T., & Chang, S.-F. (2013) · Proceedings of the 21st ACM international conference on Multimedia · doi:10.1145/2502081.2502282 · Cited by 851
Li, L.-J., Su, H., Fei-Fei, L., & Xing, E. P. (2018) · KiltHub Repository · doi:10.1184/r1/6475985 · Cited by 827
From image-level to pixel-level labeling with Convolutional Networks
Pinheiro, P. O., & Collobert, R. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298780 · Cited by 673
Privacy wizards for social networking sites
Fang, L., & LeFevre, K. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772727 · Cited by 398 · cited 2×
“Fang and LeFevre [21] proposed a privacy wizard to”
BackgroundDeep multiple instance learning for image classification and auto-annotation
Wu, J., Yu, Y., Huang, C., & Yu, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298968 · Cited by 386
iPrivacy: Image Privacy Protection by Identifying Sensitive Objects via Deep Multi-Task Learning
Yu, J., Zhang, B., Kuang, Z., Lin, D., & Fan, J. (2017) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2636090 · Cited by 349 · cited 7×
“One major problem for the visual-based approach is its low interpret-ability [33]: (a) the hand-crafted visual features for image content representation may not have exact correlations with the image content sensitiveness; (b) the deep features may have better interpret-ability at certain levels [54], but they may not…”
BackgroundInfluentialSelf-citationTour the world: Building a web-scale landmark recognition engine
Zheng, Y.-T., Zhao, M., Song, Y., Adam, H., Buddemeier, U., Bissacco, A., Brucher, F., Chua, T.-S., & Neven, H. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206749 · Cited by 341
From Group to Individual Labels Using Deep Features
Kotzias, D., Denil, M., de Freitas, N., & Smyth, P. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783380 · Cited by 312
Characterizing privacy in online social networks
Krishnamurthy, B., & Wills, C. E. (2008) · Proceedings of the first workshop on Online social networks · doi:10.1145/1397735.1397744 · Cited by 295
Scrambling for Privacy Protection in Video Surveillance Systems
Dufaux, F., & Ebrahimi, T. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.928225 · Cited by 255 · cited 1×
“It is worth noting that the visual properties of the images are the most important resource that can be used to characterize the image content sensitiveness (privacy) [34]–[38]: (a) sharing the images with privacy-sensitive objects (persons and others such as locations) and events may result in unwanted privacy disclo…”
BackgroundLandmark classification in large-scale image collections
Li, Y., Crandall, D. J., & Huttenlocher, D. P. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459432 · Cited by 244
Fully Convolutional Multi-Class Multiple Instance Learning
Pathak, D., Shelhamer, E., Long, J., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.7144 · Cited by 236 · cited 1×
“Multiple instance learning (MIL) [55]–[58] has been used”
MethodMoving beyond untagging: photo privacy in a tagged world
Besmer, A., & Richter Lipford, H. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753560 · Cited by 232 · cited 1×
“Thus, privacy protection is a critical issue to be addressed during social image sharing [6].”
BackgroundCollocated photo sharing, story-telling, and the performance of self
Van House, N. A. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.09.003 · Cited by 195
Autotagging Facebook: Social network context improves photo annotation
Stone, Z., Zickler, T., & Darrell, T. (2008) · 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4562956 · Cited by 171
100% Accuracy in Automatic Face Recognition
Jenkins, R., & Burton, A. M. (2008) · Science · doi:10.1126/science.1149656 · Cited by 151
Hiding privacy information in video surveillance system
Zhang, W., Cheung, S.-C. S., & Chen, M. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2005.1530530 · Cited by 146
Self-citationPrivacy-aware image classification and search
Zerr, S., Siersdorfer, S., Hare, J., & Demidova, E. (2012) · Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/2348283.2348292 · Cited by 142
Third-party apps on Facebook: privacy and the illusion of control
Wang, N., Xu, H., & Großklags, J. (2011) · doi:10.1145/2076444.2076448 · Cited by 129
Weinberger, K. Q., Slaney, M., & van Zwol, R. (2008) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1459359.1459375 · Cited by 126 · cited 1×
“settings for social image sharing [8]–[10].”
P3: Toward Privacy-Preserving Photo Sharing
Ra, M.-R., Govindan, R., & Ortega, A. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.5062 · Cited by 105
CoPE: Enabling collaborative privacy management in online social networks
Squicciarini, A., Xu, H., & Zhang, X. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21473 · Cited by 102
Klemperer, P., Liang, Y., Mazurek, M. L., Sleeper, M., Ur, B., Bauer, L., Cranor, L. F., Gupta, N., & Reiter, M. K. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207728 · Cited by 99 · cited 1×
“according to the similarities (closeness) on their multi-factors for social behavior characterization [1], [16]–[25].”
BackgroundTag-based web photo retrieval improved by batch mode re-tagging
Chen, L., Xu, D., Tsang, I. W.-H., & Luo, J. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539988 · Cited by 90
Capturing Social Networking Privacy Preferences:
Ravichandran, R., Benisch, M., Kelley, P. G., & Sadeh, N. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-03168-7_1 · Cited by 79
Privacy Policy Inference of User-Uploaded Images on Content Sharing Sites
Squicciarini, A., Lin, D., Sundareswaran, S., & Wede, J. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2320729 · Cited by 77 · cited 1×
“[12], [13] have leveraged the social tags for privacy policy inference and good performances are reported.”
BackgroundSelf-citationInferring privacy policies for social networking services
Danezis, G. (2009) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/1654988.1654991 · Cited by 74
Social Circles: Tackling Privacy in Social Networks
Adu-Oppong, F., Gardiner, C. K., Kapadia, A. C., & Tsang, P. P. (2008) · Cited by 73
Motivational, Structural and Tenure Factors that Impact Online Community Photo Sharing
Nov, O., Naaman, M., & Ye, C. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13954 · Cited by 72 · cited 1×
“Because tagging rich image semantics could be a time-consuming process [7], most images may be associated with low-quality social tags (i.”
BackgroundA3P: adaptive policy prediction for shared images over popular content sharing sites
Squicciarini, A., Sundareswaran, S., Lin, D., & Wede, J. (2011) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/1995966.1996000 · Cited by 72
Self-citationPicAlert! a system for privacy-aware image classification and retrieval
Zerr, S., Siersdorfer, S., & Hare, J. S. (2012) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2396761.2398735 · Cited by 57
Personalized Privacy-aware Image Classification
Spyromitros-Xioufis, E., Papadopoulos, S., Popescu, A., & Kompatsiaris, I. Y. (2016) · International Conference on Multimedia Retrieval · doi:10.1145/2911996.2912018 · Cited by 54 · cited 3×
“…features for image content representation have strong correlations with the image content sensitiveness (privacy), the visual-based approach [27]–[32] has leveraged the hand-crafted visual features (such as SIFT (scale-invariant feature transformation) features, GIST, color histograms) to learn…”
BackgroundInfluentialProviding Access Control to Online Photo Albums Based on Tags and Linked Data
Yeung, C. M. A., Kagal, L., Gibbins, N. M., & Shadbolt, N. (2009) · Cited by 52
Monitoring and recommending privacy settings in social networks
Ghazinour, K., Matwin, S., & Sokolova, M. (2013) · EDBT/ICDT Workshops · doi:10.1145/2457317.2457344 · Cited by 49
Connecting content to community in social media via image content, user tags and user communication
Choudhury, M. D., Sundaram, H., Lin, Y., et al. (2009) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2009.5202725 · Cited by 43
Analyzing images' privacy for the modern web
Squicciarini, A., Caragea, C., & Balakavi, R. (2014) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/2631775.2631803 · Cited by 40 · cited 1×
“[29] have exploited both SIFT features and facial recognition to achieve automatic image”
MethodRavichandran, R., Benisch, M., Kelley, P. G., & Sadeh, N. (2009) · Symposium On Usable Privacy and Security · doi:10.1145/1572532.1572587 · Cited by 36
Automatic Privacy Classification of Personal Photos
Buschek, D., Bader, M., von Zezschwitz, E., & Luca, A. D. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-22668-2_33 · Cited by 34
On the need for user-defined fine-grained access control policies for social networking applications
Simpson, A. C. (2008) · doi:10.1145/1461469.1461470 · Cited by 31
Automatic Social Group Organization and Privacy Management
Squicciarini, A., Lin, D., Karumanchi, S., & DeSisto, N. G. (2012) · International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom) · doi:10.4108/icst.collaboratecom.2012.250490 · Cited by 25 · cited 1×
“[12], [13] have leveraged the social tags for privacy policy inference and good performances are reported.”
BackgroundSelf-citationI Know What You Did Last Summer: risks of location data leakage in mobile and social computing
Jędrzejczyk, Ł., Price, B. A., Bandara, A. K., & Nuseibeh, B. (2009) · Open Research Online (The Open University) · doi:10.21954/ou.ro.0001608c · Cited by 24
Towards automatic privacy management in Web 2.0 with semantic analysis on annotations
Vyas, N., Squicciarini, A., Chang, C.-C., & Yao, D. D. (2009) · International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom) · doi:10.4108/icst.collaboratecom2009.8340 · Cited by 22 · cited 3×
“Many recent works have studied how to leverage machine learning to automate the privacy setting process [11]–[38].”
BackgroundHandling Uncertain Tags in Visual Recognition
Vahdat, A., & Mori, G. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.462 · Cited by 20 · cited 2×
“settings for social image sharing [8]–[10].”
BackgroundPrivacy Prediction of Images Shared on Social Media Sites Using Deep FeaturesPreprint
Tonge, A., & Caragea, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.08583 · Cited by 9
Petkos, G., Papadopoulos, S., & Kompatsiaris, I. Y. (2015) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1145/2808797.2809303 · Cited by 9
Nakashima, Y., Babaguchi, N., & Fan, J. (2016) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2015edp7378 · Cited by 8 · cited 4×
“Many recent works have studied how to leverage machine learning to automate the privacy setting process [11]–[38].”
BackgroundInfluentialSelf-citation
Cited by
A Survey on Metaverse: Fundamentals, Security, and Privacy
Wang, Y., Su, Z., Zhang, N., Xing, R., Liu, D., Luan, T. H., & Shen, X. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3202047 · Cited by 1,575
Multi-Objective Workflow Scheduling With Deep-Q-Network-Based Multi-Agent Reinforcement Learning
Wang, Y., Liu, H., Zheng, W., Xia, Y., Li, Y., Chen, P., Guo, K., & Xie, H. (2019) · IEEE Access · doi:10.1109/access.2019.2902846 · Cited by 288
DIPA2: An Image Dataset with Cross-cultural Privacy Perception Annotations
Xu, A., Zhou, Z., Miyazaki, K., Yoshikawa, R., Hosio, S., & Yatani, K. (2023) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3631439 · Cited by 15
Metadata
- Authors
- Yu, J., Kuang, Z., Zhang, B., Zhang, W., Lin, D., & Fan, J.
- Venue
- IEEE Transactions on Information Forensics and Security
- Published
- 2018-05
- Volume
- 13
- Issue
- 5
- Pages
- 1317-1332
- ISSN
- 1556-6013 (ISSN-L)
- 1556-6021
- OpenAlex
- W2783038397
- Cited by
- 202
- References
- 67
- FWCI
- 84.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.