The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Vulnerabilities to Online Social Network Identity Deception Detection Research and Recommendations for Mitigation
Open accessAbstract
Identity deception in online social networks is a pervasive problem. Ongoing research is developing methods for identity deception detection. However, the real-world efficacy of these methods is currently unknown because they have been evaluated largely through laboratory experiments. We present a review of representative state-of-the-art results on identity deception detection. Based on this analysis, we identify common methodological weaknesses for these approaches, and we propose recommendations that can increase their effectiveness for when they are applied in real-world environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Ismailov et al. (2020) assert that the techniques used to detect bots depend on the social platform and the objective.”
From Fake news, disinformation and misinformation in social media: a review (2023) · cites this paper as Ismailov et al. 2020
The cited source says what the claim attributes to it.
In the citing paper
“Social context models achieve detection by examining features related to an account’s social presence including features such as relationships to other accounts, similarities to other users’ behaviors, and a variety of graph-based features.”
From Fake news, disinformation and misinformation in social media: a review (2023) · cites this paper as Ismailov et al. 2020
The cited source says what the claim attributes to it.
In the citing paper
“User behavior models primarily focus on features related to an individual user’s behavior, such as frequency of activities (e.g., number of tweets or posts per time interval), patterns of activity and clickstream sequences.”
From Fake news, disinformation and misinformation in social media: a review (2023) · cites this paper as Ismailov et al. 2020
The cited source says what the claim attributes to it.
In the citing paper
“They note that a malicious bot designed to make friends with as many accounts as possible will require a different detection approach than a bot designed to repeatedly post links to malicious websites.”
From Fake news, disinformation and misinformation in social media: a review (2023) · cites this paper as Ismailov et al. 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Review on Evaluation Metrics for Data Classification Evaluations
M, H., & M.N, S. (2015) · International Journal of Data Mining & Knowledge Management Process · doi:10.5121/ijdkp.2015.5201 · Cited by 2,693 · cited 1×
“The predominant metrics that are used in the literature for identity deception detection relate to binary classification and are precision, recall, and F 1 score [32].”
BackgroundOutside the Closed World: On Using Machine Learning for Network Intrusion Detection
Sommer, R., & Paxson, V. (2010) · 2010 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2010.25 · Cited by 2,085
Social Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · National Bureau of Economic Research · doi:10.3386/w23089 · Cited by 608
Aiding the detection of fake accounts in large scale social online services
Cao, Q., Sirivianos, M., Yang, X., & Pregueiro, T. (2012) · Networked Systems Design and Implementation · Cited by 561
Fame for sale: Efficient detection of fake Twitter followers
Cresci, S., Di Pietro, R., Petrocchi, M., Spognardi, A., & Tesconi, M. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.09.003 · Cited by 475 · cited 3×
“An example of this is using finite measures of activity (e.g., edits on Wikipedia [17] or number of Twitter followers [33]) without incorporating a measure of time for these metrics.”
BackgroundMethodBadawy, A., Ferrara, E., & Lerman, K. (2018) · 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam.2018.8508646 · Cited by 353
An analysis of social network-based Sybil defenses
Viswanath, B., Post, A., Gummadi, K. P., & Mislove, A. (2010) · Proceedings of the ACM SIGCOMM 2010 conference · doi:10.1145/1851182.1851226 · Cited by 304
Yang, C., Harkreader, R., Zhang, J., Shin, S., & Gu, G. (2012) · Proceedings of the 21st international conference on World Wide Web · doi:10.1145/2187836.2187847 · Cited by 299
Uncovering Large Groups of Active Malicious Accounts in Online Social Networks
Cao, Q., Yang, X., Yu, J., & Palow, C. (2014) · Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2660267.2660269 · Cited by 274 · cited 3×
“User behavior models primarily focus on features that relate to an individual user’s behavior, such as frequency of activities (e.g., number of tweets or posts per time interval), patterns of activity, and clickstream sequences [3,6–8, 21, 22, 27 ].”
BackgroundMethodDetecting spammers on social networks
Zheng, X., Zeng, Z., Chen, Z., Yu, Y., & Rong, C. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.02.047 · Cited by 256
External Validity, Generalizability, and Knowledge Utilization
Ferguson, L. (2004) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2004.04006.x · Cited by 249
Fostering public trust in science: The role of social media
Huber, B., Barnidge, M., Gil de Zúñiga, H., & Liu, J. (2019) · Public Understanding of Science · doi:10.1177/0963662519869097 · Cited by 231 · cited 1×
“Subverting the trust that an individual has in the information that is being presented to him/her can have far-reaching effects on an individual’s relationship with true information and the factors of his/her decision-making process [11,12].”
BackgroundStein, T., Chen, E., & Mangla, K. (2011) · Proceedings of the 4th Workshop on Social Network Systems · doi:10.1145/1989656.1989664 · Cited by 219
Spreading (Dis)Trust: Covid-19 Misinformation and Government Intervention in Italy
Lovari, A. (2020) · Media and Communication · doi:10.17645/mac.v8i2.3219 · Cited by 181
Handling big data: research challenges and future directions
Anagnostopoulos, I. E., Zeadally, S., & Expósito, E. (2016) · The Journal of Supercomputing · doi:10.1007/s11227-016-1677-z · Cited by 177
Self-citationAn analysis of social network-based Sybil defenses
Viswanath, B., Post, A., Gummadi, K. P., & Mislove, A. (2010) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1851275.1851226 · Cited by 161
Profiling Online Social Behaviors for Compromised Account Detection
Ruan, X., Wu, Z., Wang, H., & Jajodia, S. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2482465 · Cited by 138
Online deception in social media
Tsikerdekis, M., & Zeadally, S. (2014) · Communications of the ACM · doi:10.1145/2629612 · Cited by 124
Self-citationMultiple Account Identity Deception Detection in Social Media Using Nonverbal Behavior
Tsikerdekis, M., & Zeadally, S. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2332820 · Cited by 108
Self-citationWang, B., Gong, N. Z., & Fu, H. (2017) · Proceedings · doi:10.1109/icdm.2017.56 · Cited by 107
Securing Internet of Things (IoT) with machine learning
Zeadally, S., & Tsikerdekis, M. (2019) · International Journal of Communication Systems · doi:10.1002/dac.4169 · Cited by 100
Self-citationIntervention Research: Designing, Conducting, Analyzing, and Funding
Melnyk, B. M., Morrison-Beedy, D., Melnyk, B. M., Morrison-Beedy, D., Fleury, J., Sidani, S., Melnyk, B. M., Morrison-Beedy, D., Moore, S. M., Menon, U., et al. (2012) · Springer Publishing Company eBooks · doi:10.1891/9780826109583 · Cited by 86
Detecting Malicious Social Bots Based on Clickstream Sequences
Shi, P., Zhang, Z., & Choo, K.-K. R. (2019) · IEEE Access · doi:10.1109/access.2019.2901864 · Cited by 72
On the capability of evolved spambots to evade detection via genetic engineering
Cresci, S., Petrocchi, M., Spognardi, A., & Tognazzi, S. (2018) · Online Social Networks and Media · doi:10.1016/j.osnem.2018.10.005 · Cited by 61
A Graph-Based Machine Learning Approach for Bot DetectionPreprint
Daya, A. A., Salahuddin, M. A., Limam, N., & Boutaba, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.08538 · Cited by 49
Applied Network Security Monitoring: Collection, Detection, and Analysis
Sanders, C., & Smith, J. (2013) · Cited by 45
Detecting and Preventing Online Identity Deception in Social Networking Services
Tsikerdekis, M., & Zeadally, S. (2015) · IEEE Internet Computing · doi:10.1109/mic.2015.21 · Cited by 24
Self-citationDetection of Multiple Identity Manipulation in Collaborative Projects
Yamak, Z., Saunier, J., & Vercouter, L. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872518.2890586 · Cited by 24
Identity Deception Prevention Using Common Contribution Network Data
Tsikerdekis, M. (2016) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2607697 · Cited by 23
Self-citationThe Early (tweet-ing) Bird Spreads the Worm: An Assessment of Twitter for Malware Propagation
Sanzgiri, A., Joyce, J., & Upadhyaya, S. (2012) · Procedia Computer Science · doi:10.1016/j.procs.2012.06.090 · Cited by 22
Twitter spam account detection by effective labeling
Concone, F., Re, G. L., Morana, M., & Ruocco, C. (2019) · Nova Science Publishers (Nova Science Publishers, Inc.) · Cited by 10
Bot Detection: Will Focusing on Recall Cause Overall Performance Deterioration?
Nazer, T. H., Davis, M., Karami, M., Akoglu, L., Koelle, D. M., & Liu, H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21741-9_5 · Cited by 6
Minimizing Threats to External Validity
Nicholson, W. K. (2012) · Intervention Research · doi:10.1891/9780826109583.0007 · Cited by 3
Cited by
Fake news, disinformation and misinformation in social media: a review
Aïmeur, E., Amri, S., & Brassard, G. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01028-5 · Cited by 772
Metadata
- Authors
- Ismailov, M., Tsikerdekis, M., & Zeadally, S.
- Affiliations
- Western Washington University (US)
- University of Kentucky (US)
- Corresponding author
- Tsikerdekis, Michail
- Venue
- Future Internet
- Publisher
- MDPI AG
- Published
- 2020-08-31
- Volume
- 12
- Issue
- 9
- Pages
- 148
- ISSN
- 1999-5903 (ISSN-L)
- OpenAlex
- W3082641322
- Cited by
- 6
- References
- 33
- Citations by year
- 2024: 1 · 2023: 1 · 2022: 3 · 2021: 1
- FWCI
- 1.18
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Future Internet (publishedVersion, cc-by)
- UKnowledge (University of Kentucky) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
- Keywords
- social networking sites, fake accounts, methodological weaknesses, real-world evaluation, mitigation recommendations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.