Cited by 27Spam and Phishing DetectionMisinformation and Its ImpactsComplex Network Analysis Techniques

Measuring, Characterizing, and Detecting Facebook Like Farms

Ikram, Muhammad, Onwuzurike, Lucky, Farooqi, Shehroze, Cristofaro, Emiliano De, Friedman, Arik, Jourjon, Guillaume, Kaafar, Mohammed Ali, Shafiq, M. Zubair·2017·ACM Transactions on Privacy and Security

Abstract

Online social networks offer convenient ways to reach out to large audiences. In particular, Facebook pages are increasingly used by businesses, brands, and organizations to connect with multitudes of users worldwide. As the number of likes of a page has become a de-facto measure of its popularity and profitability, an underground market of services artificially inflating page likes (“like farms ”) has emerged alongside Facebook’s official targeted advertising platform. Nonetheless, besides a few media reports, there is little work that systematically analyzes Facebook pages’ promotion methods. Aiming to fill this gap, we present a honeypot-based comparative measurement study of page likes garnered via Facebook advertising and from popular like farms. First, we analyze likes based on demographic, temporal, and social characteristics and find that some farms seem to be operated by bots and do not really try to hide the nature of their operations, while others follow a stealthier approach, mimicking regular users’ behavior. Next, we look at fraud detection algorithms currently deployed by Facebook and show that they do not work well to detect stealthy farms that spread likes over longer timespans and like popular pages to mimic regular users. To overcome their limitations, we investigate the feasibility of timeline-based detection of like farm accounts, focusing on characterizing content generated by Facebook accounts on their timelines as an indicator of genuine versus fake social activity. We analyze a wide range of features extracted from timeline posts, which we group into two main categories: lexical and non-lexical. We find that like farm accounts tend to re-share content more often, use fewer words and poorer vocabulary, and more often generate duplicate comments and likes compared to normal users. Using relevant lexical and non-lexical features, we build a classifier to detect like farms accounts that achieves a precision higher than 99% and a 93% recall.

AI snapshot

Written from the paper’s full text.

TL;DR

This paper uses Facebook honeypot pages to compare likes from paid like farms versus legitimate Facebook ad campaigns, characterizing farm behavior and showing that deployed graph co-clustering detection can fail against stealthy farms. It then builds timeline-based classifiers using lexical and non-lexical features that detect like farm accounts with at least 99% precision and 93% recall across campaigns.

Key findings

  • The honeypot study collected 6,222 likes total: 4,453 from like farms and 1,769 from Facebook ads; like farms showed two main modi operandi: bot-like farms delivering likes in bursts, and stealthier farms mimicking regular users with well-connected social graphs and gradual likes.
  • Graph co-clustering detection performed poorly on the stealthiest farm: for BL-USA it achieved 47% precision, 100% recall, and 64% F1-score, while other farms ranged from 86–98% precision and 93–99% F1-score.
  • Timeline posts by like farm accounts had 43% fewer words, lower lexical richness (55% vs. 70% for baseline), lower ARI (15 vs. 20), and lower Flesch score (48 vs. 55); farm posts also attracted more comments and likes and contained more shared activity.
  • The best SVM classifier using both lexical and non-lexical features achieved 100% precision and 97% recall at best, and at least 99% precision and 93% recall across all campaigns; SVM outperformed Decision Tree, AdaBoost, kNN, Random Forest, and Naïve Bayes.

Methods

  • In March 2014, the authors created 13 empty Facebook honeypot pages described as “This is not a real page, so please do not like it”; 5 were promoted via Facebook ad campaigns and 8 via 4 like farms, with monitoring every 2 hours using Selenium and collection of liker demographics, friend lists, and page likes.
  • They later re-crawled like farm accounts and a baseline of 1,408 random accounts, collecting timelines up to 500 recent posts; the final dataset included 3,670 like farm users, more than 234K posts, and about 35K baseline posts.
  • They evaluated graph co-clustering algorithms inspired by CopyCatch and SynchroTrap, then extracted lexical and non-lexical timeline features and trained supervised two-class SVM classifiers with 80/20 train-test splits, comparing against other classifiers.

Limitations

  • The paper states that lexical analysis is limited to English and may be biased toward non-native English speakers and non-USA campaign users; it also states it lacks a larger dataset to measure false positive ratio at scale.
  • The paper states data collection was incomplete because Facebook blocked crawling accounts, some accounts became inactive or restricted timelines, and 109 users were missed; it also notes no fine-grained features to further analyze CopyCatch and SynchroTrap.
  • Evident from the text: the honeypot pages explicitly said they were not real and campaigns were designed to avert real users, so the authors caution findings do not necessarily imply Facebook advertising is ineffective; the ground truth also assumes farm likers are fake or compromised.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3121134

Cites

52 of 52 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 32 cited sources checked · 0 supported · 0 flagged

  • Findingown data
    § 1.1 Roadmap · p. 2

    Like farm accounts' posts generate significantly more comments and likes than normal users' posts.

    “Moreover, like farm accounts' posts generate significantly more comments and likes, and a much larger fraction of their posts consists of 'shared activity' (i.e., sharing posts from other users, news articles, videos, and external URLs).”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Likers from farms that like empty honeypot pages are either fake or compromised real users (fake likes).
  • Findingown data
    § 1.1 Roadmap · p. 2

    The SVM classifier achieves higher accuracy across the board than decision tree, AdaBoost, kNN, random forest, and naive Bayes.

    “Finally, we generalize our approach using other classification algorithms, namely, decision tree [7], AdaBoost [20], kNN [1], random forest [6], and na¨ ıve Bayes [55], and empirically confirm that the SVM classifier achieves higher accuracy across the board.”
    Quote in the paperNot a substantial claim
  • Findingown data
    § Abstract · p. 1

    Like farm accounts more often generate duplicate comments and likes compared to normal users.

    “We find that like farm accounts tend to re-share content more often, use fewer words and poorer vocabulary, and more often generate duplicate comments and likes compared to normal users.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Likers from farms that like empty honeypot pages are either fake or compromised real users (fake likes).
  • Findingown data
    § 1.1 Roadmap · p. 2

    Timeline posts by like farm accounts have 43% fewer words than normal users' posts.

    “In particular, we find that timeline posts by like farm accounts have 43% fewer words, a more limited vocabulary, and lower readability than normal users' posts.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Likers from farms that like empty honeypot pages are either fake or compromised real users (fake likes).
  • Findingown data
    § 2.2 Location and Demographics Analysis · p. 3

    For the first four Facebook campaigns (FB-USA, FB-FRA, FB-IND, FB-EGY), we mainly received likes from the targeted country (87-99.8%).

    “as shown in Figure 1, for the first four Facebook campaigns (FB-USA, FB-FRA, FB-IND, FB-EGY), we mainly received likes from the targeted country (87-99.8%), even though FB-USA and FB-FRA generated a number of likes much smaller than any other campaign.”
    Quote in the paperSubstantial claim
  • May combine two claims. 63
  • Classified as probably not a substantial claim. 22
  • The quote only partly states this claim. 2
  • May combine two claims.

    Findingown data
    § 2.3 Temporal Analysis · p. 4

    With AuthenticLikes, we observed likes from more than 700 profiles within the first 4 hours of the second day of data collection, and no more likes were observed later on.

    “With AuthenticLikes, we observed likes from more than 700 profiles within the first 4 hours of the second day of data collection. Interestingly, no more likes were observed later on.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § Abstract · p. 1

    A classifier using relevant lexical and non-lexical features detects like farm accounts with precision higher than 99% and recall of 93%.

    “Using relevant lexical and non-lexical features, we build a classifier to detect like farms accounts that achieves a precision higher than 99% and a 93% recall.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 2.2 Location and Demographics Analysis · p. 3

    The other three farms delivered likes complying to our requests, e.g., for US-only campaigns, the pages received a majority of likes from US profiles.

    “The other three farms delivered likes complying to our requests, e.g., for US-only campaigns, the pages received a majority of likes from US profiles.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 2.2 Location and Demographics Analysis · p. 4

    FB-IND, FB-EGY, and FB-ALL campaigns are biased toward younger users.

    “The last column reports the KLdivergence between the age distribution of the campaign users and that of the entire Facebook population, highlighting large divergence for FB-IND, FB-EGY, and FB-ALL, which are biased toward younger users.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data
    § 2.1 Datasets · p. 3

    BL-ALL and MS-ALL campaigns remained inactive, i.e., they did not result in any likes even though we were charged in advance.

    “Note that the BL-ALL and MS-ALL campaigns remained inactive, i.e., they did not result in any likes even though we were charged in advance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data
    § 2.1 Datasets · p. 3

    The largest number of likes were garnered by AL-USA, the lowest (excluding inactive campaigns) by FB-USA.

    “The largest number of likes were garnered by AL-USA, the lowest (excluding inactive campaigns) by FB-USA.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given
    § 1.1 Roadmap · p. 2

    Likers' profiles seem skewed toward males.

    “When targeting Facebook users worldwide, we obtain likes from only a few countries, and that likers' profiles seem skewed toward males.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 2.3 Temporal Analysis · p. 4

    The BoostLikes campaign targeting US users shows a temporal behavior comparable to Facebook Ads campaigns: the number of likes steadily increases during the observation period and no abrupt changes are observed.

    “On the contrary, the BoostLikes campaign targeting US users shows a different temporal behavior: the trend is actually comparable to that observed in the Facebook Ads campaigns (see Figure 2(b)). The number of likes steadily increases during the observation period and no abrupt changes are observed.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 2.2 Location and Demographics Analysis · p. 4

    The demographics of likers from SocialFormula and, to a lesser extent, AuthenticLikes and MammothSocials, are much more similar to those of the entire Facebook network, even though male users are still over-represented.

    “In contrast, the demographics of likers from SocialFormula and, to a lesser extent, AuhtenticLikes and MammothSocials, are much more similar to those of the entire network, even though male users are still over-represented.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 2.1 Datasets · p. 3

    We identify more than 6.3 million total likes by users who liked our honeypot pages and more than 1 million friendship relations.

    “Overall, we identify more than 6.3 million total likes by users who liked our honeypot pages and more than 1 million friendship relations.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 4.2 Analysis of Lexical Features · p. 10

    Baseline users and like farm users in USA (i.e., MS-USA, BL-USA, and AL-USA) mostly post in English, while users of worldwide campaigns (MS-ALL, BL-ALL, AL-ALL) have significantly fewer posts in English.

    “Figure 9 shows that the baseline users and like farm users in USA (i.e., MS-USA, BL-USA, and AL-USA) mostly post in English, while users of worldwide campaigns (MS-ALL, BL-ALL, AL-ALL) have significantly fewer posts in English.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 4.1 Analysis of Non-Lexical Features · p. 10

    Baseline users generate more original posts, and share fewer posts or links, compared to farm users.

    “Figure 8(c) shows that baseline users generate more original posts, and share fewer posts or links, compared to farm users.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.2 Experimental Evaluation of Co-Clustering · p. 9

    The graph co-clustering algorithm neatly separates users for AL-USA, but incurs false positives for other like farms.

    “While the graph co-clustering algorithm neatly separates users for AL-USA, it incurs false positives for other like farms.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 3.1 Re-Crawling · p. 8

    Overall, the paper gathered information from 600K unique pages, liked by 3,670 like farm accounts and 1,408 baseline accounts, and around 270K posts.

    “Overall, we gathered information from 600K unique pages, liked by 3,670 like farm accounts and 1,408 baseline accounts, and around 270K posts.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingcitation
    § 4.2 Analysis of Lexical Features · p. 10

    The overall performance of the 'bag-of-words' approach was poor, which can be explained with the short nature of the posts.

    “However, the overall performance of this 'bag-of-words' approach was poor, which can be explained with the short nature of the posts.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 2.6 Discussion · p. 8

    For BoostLikes, there is a high number of friends per profile and a 'reasonable' number of likes.

    “For the latter, we also observed a high number of friends per profile and a 'reasonable' number of likes.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 3.2 Experimental Evaluation of Co-Clustering · p. 9

    The co-clustering algorithm fails to achieve a good separation for BL-USA, where it incurs a large number of false positives, resulting in 47% precision.

    “In particular, the co-clustering algorithm fails to achieve a good separation for BL-USA, where it incurs a large number of false positives, resulting in 47% precision.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning
    § 2.4 Social Graph Analysis · p. 5

    The number of likers reported for each campaign in Table 3 is different from the number of campaign likes (Table 1), since some users liked more than one page.

    “Note that the number of likers reported for each campaign in Table 3 is different from the number of campaign likes (Table 1), since some users liked more than one page.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 2.4 Social Graph Analysis · p. 5

    Many likers kept their friend lists private: almost 80% of likers in the Facebook campaigns, about 75% in the BoostLikes campaign, and much less frequently for the other like farm campaigns (~40-60%).

    “Many likers kept their friend lists private: this occurred for almost 80% of likers in the Facebook campaigns, about 75% in the BoostLikes campaign, and much less frequently for the other like farm campaigns ( ∼ 40-60%).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.1 Re-Crawling · p. 8

    The paper garnered 5,918 likes from 5,616 unique users, specifically, 1,437 unique accounts from Facebook ad campaigns and 4,179 unique accounts from the like farm campaigns.

    “Recall (from Section 2) that we garnered 5,918 likes from 5,616 unique users, specifically, 1,437 unique accounts from Facebook ad campaigns and 4,179 unique accounts from the like farm campaigns (note that some users liked more than one honeypot pages).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 2.6 Discussion · p. 8

    A month after the campaigns, only one account associated with BoostLikes was terminated, as opposed to 9, 20, and 44 for the other like farms; 11 accounts from the regular Facebook campaigns were also terminated.

    “A month after the campaigns, we checked whether or not likers' accounts were still active: as shown in Table 1, only one account associated with BoostLikes was terminated, as opposed to 9, 20, and 44 for the other like farms. 11 accounts from the regular Facebook campaigns were also terminated.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data
    § 3.1 Re-Crawling · p. 8

    53% of the baseline accounts had at least 10 visible posts on the timeline, and in total about 35K posts were collected.

    “53% of the accounts had at least 10 visible posts on the timeline, and in total we collected about 35K posts.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 2.5 Page Like Analysis · p. 6

    The median page like count ranged between 600 and 1000 for users from the Facebook campaigns and between 1200 and 1800 for those from like farm campaigns, with the exception of the BL-USA campaign (median was 63).

    “The median page like count ranged between 600 and 1000 for users from the Facebook campaigns and between 1200 and 1800 for those from like farm campaigns, with the exception of the BL-USA campaign (median was 63).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 2.4 Social Graph Analysis · p. 6

    The average degree of BoostLikes accounts is 18 while other like farms have average degrees of less than 5.

    “For example, the average degree of BoostLikes accounts is 18 while other like farms have average degrees of less than 5.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.2 Experimental Evaluation of Co-Clustering · p. 9

    The paper observes two distinct behaviors in the scatter plots: 'liking everything' (vertical streaks) and 'everyone liking a particular page' (horizontal streaks). Both like farm and normal users exhibit vertical and horizontal streaks.

    “We observe two distinct behaviors in the scatter plots: (1) 'liking everything' (vertical streaks), and (2) 'everyone liking a particular page' (horizontal streaks). Both like farm and normal users exhibit vertical and horizontal streaks in the scatter plots.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 2.5 Page Like Analysis · p. 7

    The SF-USA and SF-ALL pair and the AL-USA and MS-USA pair also have relatively large Jaccard similarity.

    “In addition, the SF-USA and SF-ALL pair and the AL-USA and MS-USA pair also have relatively large Jaccard similarity.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 3.1 Re-Crawling · p. 8

    The new dataset consists of 3,670 users (out of the initial 4,179), with more than 234K posts.

    “In summary, our new dataset consists of 3,670 users (out of the initial 4,179), with more than 234K posts (messages, shared content, check-ins, etc) for these accounts.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 4.2 Analysis of Lexical Features · p. 10

    The median ratio of English posts for AL-ALL campaign is around 10% and that for SF-ALL around 15%.

    “For example, the median ratio of English posts for AL-ALL campaign is around 10% and that for SF-ALL around 15%.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 2.4 Social Graph Analysis · p. 6

    More than 25% of BoostLikes accounts make maximal cliques of size greater than 10 while less than 1% accounts of the other like farms make maximal cliques of size greater than 10.

    “Moreover, more than 25% of BoostLikes accounts make maximal cliques of size greater than 10 while less than 1% accounts of the other like farms make maximal cliques of size greater than 10.”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data
    § 5 Timeline-based Detection of Like Farms · p. 13

    The classifier achieves very high precision and recall for MS-USA, BL-USA, and AL-USA with lexical features.

    “We observe that our classifier achieves very high precision and recall for MS-USA, BL-USA, and AL-USA.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 7 Conclusion · p. 17

    Posts by like farm accounts have 43% fewer words, a more limited vocabulary, and lower readability than normal users' posts.

    “We extracted lexical and non-lexical features from user timelines, finding that posts by like farm accounts have 43% fewer words, a more limited vocabulary, and lower readability than normal users' posts.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 7 Conclusion · p. 17

    The best classifier (SVM) achieved as high as 100% precision and 97% recall, and at least 99% precision and 93% recall across all campaigns, significantly higher than graph co-clustering techniques.

    “By leveraging both lexical and non-lexical features, we experimented with several machine learning classifiers, with the best of our classifiers (SVM) achieving as high as 100% precision and 97% of recall, and at least 99% and 93% respectively across all campaigns significantly higher than graph co-clustering techniques.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 5 Timeline-based Detection of Like Farms · p. 15

    When 30% of like farm users coordinate and mimic all features of baseline users, the classifier achieves at least 73% F1-Score and at most 17% false positive ratio, a decrease of 26% F1-Score compared to the approach in Table 9.

    “When 30% of like farms users coordinate and mimic all features of baseline users, we observe that our classifier achieves at least 73% F1-Score and at most 17% false positive ratio, decreasing 26% F1-Score compared to our approach (cf. Table 9).”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Fractions of like farm users mimic all features of baseline users, and all like farm users mimic sets of baseline users' features.
    • The authors state this as an assumption: In the first scenario, sets of like farm users randomly select baseline users and aggressively replace the values of all their features with that of the selected baseline users.
  • The quote only partly states this claim.

    Findingown data
    § 5 Timeline-based Detection of Like Farms · p. 13

    The SVM classifier achieves the highest F1-Scores across all campaigns compared with Decision Tree, AdaBoost, kNN, Random Forest, and Naïve Bayes when using both lexical and non-lexical features.

    “Our results show that the SVM classifier achieves the highest F1-Scores across the board.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationown data
    § 2.2 Location and Demographics Analysis · p. 3

    The location result potentially supports the claim that like farm accounts diversify their liking activities by liking pages promoted via Facebook ads to avoid Facebook's fraud detection algorithms.

    “It also potentially supports the claim that like farm accounts diversify their liking activities by liking pages promoted via Facebook ads to avoid Facebook's fraud detection algorithms (we further explore this in section 2.5).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation
    § 1 Introduction · p. 1

    The number of likes on a Facebook page is considered a measure of its popularity.

    “At the same time, as the number of likes on a Facebook page is considered a measure of its popularity [11], an ecosystem of so-called 'like farms' has emerged that offers paid services to artificially inflate the number of likes on Facebook pages.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [11] [11] B. Carter. The Like Economy: How Businesses Make Money with Facebook . QUE Publishing, 2013. -

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 1 Introduction · p. 1

    Like farms rely on fake and compromised accounts as well as incentivized collusion networks where users are paid for actions from their account.

    “These farms rely on fake and compromised accounts as well as incentivized collusion networks where users are paid for actions from their account [50].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [50] [50] B. Viswanath, M. A. Bashir, M. Crovella, S. Guha, K. P. Gummadi, B. Krishnamurthy, and A. Mislove. Towards Detecting Anomalous User Behavior in Online Social Networks. In Usenix Security , 2014. -

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data
    § 2.2 Location and Demographics Analysis · p. 3

    The location result supports Facebook's claim that the percentage of accounts that are duplicate or false is meaningfully lower in developed markets such as the United States or United Kingdom and higher in developing markets such as India and Turkey.

    “The location result supports Facebook's claim that 'the percentage of accounts that are duplicate or false is meaningfully lower in developed markets such as the United States or United Kingdom and higher in developing markets such as India and Turkey.' 3”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [3] [3] P. R. Badri Satya, K. Lee, D. Lee, T. Tran, and J. J. Zhang. Uncovering fake likers in online social networks. In CIKM , 2016. - source

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data
    § Abstract · p. 1

    Some like farms seem to be operated by bots and do not really try to hide the nature of their operations.

    “First, we analyze likes based on demographic, temporal, and social characteristics, and find that some farms seem to be operated by bots and do not really try to hide the nature of their operations, while others follow a stealthier approach, mimicking regular users' behavior.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Likers from farms that like empty honeypot pages are either fake or compromised real users (fake likes).
  • May combine two claims.

    Interpretationown data
    § 2.6 Discussion · p. 8

    Other farms, like BoostLikes, follow a much stealthier approach, aiming to mimic regular users' behavior, and rely on their large and well-connected network structure to disseminate the target likes while keeping a small count of likes per user.

    “(2) other farms, like BoostLikes, follow a much stealthier approach, aiming to mimic regular users' behavior, and rely on their large and wellconnected network structure to disseminate the target likes while keeping a small count of likes per user.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data
    § 2.4 Social Graph Analysis · p. 5

    Dense friendship relations among BoostLikes likers indicate an interconnected network of either real users or fake users who mimic complex ties to pose as real users.

    “Dense relations between likers from BoostLikes point to an interconnected network of real users, or fake users who mimic complex ties to pose as real users;”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation
    § 1.1 Roadmap · p. 2

    SynchroTrap relies on the fact that malicious accounts usually perform loosely synchronized actions in a variety of social network context, and can cluster malicious accounts that act similarly at around the same time for a sustained period of time.

    “Another one, SynchroTrap, relies on the fact that malicious accounts usually perform loosely synchronized actions in a variety of social network context, and can cluster malicious accounts that act similarly at around the same time for a sustained period of time [10].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [10] [10] Q. Cao, X. Yang, J. Yu, and C. Palow. Uncovering Large Groups of Active Malicious Accounts in Online Social Networks. In CCS , 2014. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given
    § 3.1 Re-Crawling · p. 8

    All data was encrypted at rest and has not been redistributed.

    “Also, all data was encrypted at rest and has not been redistributed.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § 3.2 Experimental Evaluation of Co-Clustering · p. 9

    Stealthy like farms, such as BL-USA, use the tactic of liking popular pages aiming to mimic normal users, which reduces the accuracy of the graph co-clustering algorithm.

    “We deduce that stealthy like farms, such as BL-USA, use the tactic of liking popular pages aiming to mimic normal users, which reduces the accuracy of the graph co-clustering algorithm.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § 2.4 Social Graph Analysis · p. 5

    The pairs and occasionally triplets characterizing SocialFormula likers might indicate a different strategy of constructing fake networks, mitigating the risk that identification of a user as fake would bring down the whole connected network of fake users.

    “The pairs (and occasionally triplets) that characterize SocialFormula likers might indicate a different strategy of constructing fake networks, mitigating the risk that identification of a user as fake would consequently bring down the whole connected network of fake users;”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given
    § 3.1 Re-Crawling · p. 8

    Data61's legal team classified the research as exempt and the ethics committee of UCL approved it.

    “We also consulted Data61's legal team, which classified our research as exempt and likewise, received approval from the ethics committee of UCL.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data
    § 2.6 Discussion · p. 8

    The accounts' termination might be indicative of the disposable nature of fake accounts on most like farms, where 'bot-like' patterns are actually easy to detect.

    “Although occurring not so frequently, the accounts' termination might be indicative of the disposable nature of fake accounts on most like farms, where 'bot-like' patterns are actually easy to detect.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data
    § 2.6 Discussion · p. 8

    Most fake likes exhibit some peculiar characteristics - including demographics, likes, temporal and social graph patterns - that can and should be exploited by like fraud detection algorithms.

    “We also show that most fake likes exhibit some peculiar characteristics - including demographics, likes, temporal and social graph patterns - that can and should be exploited by like fraud detection algorithms.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data
    § 2.6 Discussion · p. 8

    Some farms, like SocialFormula and AuthenticLikes, seem to be operated by bots and do not really try to hide the nature of their operations, as demonstrated by large bursts of likes and the limited number of friends per profile.

    “Overall, we identified two main modi operandi : (1) some farms, like SocialFormula and AuthenticLikes, seem to be operated by bots and do not really try to hide the nature of their operations, as demonstrated by large bursts of likes and the limited number of friends per profile;”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationown data
    § 2.4 Social Graph Analysis · p. 5

    Friendship relations between AuthenticLikes and MammothSocials likers might indicate that the same operator manages both services.

    “The friendship relations between AuthenticLikes and MammothSocials likers might indicate that the same operator manages both services.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3.2 Experimental Evaluation of Co-Clustering · p. 9

    The clusters identified in the user-page bipartite graph represent near-bipartite cores, and the set of users in a near-bipartite core like the same set of pages.

    “Similar to CopyCatch [4] and SynchroTrap [10], the clusters identified in the user-page bipartite graph represent near-bipartite cores, and the set of users in a near-bipartite core like the same set of pages.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [4] [4] A. Beutel, W. Xu, V. Guruswami, C. Palow, and C. Faloutsos. CopyCatch: Stopping Group Attacks by Spotting Lockstep Behavior in Social Networks. In WWW , 2013. - source

      Not checked in the free run.

    • cites [10] [10] Q. Cao, X. Yang, J. Yu, and C. Palow. Uncovering Large Groups of Active Malicious Accounts in Online Social Networks. In CCS , 2014. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 1.1 Roadmap · p. 2

    Facebook reports that 'false' accounts are less prevalent in developed markets and more in developing markets.

    “The other three target one developed and two developing countries, as Facebook reports that 'false' accounts are less prevalent in developed markets and more in developing markets. 1”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [1] [1] A. Andoni and P. Indyk. Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. Communications of the ACM , 2008. - source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data
    § 3.1 Re-Crawling · p. 8

    Besides some accounts having become inactive (376), the paper could not crawl the timeline of 24 users who had restricted visibility, and in Fall 2015 Facebook blocked all crawling accounts, so they missed further 109 users.

    “Besides some accounts having become inactive (376), we also could not crawl the timeline of 24 users who had restricted the visibility of their timeline. Moreover, in Fall 2015, Facebook blocked all the accounts we were using for crawling, and so we stopped our data collection before we could completely finish our data collection, hence, we missed further 109 users.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given
    § 2.5 Page Like Analysis · p. 6

    These users like a large number of pages because they are probably reused for multiple 'jobs' and also like 'normal' pages to mimic real users.

    “We argue that these users like a large number of pages because they are probably reused for multiple 'jobs' and also like 'normal' pages to mimic real users.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data
    § 3.1 Re-Crawling · p. 8

    The paper collected openly available data such as public profile and timeline information, as well as page likes.

    “Again, note that we collected openly available data such as (public) profile and timeline information, as well as page likes.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § 2.6 Discussion · p. 8

    Like farms such as BoostLikes exhibit patterns closely resembling real users' behavior, thus making fake like detection quite difficult.

    “It also mirrors the challenge Facebook is confronted by, with like farms such as BoostLikes that exhibit patterns closely resembling real users' behavior, thus making fake like detection quite difficult.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductown data
    § 3.2 Experimental Evaluation of Co-Clustering · p. 9

    The crawlers were restricted to crawl the behavior of all like farms and baseline users on daily basis, so the paper does not have fine-grained features to further analyze CopyCatch and SynchroTrap.

    “Given that our crawlers were restricted to crawl the behavior of all like farms and baseline users on daily basis, we do not have fine-grained features to further analyze CopyCatch and SynchroTrap.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data
    § 3 Limitations of Graph Co-Clustering Techniques · p. 8

    Some stealthy like farms seem to deliberately modify their behavior in order to avoid synchronized patterns, which might reduce the effectiveness of these detection tools.

    “However, as shown in Section 2, some stealthy like farms seem to deliberately modify their behavior in order to avoid synchronized patterns, which might reduce the effectiveness of these detection tools.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation
    § 1.1 Roadmap · p. 2

    CopyCatch detects lockstep page like patterns by analyzing the social graph between users and pages, and the times at which the edges in the graph are created.

    “One currently deployed tool is CopyCatch, which detects lockstep page like patterns by analyzing the social graph between users and pages, and the times at which the edges in the graph are created [4].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [4] [4] A. Beutel, W. Xu, V. Guruswami, C. Palow, and C. Faloutsos. CopyCatch: Stopping Group Attacks by Spotting Lockstep Behavior in Social Networks. In WWW , 2013. - source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductreasoning
    § 4.2 Analysis of Lexical Features · p. 10

    The analysis is limited to English-only content and may be statistically biased toward non-native English speakers, i.e., non-USA campaign users.

    “We acknowledge that our analysis is limited to English-only content and may be statistically biased toward non-native English speakers i.e., nonUSA campaign users.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § 4.1 Analysis of Non-Lexical Features · p. 10

    Posts produced by like farm users gather more likes and have lower lexical richness, which might indicate their attempt to mask suspicious activities.

    “Therefore, posts produced by the former gather more likes (and also have lower lexical richness as shown later on in Table 6), which might actually indicate their attempt to mask suspicious activities.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning
    § 3.1 Re-Crawling · p. 8

    No personal information was extracted as only aggregated statistics were analyzed.

    “No personal information was extracted as we only analyzed aggregated statistics.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation
    § 3.1 Re-Crawling · p. 8

    The experiments rely on a baseline of 1,408 random accounts from Chen et al. [14] used to form a baseline of 'normal' accounts.

    “In our experiments, we will also rely on a baseline of 1,408 random accounts from Chen et al. [14] which we use to form a baseline of 'normal' accounts.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [14] [14] T. Chen, A. Chaabane, P. U. Tournoux, M.-A. Kaafar, and R. Boreli. How Much is too Much? Leveraging Ads Audience Estimation to Evaluate Public Profile Uniqueness. In PETS , 2013. - source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § 3 Limitations of Graph Co-Clustering Techniques · p. 8

    While several farms use a large number of accounts (possibly fake or compromised) liking target pages within a short timespan, some spread likes over longer timespans and onto popular pages aiming to circumvent fraud detection algorithms.

    “Specifically, while several farms use a large number of accounts (possibly fake or compromised) liking target pages within a short timespan, some spread likes over longer timespans and onto popular pages aiming to circumvent fraud detection algorithms.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning
    § 2.4 Social Graph Analysis · p. 5

    Some friendship relations may be hidden, e.g., if a friend chose to be invisible in friend lists, thus, these numbers only represent a lower bound.

    “Some friendship relations may be hidden, e.g., if a friend chose to be invisible in friend lists, thus, these numbers only represent a lower bound .”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data
    § 2.6 Discussion · p. 8

    The paper provides strong evidence that likers attracted on honeypot pages, even when using legitimate Facebook campaigns, are significantly different from typical Facebook users, which confirms concerns about the genuineness of these likes.

    “However, we do provide strong evidence that likers attracted on our honeypot pages, even when using legitimate Facebook campaigns, are significantly different from typical Facebook users, which confirms the concerns about the genuineness of these likes.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning
    § 6 Related Work · p. 17

    The paper uses timeline features, relying on both lexical and non-lexical features, to build a classifier that detects stealthy like farm users with high accuracy.

    “As a result, we use timeline features, relying on both lexical and non-lexical features to build a classifier that detects stealthy like farm users with high accuracy.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data
    § 7 Conclusion · p. 17

    The paper's analysis revealed two main modi operandi: some farms seem to be operated by bots and do not really try to hide their operations, while others follow a stealthier approach, mimicking regular users' behavior.

    “Our demographic, temporal, and social graph analysis highlighted similar patterns between accounts across different like farms and revealed two main modi operandi: some farms seem to be operated by bots and do not really try to hide the nature of their operations, while others follow a stealthier approach, mimicking regular users' behavior.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data
    § 5 Timeline-based Detection of Like Farms · p. 14

    Like farm users use shorter words and fewer words in their timeline posts than baseline users.

    “This finding suggests that like farm users use shorter words and fewer number of words in their timeline posts as compared to baseline users.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data
    § 6 Related Work · p. 17

    While some farms seem to be operated by bots and do not try to hide their activities, other stealthier farms exhibit behavior that may be challenging to detect with tools like CopyCatch and SynchroTrap.

    “However, as discussed earlier, while some farms seem to be operated by bots (producing large bursts of likes and having limited numbers of friends) that do not really try to hide their activities, other stealthier farms exhibit behavior that may be challenging to detect with tools like CopyCatch and SynchroTrap.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given
    § 6 Related Work · p. 16

    Twitter follower markets differ from Facebook like farms because Twitter entails a follower-followee relationship while Facebook friendships are bidirectional, and there is no equivalent of liking a Facebook page in the Twitter ecosystem.

    “Note that Twitter follower markets differ from Facebook like farms as Twitter entails a follower-followee relationship among users, while Facebook friendships imply a bidirectional relationships. Also, there is no equivalent of liking a Facebook page in the Twitter ecosystem.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § 6 Related Work · p. 17

    The paper's work can complement other methods used in prior work to detect fake and compromised accounts, such as unsupervised anomaly detection, temporal features, IP addresses, and generic supervised learning.

    “Finally, we highlight that our work can complement other methods used in prior work to detect fake and compromised accounts, such as using unsupervised anomaly detection techniques [50], temporal features [23, 24], IP addresses [45], as well as generic supervised learning [3].”
    Quote in the paperNot a substantial claim0 of 4 sources checked
    • cites [50] [50] B. Viswanath, M. A. Bashir, M. Crovella, S. Guha, K. P. Gummadi, B. Krishnamurthy, and A. Mislove. Towards Detecting Anomalous User Behavior in Online Social Networks. In Usenix Security , 2014. -

      Not checked in the free run.

    • cites [23] [23] M. Jiang, P. Cui, A. Beutel, C. Faloutsos, and S. Yang. CatchSync: Catching Synchronized Behavior in Large Directed Graphs. In KDD , 2014. - source

      Not checked in the free run.

    • cites [24] [24] M. Jiang, P. Cui, A. Beutel, C. Faloutsos, and S. Yang. Inferring Strange Behavior from Connectivity Pattern in Social Networks. In PAKDD , 2014. - source

      Not checked in the free run.

    • cites [45] [45] G. Stringhini, P. Mourlanne, G. Jacob, M. Egele, C. Kruegel, and G. Vigna. EvilCohort: Detecting Communities of Malicious Accounts on Online Services. In Usenix Security , 2015. -

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data
    § 4.2 Analysis of Lexical Features · p. 10

    Normal users use a richer vocabulary and their posts have higher readability than like farm users.

    “In comparison to like farm users, baseline users post text with higher lexical richness (70% vs. 55%), ARI (20 vs. 15), and Flesch score (55 vs. 48), thus suggesting that normal users use a richer vocabulary and that their posts have higher readability.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data
    § 6 Related Work · p. 15

    The paper's analysis confirms some insights used by sybil detection algorithms and reveals new patterns that could complement them.

    “In fact, our analysis does not only confirm a few insights used by sybil detection algorithms but also reveals new patterns that could complement them.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductnone given
    § 6 Related Work · p. 15

    The paper's honeypot pages explicitly indicated they were not 'real' to deflect real profiles, and actively attracted fake profiles by means of paid campaigns, as opposed to passive honeypot profiles.

    “Our work also differs from theirs in that (1) their honeypot profiles were designed to look legitimate, while our honeypot pages explicitly indicated they were not 'real' (to deflect real profiles), and (2) our honeypot pages actively attracted fake profiles by means of paid campaigns, as opposed to passive honeypot profiles.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Study design and conductnone given
    § 5 Timeline-based Detection of Like Farms · p. 13

    Lexical features may be affected by geographical location especially if one set of users who write in English are native speakers while the other set is not.

    “While building a classifier based on lexical features performs very well in detecting fake accounts, we acknowledge that lexical features may be affected by geographical location especially if one set of users who write in English are native speakers while the other set is not.”
    Quote in the paperNot a substantial claim
76 of 76
  • The paper relies on this without support.

    There has been little work that systematically analyzes and compares Facebook page promotion methods.

    “However, even though the understanding of fake likes is crucial to improve fraud mitigation in social networks, there has been little work to systematically analyze and compare Facebook page promotion methods.”
  • The authors state this as an assumption.

    Likers from farms that like empty honeypot pages are either fake or compromised real users (fake likes).

    “we start our study with the assumption that likers from farms that like our empty honeypot pages are either fake or compromised real users (i.e., fake likes) as shown in [50].”
  • The authors state this as an assumption.

    Selling likes may yield significant profits for fraudsters.

    “it is not far fetched to assume that selling likes may yield significant profits for fraudsters.”
  • The paper relies on this without support.

    Like farms typically rely on pre-defined lists of comments, resulting in word repetition and lower lexical richness.

    “Like farms typically rely on pre-defined lists of comments, resulting in word repetition and lower lexical richness.”
  • The paper relies on this without support.

    Like farms either heavily automate mechanisms or rely on manual input of cheap human labor.

    “However, like farms either heavily automate mechanisms or rely on manual input of cheap human labor.”
  • The authors state this as an assumption.

    Fractions of like farm users mimic all features of baseline users, and all like farm users mimic sets of baseline users' features.

    “we assume two worst case attacking scenarios: (i) fractions of like farms users mimic all features of baseline users; and (ii) all like farm users mimic sets of baseline users' features”
  • The authors state this as an assumption.

    In the first scenario, sets of like farm users randomly select baseline users and aggressively replace the values of all their features with that of the selected baseline users.

    “We simulate the first scenario by assuming that sets of like farm users randomly select baseline users and aggressively replace the values of all their features with that of the selected baseline users.”
  • The authors state this as an assumption.

    In the latter case, all like farm users coordinate and select sets of features from randomly selected baseline users that they copy or mimic.

    “For the latter case, we assume that all like farms users coordinate and select sets of features from randomly selected baseline users that they copy or mimic.”
8 of 8

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Malicious actors continuously evolve their behaviors to evade platform detection.

    “malicious actors continuously evolve their behaviors to evade platform detection [40, 58]”

    From Six Million (Suspected) Fake Stars on GitHub: A Growing Spiral of Popularity Contests, Spams, and Malware (2026) · cites this paper as [58]

    The Roadmap (p. 2) says stealthier like farms circumvent detection by spreading likes over longer periods and mimicking normal users. Timeline-based Detection (p. 15) describes evasion as an arms race, but the paper does not establish that malicious actors generally or continuously evolve their behavior over time. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • Some providers generate fake popularity signals using automated bots, while others use realistic accounts and even crowdsourced real humans.

    “some providers generate fake popularity signals using automated bots (aka. sybils), but some others use realistic accounts and even crowdsourced real humans (aka. crowdturfing) [58, 83, 84, 93, 100].”
  • Facebook Like farms are still able to maneuver through detection techniques by mimicking realistic user activities and violating the techniques' built-in assumptions.

    “Ikram et al. [58] show that the Facebook Like farms are still able to maneuver through these techniques by mimicking realistic user activities and violating the techniques' built-in assumptions (e.g., assuming that fake Likes happen in bursts [30]).”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • AL-USA non-lexical recall is miscalculated

    Major

    Table 7's 113 true positives and four false negatives give approximately 97% recall, rather than 69%.

    Reported 69 · recomputed 96.581197

  • BL-USA non-lexical recall is miscalculated

    Major

    With 37 true positives and 12 false negatives, recall is about 76%, not the reported 32%.

    Reported 32 · recomputed 75.510204

  • SF-USA non-lexical precision is miscalculated

    Major

    Table 7's 110 true positives and 21 false positives give approximately 84% precision, rather than 96%.

    Reported 96 · recomputed 83.969466

  • AL-USA non-lexical precision is miscalculated

    Major

    Table 7's 113 true positives and 51 false positives give approximately 69% precision, rather than 97%.

    Reported 97 · recomputed 68.902439

  • SF-ALL non-lexical precision is miscalculated

    Major

    Table 7's 139 true positives and 35 false positives give approximately 80% precision, rather than 94%.

    Reported 94 · recomputed 79.885057

  • Conflicting totals for the original honeypot campaigns

    Major

    Section 2 reports 6,222 likes from the campaigns, but Section 3 says those campaigns garnered 5,918 likes. The latter is presented as a recap of the original measurement, not as the result of the later re-crawl.

  • BL-USA non-lexical precision is miscalculated

    Major

    Table 7 reports 37 true positives and 80 false positives. Under the paper's stated definition, precision is 37/(37+80), or about 32%, not 76%.

    Reported 76 · recomputed 31.623932

  • English-post ratio has two different denominators

    Minor

    The method defines the ratio as English posts divided by all posts, whereas the figure caption calls it English posts divided by non-English posts. Those are different quantities.

  • Posts attributed to inactive worldwide campaigns

    Minor

    The language analysis refers to users of MS-ALL and BL-ALL, although the campaign summary says neither campaign produced any likes.

  • Reported minimum F1-score decrease omits a 20% result

    Minor

    The text says the eight-feature attack reduces F1-score by 26% to 56%, but Table 11 gives a 20% decrease for AL-USA.

10 of 10

Cites

Flagged first, then by citations

1 of the 53 references couldn’t be matched to a known paper.

Research works printed but not linked: 12

  1. Buitinck Lars, 2013, Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases Workshop (ECML/PKDD LML’13)
  2. 10.5555/2228298.2228319 · DOI
  3. Chaabane A., 2012, Proceedings of the 19th Annual Network and Distributed System Security Symposium (NDSS’12)
  4. Danezis George, 2009, Proceedings of the 16th Annual Network and Distributed System Security Symposium (NDSS’09)
  5. Kohavi Ron, 1995, Proceedings of the 1st International Conference on Knowledge Discovery and Data Mining (KDD’95)
  6. Metzger Richard, 2012, Facebook: I Want My Friends Back.
  7. Nazir Atif, 2010, Proceedings of the 3rd Wonference on Online Social Networks (WOSN’10)
  8. Silberztein Max, Proceedings of the LITP Spring School on Theoretical Computer Science: Electronic Dictionaries and Automata in Computational Linguistics
  9. Thomas Kurt, 2013, Proceedings of the 22nd USENIX Conference on Security (SEC’13)
  10. Viswanath Bimal, 2014, Proceedings of the 23rd USENIX Security Symposium (USENIX Security’14)
  11. Wang Gang, Proceedings of the 23rd USENIX Security Symposium (USENIX Security’14)
  12. Zhang Harry, 2004, Proceedings of the Seventeenth International Florida Artificial Intelligence Research Society Conference (FLAIRS’04)

Cited by

Sorted by citations

Authors
Ikram, M., Onwuzurike, L., Farooqi, S., Cristofaro, E. D., Friedman, A., Jourjon, G., Kaafar, M. A., & Shafiq, M. Z.
Affiliations
  • Commonwealth Scientific and Industrial Research Organisation (AU)
  • University College London (GB)
  • University of Iowa (US)
  • Atlassian (United Kingdom) (GB)
  • Data61-CSIRO
Venue
ACM Transactions on Privacy and Security
Published
2017-09-20
Volume
20
Issue
4
Pages
1-28
ISSN
  • 2471-2566 (ISSN-L)
  • 2471-2574
OpenAlex
W2727710601
Cited by
27
References
53
Citations by year
2026: 2 · 2025: 2 · 2024: 3 · 2023: 3 · 2021: 3 · 2020: 7 · 2019: 5 · 2018: 2
FWCI
7.15
Type
journal article
Language
en
Open access
closed
Locations
ACM Transactions on Privacy and Security (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
Keywords
Facebook, fake accounts, honeypots, lexical features, bot detection, social media marketing, targeted advertising, user-generated content

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review