Recruiting Hard-to-Reach Populations for Survey Research: Using Facebook and Instagram Advertisements and In-Person Intercept in LGBT Bars and Nightclubs to Recruit LGBT Young Adults
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Tobacco public education campaigns focus increasingly on hard-to-reach populations at higher risk for smoking, prompting campaign creators and evaluators to develop strategies to reach hard-to-reach populations in virtual and physical spaces where they spend time. OBJECTIVE: The aim of this study was to describe two novel recruitment strategies (in-person intercept interviews in lesbian, gay, bisexual, and transgender [LGBT] social venues and targeted social media ads) and compares characteristics of participants recruited via these strategies for the US Food and Drug Administration's This Free Life campaign evaluation targeting LGBT young adults who smoke cigarettes occasionally. METHODS: We recruited LGBT adults aged 18-24 years in the United States via Facebook and Instagram ads (N=1709, mean age 20.94, SD 1.94) or intercept in LGBT social venues (N=2348, mean age 21.98, SD 1.69) for the baseline evaluation survey. Covariates related to recruitment strategy were age; race or ethnicity; LGBT identity; education; pride event attendance; and alcohol, cigarette, and social media use. RESULTS: Lesbian or gay women (adjusted odds ratio, AOR 1.88, 95% CI 1.54-2.29, P<.001), bisexual men and women (AOR 1.46, 95% CI 1.17-1.82, P=.001), gender minorities (AOR 1.68, 95% CI 1.26-2.25, P<.001), and other sexual minorities (AOR 2.48, 95% CI 1.62-3.80, P<.001) were more likely than gay men to be recruited via social media (than intercept). Hispanic (AOR 0.73, 95% CI 0.61-0.89, P=.001) and other or multiracial, non-Hispanic participants (AOR 0.70, 95% CI 0.54-0.90, P=.006) were less likely than white, non-Hispanic participants to be recruited via social media. As age increased, odds of recruitment via social media decreased (AOR 0.76, 95% CI 0.72-0.80, P<.001). Participants with some college education (AOR 1.27, 95% CI 1.03-1.56, P=.03) were more likely than those with a college degree to be recruited via social media. Participants reporting past 30-day alcohol use were less likely to be recruited via social media (AOR 0.33, 95% CI 0.24-0.44, P<.001). Participants who reported past-year pride event attendance were more likely to be recruited via social media (AOR 1.31, 95% CI 1.06-1.64, P=.02), as well as those who used Facebook at least once daily (AOR 1.43, 95% CI 1.14-1.80, P=.002). Participants who reported using Instagram at least once daily were less likely to be recruited via social media (AOR 0.73, 95% CI 0.62-0.86, P<.001). Social media recruitment was faster (incidence rate ratio, IRR=3.31, 95% CI 3.11-3.52, P<.001) and less expensive (2.2% of combined social media and intercept recruitment cost) but had greater data quality issues-a larger percentage of social media respondents were lost because of duplicate and low-quality responses (374/4446, 8.41%) compared with intercept respondents lost to interviewer misrepresentation (15/4446, 0.34%; P<.001). CONCLUSIONS: Social media combined with intercept provided access to important LGBT subpopulations (eg, gender and other sexual minorities) and a more diverse sample. Social media methods have more data quality issues but are faster and less expensive than intercept. Recruiting hard-to-reach populations via audience-tailored strategies enabled recruitment of one of the largest LGBT young adult samples, suggesting these methods' promise for accessing hard-to-reach populations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P. (2004) · American Psychologist · doi:10.1037/0003-066x.59.2.93 · Cited by 2,932 · cited 1×
“This finding is promising for social media recruitment as a data collection method—previous research has shown that collecting data entirely via the Web leads to lower levels of participant accountability, which results from higher levels of psychological distance between researcher and participant in Web-based studie…”
MethodRamo, D. E., & Prochaska, J. J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1878 · Cited by 404
Cited by
Hoyt, L. T., Cohen, A. K., Dull, B., Maker Castro, E., & Yazdani, N. (2021) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2020.10.030 · Cited by 337
Ensuring survey research data integrity in the era of internet bots
Griffin, M., Martino, R. J., LoSchiavo, C., Comer-Carruthers, C., Krause, K. D., Stults, C. B., & Halkitis, P. N. (2022) · Quality & Quantity · doi:10.1007/s11135-021-01252-1 · Cited by 314
Cohen, A. K., Hoyt, L. T., & Dull, B. (2020) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2020.06.009 · Cited by 203
Watson, N. L., Mull, K. E., Heffner, J. L., McClure, J. B., & Bricker, J. B. (2018) · Journal of Medical Internet Research · doi:10.2196/10351 · Cited by 118
Primack, B. A., & Escobar-Viera, C. G. (2017) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2016.12.007 · Cited by 71
Metadata
- Authors
- Guillory, J., Wiant, K. F., Farrelly, M., Fiacco, L., Alam, I., Hoffman, L., Crankshaw, E., Delahanty, J., & Alexander, T. N.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2018-06-18
- Volume
- 20
- Issue
- 6
- Pages
- e197
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2809562162
- Cited by
- 184
- References
- 3
- FWCI
- 13.96
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.