The Virtual Focus Group: A Modern Methodology for Facial Attractiveness Rating
Abstract
BACKGROUND: Traditional focus groups have been essential to facial aesthetics research. Although they are currently the criterion standard in acquiring facial attractiveness ratings, they retain many shortcomings. This study's objectives were twofold: to determine whether attractiveness scores obtained from a social network site correlate with those from the traditional focus group method; and to evaluate whether this methodology could be a superior tool in evaluating facial attractiveness. METHODS: Forty facial portraits were rated for attractiveness scores using three different subject recruitment methods: traditional live focus groups (n = 123 raters), Internet-based rating (n = 857 raters), and a novel method using a combination of focus groups and a social network site (i.e., Facebook) (n = 1775 raters). Each facial image was scored on a 10-point Likert scale. Regression analysis compared each approach to the traditional method. RESULTS: The methods varied in terms of data accrual time, rater demographics/ages, researcher's accessibility, necessity for subject incentives, researcher labor, and rater effort/accuracy. A strong correlation (0.922) existed between the online social network-based rating and focus group method. A minimum of 992 raters achieved stabilization of the attractiveness scores using social network-based rating. CONCLUSIONS: This study shows significant advantages to using a social network site-based method over both Internet-based rating and traditional focus groups for evaluating facial attractiveness. The main benefits include exponential increase in raters, minimized researcher time/labor, rater scores comparable to those of the focus group method, nonnecessity of rater monetary incentives, and selectable demographics/ages of raters.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Some studies have documented the advantages and comparability of in-person and virtual focus group data.
“Although virtual focus groups are a relatively new methodology, some studies have documented their advantages and the comparability of in-person and virtual focus group data.[24–28]”
From Perceived healthcare provider reactions to patient and caregiver use of online health communities (2014) · cites this paper as [27]
Cites
Facial attractiveness: evolutionary based research
Little, A. C., Jones, B. C., & DeBruine, L. M. (2011) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2010.0404 · Cited by 1,017 · see citing works
Thornhill, R., & Gangestad, S. W. (1993) · Human Nature · doi:10.1007/bf02692201 · Cited by 612 · see citing works
Bilateral Symmetry and Sexual Selection: A Meta‐Analysis
Møller, A. P., & Thornhill, R. (1998) · The American Naturalist · doi:10.1086/286110 · Cited by 441 · see citing works
Sexual strategies theory: historical origins and current status
Buss, D. M. (1998) · The Journal of Sex Research · doi:10.1080/00224499809551914 · Cited by 354 · see citing works
History and Current Concepts in the Analysis of Facial Attractiveness
Bashour, M. (2006) · Plastic & Reconstructive Surgery · doi:10.1097/01.prs.0000233051.61512.65 · Cited by 226 · see citing works
ALE meta-analysis on facial judgments of trustworthiness and attractiveness
Bzdok, D., Langner, R., Caspers, S., Kurth, F., Habel, U., Zilles, K., Laird, A., & Eickhoff, S. B. (2011) · Brain Structure and Function · doi:10.1007/s00429-010-0287-4 · Cited by 183 · see citing works
The evolution of human mating.
Buss, D. M. (2007) · Acta Psychologica Sinica · Cited by 168 · see citing works
Rhodes, G., Yoshikawa, S., Palermo, R., Simmons, L. W., Peters, M., Lee, K., Halberstadt, J. B., & Crawford, J. R. (2007) · Perception · doi:10.1068/p5712 · Cited by 167 · see citing works
Proper methodologies for psychological and sociological studies conducted via the Internet
Hewson, C. M., Laurent, D., & Vogel, C. M. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204763 · Cited by 163 · see citing works
Lip Colour Affects Perceived Sex Typicality and Attractiveness of Human Faces
Stephen, I. D., & McKeegan, A. M. (2010) · Perception · doi:10.1068/p6730 · Cited by 140 · see citing works
A Statistical Model of Facial Attractiveness
Said, C. P., & Todorov, A. T. (2011) · Psychological Science · doi:10.1177/0956797611419169 · Cited by 137 · see citing works
Averageness or symmetry: Which is more important for facial attractiveness?
Komori, M., Kawamura, S., & Ishihara, S. (2009) · Acta Psychologica · doi:10.1016/j.actpsy.2009.03.008 · Cited by 132 · see citing works
An Objective System for Measuring Facial Attractiveness
Bashour, M. (2006) · Plastic & Reconstructive Surgery · doi:10.1097/01.prs.0000207382.60636.1c · Cited by 126 · see citing works
An Investigation of Changes in Body Image following Cosmetic Surgery
Sarwer, D. B., Wadden, T. A., & Whitáker, L. A. (2002) · Plastic & Reconstructive Surgery · doi:10.1097/00006534-200201000-00060 · Cited by 102 · see citing works
Influence of panel composition on aesthetic evaluation of adolescent faces
Kiekens, R. M. A., Hof, M. V. '., Straatman, H., Kuijpers‐Jagtman, A. M., & Maltha, J. C. (2007) · European Journal of Orthodontics · doi:10.1093/ejo/cjl060 · Cited by 50 · see citing works
Faces differing in attractiveness elicit corresponding affective responses
Principe, C. P., & Langlois, J. H. (2010) · Cognition & Emotion · doi:10.1080/02699931003612098 · Cited by 40 · see citing works
Wong, B. J. F., Karimi, K., Devcic, Z., McLaren, C. E., & Chen, W. (2008) · The Laryngoscope · doi:10.1097/mlg.0b013e31816bf545 · Cited by 33 · see citing works
Self-citationJohnston, V. S., Solomon, C. J., Gibson, S. J., & Pallares-Bejarano, A. (2003) · Archives of Facial Plastic Surgery · doi:10.1001/archfaci.5.5.371 · Cited by 29 · see citing works
A web‐based method for rating facial attractiveness
Devcic, Z., Karimi, K., Popenko, N. A., & Wong, B. J. F. (2010) · The Laryngoscope · doi:10.1002/lary.20857 · Cited by 17 · see citing works
Self-citationLimitations of traditional morphometrics in research on the attractiveness of faces
Holland, E. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.3.613 · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Recruiting for health, medical or psychosocial research using Facebook: Systematic review
Thornton, L., Batterham, P. J., Fassnacht, D. B., Kay-Lambkin, F., Calear, A. L., & Hunt, S. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.02.001 · Cited by 326 · see citing works
Virtual Versus In-Person Focus Groups: Comparison of Costs, Recruitment, and Participant Logistics
Rupert, D. J., Poehlman, J. A., Hayes, J. J., Ray, S. E., & Moultrie, R. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6980 · Cited by 168 · see citing works
Perceived healthcare provider reactions to patient and caregiver use of online health communities
Rupert, D. J., Moultrie, R. R., Read, J. G., Amoozegar, J. B., Bornkessel, A. S., O’Donoghue, A. C., & Sullivan, H. W. (2014) · Patient Education and Counseling · doi:10.1016/j.pec.2014.05.015 · Cited by 149 · see citing works
Popenko, N. A., Tripathi, P. B., Devcic, Z., Karimi, K., Osann, K., & Wong, B. J. F. (2017) · JAMA Facial Plastic Surgery · doi:10.1001/jamafacial.2016.2049 · Cited by 105 · see citing works
Self-citationA cross-sectional study of the presence of United Kingdom (UK) plastic surgeons on social media
Mabvuure, N. T., Rodrigues, J. N., Klimach, S. G., & Nduka, C. C. (2014) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2013.12.015 · Cited by 59 · see citing works
Akard, T. F., Wray, S., & Gilmer, M. J. (2014) · Cancer Nursing · doi:10.1097/ncc.0000000000000146 · Cited by 53 · see citing works
Rupert, D. J., Gard, J. C., Amoozegar, J. B., Moultrie, R., Taylor, O. M., O’Donoghue, A. C., & Sullivan, H. W. (2016) · Journal of Health Communication · doi:10.1080/10810730.2016.1237592 · Cited by 53 · see citing works
Evaluation of Migraine Surgery Outcomes through Social Media
Egan, K. G., Israel, J. S., Ghasemzadeh, R., & Afifi, A. M. (2016) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000001084 · Cited by 31 · see citing works
Ahmed, O., Dhinsa, A., Popenko, N. A., Osann, K., Crumley, R. L., & Wong, B. J. F. (2014) · JAMA Facial Plastic Surgery · doi:10.1001/jamafacial.2014.228 · Cited by 22 · see citing works
Self-citationAssociation of Frontal and Lateral Facial Attractiveness
Gu, J. T., Avilla, D., Devcic, Z., Karimi, K., & Wong, B. J. F. (2017) · JAMA Facial Plastic Surgery · doi:10.1001/jamafacial.2017.0710 · Cited by 15 · see citing works
Self-citationArtificial Intelligence Versus Human Focus Group Rating of Facial Attractiveness
Goshtasbi, K., Hakimi, A. A., & Wong, B. J. F. (2024) · Facial Plastic Surgery & Aesthetic Medicine · doi:10.1089/fpsam.2023.0281 · Cited by 10 · see citing works
Self-citationTakehara, T., Kaigawa, M., Kobayashi, A., & Yamaguchi, Y. (2023) · Discover Psychology · doi:10.1007/s44202-023-00066-6 · Cited by 7 · see citing works
Morphometric facial analysis: a methodology to create lateral facial images
Karimi, K., Devcic, Z., Popenko, N. A., Oyoyo, U. E., & Wong, B. J. F. (2015) · Oral and Maxillofacial Surgery · doi:10.1007/s10006-015-0512-7 · Cited by 3 · see citing works
Self-citationEvidence-Based Medicine: Rhinoplasty Surgical Outcomes
Kimura, K. S., & Most, S. P. (2023) · Facial Plastic Surgery · doi:10.1055/a-2034-8162
- Authors
- Popenko, N. A., Devcic, Z., Karimi, K., & Wong, B. J. F.
- Affiliations
- University of California, Irvine (US)
- Venue
- Plastic & Reconstructive Surgery
- Published
- 2012-09
- Volume
- 130
- Issue
- 3
- Pages
- 455e-461e
- ISSN
- 0032-1052 (ISSN-L)
- OpenAlex
- W2001957271
- Cited by
- 14
- References
- 20
- Citations by year
- 2024: 1 · 2023: 2 · 2017: 3 · 2016: 3 · 2015: 1 · 2014: 4
- FWCI
- 5.26
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Plastic & Reconstructive Surgery (publishedVersion)
- PubMed (publishedVersion)
- Funders
- University of California, Irvine
- Topics
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- facial attractiveness, facial aesthetics, social network sites, Facebook, focus groups
- MeSH terms
- Adolescent, Adult, Esthetics, Face, Female, Humans, Regression Analysis, Focus Groups, Internet, Young Adult, Social Networking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review