Introducing and Testing the Creepiness of Situation Scale (CRoSS)
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
When people interact with novel technologies (e.g., robots, novel technological tools), the word “creepy” regularly pops up. We define creepy situations as ambiguous situations involving uneasy feelings as eliciting uneasy feelings and involving ambiguity (e.g., on how the behave or how to judge the situation). A common metric for creepiness would help evaluating creepiness of situations and developing adequate interventions against creepiness. Following psychometrical guidelines, we developed the Creepiness of Situation Scale (CRoSS) across four studies with a total of N = 882 American and German participants. In Studies 1-3, participants watched a video of a creepy situation involving technology. Study 1 used exploratory factor analysis in an American sample and showed that creepiness consists of emotional creepiness and creepy ambiguity. In a German sample, Study 2 confirmed these subdimensions. Study 3 supported validity of the CRoSS as creepiness correlated positively with privacy concerns and computer anxiety, but negatively with controllability and transparency. Study 4 used the scale in a 2 (male vs. female experimenter) x 2 (male vs. female participant) x 2 (day vs. night) field study to demonstrate its usefulness for non-technological settings and its sensitivity to theory-based predictions. Results indicate that participants contacted by an experimenter at night-time reported higher feelings of creepiness. Overall, these studies suggest that the CRoSS is a psychometrically sound measure for research and practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615
The application of electronic computers to factor analysis
Kaiser, H. F. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000116 · Cited by 12,459
Evaluating the use of exploratory factor analysis in psychological research.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.272 · Cited by 9,587
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 1×
“For the entire scale we found a good reliability (cf., Cortina, 1993) of Cronbach’s α = 0.90 (emotional creepiness Cronbach’s α = 0.87; creepy ambiguity Cronbach’s α = 0.89).”
InfluentialEstimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Perceived Behavioral Control, Self‐Efficacy, Locus of Control, and the Theory of Planned Behavior 1
Ajzen, I. (2002) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2002.tb00236.x · Cited by 7,629
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“Trust is required in uncertain situations (i.e., because it is unclear if a system will fulfill its job adequately), and affective impressions seem to be especially important in the formation of trust (Lee and See, 2004).”
BackgroundA Brief Tutorial on the Development of Measures for Use in Survey Questionnaires
Hinkin, T. R. (1998) · Organizational Research Methods · doi:10.1177/109442819800100106 · Cited by 4,095
Internet Users' Information Privacy Concerns (IUIPC): The Construct, the Scale, and a Causal Model
Malhotra, N. K., Kim, S. S., & Agarwal, J. (2004) · Information Systems Research · doi:10.1287/isre.1040.0032 · Cited by 3,173 · cited 1×
“This can detrimentally affect important organizational outcomes such as, applicant reactions, provision of personal information, and online sales revenue (Phelps et al., 2000; Malhotra et al., 2004; Bauer et al., 2006; Shin, 2010).”
BackgroundTrust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Construction and Evaluation of a User Experience Questionnaire
Laugwitz, B., Held, T., & Schrepp, M. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-89350-9_6 · Cited by 2,114
Information Privacy Research: an Interdisciplinary Review1
Smith, H. J., Dinev, T., & Xu, H. (2011) · MIS Quarterly · doi:10.2307/41409970 · Cited by 2,013 · cited 4×
“Privacy concerns are an important variable to measure feelings of privacy invasion through novel technologies (Smith et al., 2011).”
BackgroundInfluentialSex differences in emotion: Expression, experience, and physiology.
Kring, A. M., & Gordon, A. H. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.3.686 · Cited by 1,067 · cited 1×
“Since females tend to be more emotionally expressive (Kring and Gordon, 1998), it might have been more unfamiliar for participants to be contacted by a female experimenter who did not smile as opposed to a non-smiling male experimenter, thus leading to higher feelings of creepiness.”
BackgroundPrivacy Concerns and Consumer Willingness to Provide Personal Information
Phelps, J., Nowak, G., & Ferrell, E. (2000) · Journal of Public Policy & Marketing · doi:10.1509/jppm.19.1.27.16941 · Cited by 1,027
Virtual reality exposure therapy for anxiety disorders: A meta-analysis
Powers, M. B., & Emmelkamp, P. M. G. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2007.04.006 · Cited by 904
Kätsyri, J., Förger, K., Mäkäräinen, M., & Takala, T. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00390 · Cited by 500
Computer anxiety and its correlates: a meta-analysis
Chua, S. L., Chen, D.-T., & Wong, A. F. L. (1999) · Computers in Human Behavior · doi:10.1016/s0747-5632(99)00039-4 · Cited by 477
Saygin, A. P., Chaminade, T., Ishiguro, H., Driver, J., & Frith, C. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr025 · Cited by 452
Craig, T. K., Rus-Calafell, M., Ward, T., Leff, J. P., Huckvale, M., Howarth, E., Emsley, R., & Garety, P. A. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30427-3 · Cited by 403 · cited 1×
“…there are virtual characters instructing people how to adapt their non-verbal behavior in social situations (Langer et al., 2016), computer avatars are used for therapy of psychological disorders (e.g., schizophrenia; Craig et al., 2018), and algorithms decide who you could date next (Toma, 2015).”
BackgroundLanger, M., König, C. J., & Fitili, A. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2017.11.036 · Cited by 119
Self-citationTinwell, A. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02774-1_67 · Cited by 27 · cited 1×
“Within this field, scholars and practitioners (Seyama and Nagayama, 2007; Walters et al., 2008; Tinwell, 2009; Ho and MacDorman, 2010; Saygin et al., 2012; Kätsyri et al., 2015) extensively debate the phenomenon of the uncanny valley (Mori, 1970; Mori et al., 2012), which describes feelings toward…”
Background
Cited by
Hyun Baek, T., & Kim, M. (2023) · Telematics and Informatics · doi:10.1016/j.tele.2023.102030 · Cited by 319
Creepiness: Its antecedents and impact on loyalty when interacting with a chatbot
Rajaobelina, L., Prom Tep, S., Arcand, M., & Ricard, L. (2021) · Psychology & Marketing · doi:10.1002/mar.21548 · Cited by 252
Highly automated job interviews: Acceptance under the influence of stakes
Langer, M., König, C. J., & Papathanasiou, M. (2019) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12246 · Cited by 203
“This hy‐ pothesis suggests that acceptance of virtual character rises as they become more human‐like up to a certain point where acceptance rapidly drops—this drop in acceptance is associated with negative feelings that constitute the uncanny valley (Langer & König, 2018).”
InfluentialSelf-citationPolyportis, A. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1324398 · Cited by 111
“Emotional creepiness, a relatively unexplored yet impactful factor (Langer and König, 2018; Rajaobelina et al., 2021), brings to the forefront the affective responses that can significantly deter or encourage technology adoption, particularly in AI where human-like interactions are prevalent.”
BackgroundMethodInfluentialCreepy vs. cool: Switching from human staff to service robots in the hospitality industry
Kang, S.-E., Koo, C., & Chung, N. (2023) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2023.103479 · Cited by 96
Metadata
- Authors
- Langer, M., & König, C. J.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2018-11-16
- Volume
- 9
- Pages
- 2220-2220
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2901066322
- Cited by
- 91
- References
- 22
- FWCI
- 3.54
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.