When both the original study and its failed replication are correct: Feeling observed eliminates the facial-feedback effect.
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
This article suggests a theoretically driven explanation for a replication failure of one of the basic findings in psychology: the facial-feedback effect. According to the facial-feedback hypothesis, the facial activity associated with particular emotional expressions can influence people's affective experiences. Recently, a replication attempt of this effect in 17 laboratories around the world failed to find any support for the effect. We hypothesize that the reason for the failure of replication is that the replication protocol deviated from that of the original experiment in a critical factor. In all of the replication studies, participants were alerted that they would be monitored by a video camera, whereas the participants in the original study were not monitored, observed, or recorded. Previous findings indicate that feeling monitored or observed reduces reliance on internal cues in making judgments. Therefore, we hypothesize that recording the participants in the replication experiments reduced their reliance on the facial-feedback. To test the hypothesis, we replicated the facial-feedback experiment in 2 conditions: one with a video-camera and one without it. The results revealed a significant facial-feedback effect in the absence of a camera, which was eliminated in the camera's presence. These findings suggest that minute differences in the experimental protocol might lead to theoretically meaningful changes in the outcomes. In our view, the theoretical and methodological approach advocated by our study changes failed replications from being the "end of the road" regarding entire fields of study into a new road for growth regarding our understanding of human nature. (PsycINFO Database Record
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Conditions for intuitive expertise: A failure to disagree.
Kahneman, D., & Klein, G. (2009) · American Psychologist · doi:10.1037/a0016755 · Cited by 2,443
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Using Bayes to get the most out of non-significant results
Dienes, Z. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00781 · Cited by 1,998
Strack, F., Martin, L. L., & Stepper, S. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.5.768 · Cited by 1,898
Krämer (2008) · doi:10.1027/1864-1105.20.3.106 · Cited by 883
Point of view in personal memories
Nigro, G., & Neisser, U. (1983) · Cognitive Psychology · doi:10.1016/0010-0285(83)90016-6 · Cited by 827
Contextual sensitivity in scientific reproducibility
Van Bavel, J. J., Mende-Siedlecki, P., Brady, W. J., & Reinero, D. A. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521897113 · Cited by 398
How we see ourselves and how we see others
Pronin, E. (2008) · Science · doi:10.1126/science.1154199 · Cited by 353
Questionable Research Practices Revisited
Fiedler, K., & Schwarz, N. (2016) · Social Psychological and Personality Science · doi:10.1177/1948550615612150 · Cited by 279
Registered Replication Report: Schooler and Engstler-Schooler (1990)
Alogna, V. K., Attaya, M. K., Aucoin, P., Bahník, Š., Birch, S., Birt, A. R., Bornstein, B. H., Bouwmeester, S., Brandimonte, M. A., Brown, C., et al. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614545653 · Cited by 223
Public and private self-awareness: When personal attitudes conflict with societal expectations
Froming, W. J., Walker, G. R., & Lopyan, K. J. (1982) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(82)90067-1 · Cited by 178
Cited by
Replicability, Robustness, and Reproducibility in Psychological Science
Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., et al. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-114157 · Cited by 770
Are Manipulation Checks Necessary?
Hauser, D. J., Ellsworth, P. C., & Gonzalez, R. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00998 · Cited by 480
Walton, G. M., & Yeager, D. S. (2020) · Current Directions in Psychological Science · doi:10.1177/0963721420904453 · Cited by 298
“Typically, these debates have centered on laboratory experiments and the quality of the manipulation or procedures (e.g., Noah et al., 2018).”
BackgroundImproving Methodological Standards in Behavioral Interventions for Cognitive Enhancement
Shawn Green, C., Bavelier, D., Kramer, A. F., Vinogradov, S., Ansorge, U., Ball, K. K., Bingel, U., Chein, J. M., Colzato, L. S., Edwards, J. D., et al. (2019) · Journal of Cognitive Enhancement · doi:10.1007/s41465-018-0115-y · Cited by 235
“While one could argue that the attempted replications were framed as being direct replications, changes were made to the original procedures that may have substantively altered the results (e.g., the presence of video recording equipment; Noah et al. 2018).”
MethodNinaus, M., Greipl, S., Kiili, K., Lindstedt, A., Huber, S., Klein, E., Karnath, H.-O., & Moeller, K. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.103641 · Cited by 189
Metadata
- Authors
- Noah, T., Schul, Y., & Mayo, R.
- Venue
- Journal of Personality and Social Psychology
- Published
- 2018-05
- Volume
- 114
- Issue
- 5
- Pages
- 657-664
- ISSN
- 0022-3514 (ISSN-L)
- 1939-1315
- OpenAlex
- W2799327013
- Cited by
- 109
- References
- 13
- FWCI
- 8.30
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.