CoChat

Estimating peer effects in networks with peer encouragement designs

Eckles, Dean, Kizilcec, René F., Bakshy, Eytan · 2016 · Proceedings of the National Academy of Sciences
Cited by 103

The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.

Abstract

Peer effects, in which the behavior of an individual is affected by the behavior of their peers, are central to social science. Because peer effects are often confounded with homophily and common external causes, recent work has used randomized experiments to estimate effects of specific peer behaviors. These experiments have often relied on the experimenter being able to randomly modulate mechanisms by which peer behavior is transmitted to a focal individual. We describe experimental designs that instead randomly assign individuals’ peers to encouragements to behaviors that directly affect those individuals. We illustrate this method with a large peer encouragement design on Facebook for estimating the effects of receiving feedback from peers on posts shared by focal individuals. We find evidence for substantial effects of receiving marginal feedback on multiple behaviors, including giving feedback to others and continued posting. These findings provide experimental evidence for the role of behaviors directed at specific individuals in the adoption and continued use of communication technologies. In comparison, observational estimates differ substantially, both underestimating and overestimating effects, suggesting that researchers and policy makers should be cautious in relying on them.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1073/pnas.1511201113

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 42

  1. E Cohen-Cole JM Fletcher Detecting implausible social network effects in acne height and headaches: Longitudinal analysis BMJ 337:a2533. (2008). · DOI · Paper page
  2. AC Thomas, The social contagion hypothesis: Comment on ‘Social contagion theory: Examining dynamic social networks and human behavior.’. Stat Med 32, 581–590, and discussion (2013) 32(4):597–599. (2013). · DOI
  3. M McPherson, L Smith-Lovin, JM Cook, Birds of a feather: Homophily in social networks. Annu Rev Sociol 27, 415–444 (2001). · DOI · Paper page
  4. CF Manski, Economic analysis of social interactions. J Econ Perspect 14, 115–136 (2000). · DOI · Paper page
  5. EL Ogburn, TJ van der Weele, Causal diagrams for interference. Stat Sci 29, 559–578 (2014). · DOI · Paper page
  6. M Burke C Marlow T Lento Feed me: Motivating newcomer contribution in social network sites. Proceedings of the 27th International Conference on Human Factors in Computing Systems (Assoc Comput Machinery New York) pp 945–954. (2009). · DOI · Paper page
  7. J Ugander, L Backstrom, C Marlow, J Kleinberg, Structural diversity in social contagion. Proc Natl Acad Sci USA 109, 5962–5966 (2012). · DOI · Paper page
  8. AZ Jacobs SF Way J Ugander A Clauset Assembling thefacebook: Using heterogeneity to understand online social network assembly. arXiv:1503.06772. (2015). · DOI
  9. SK Shriver, HS Nair, R Hofstetter, Social ties and user-generated content: Evidence from an online social network. Manage Sci 59, 1425–1443 (2013). · DOI · Paper page
  10. C Tucker, Identifying formal and informal influence in technology adoption with network externalities. Manage Sci 54, 2024–2038 (2008). · DOI · Paper page
  11. RA Moffitt, Policy interventions, low-level equilibria, and social interactions. Social Dynamics, eds SN Durlauf, HP Young (MIT Press, Cambridge, MA), pp. 45–82 (2001). · DOI · Paper page
  12. D Walker, L Muchnik, Design of randomized experiments in networks. Proc IEEE 102, 1940–1951 (2014). · DOI
  13. E Bakshy D Eckles R Yan I Rosenn Social influence in social advertising: Evidence from field experiments. Proceedings of the 13th ACM Conference on Electronic Commerce (Assoc Comput Machinery New York) pp 146−161. (2012). · DOI · Paper page
  14. B Sacerdote, Peer effects with random assignment: Results for Dartmouth roommates. Q J Econ 116, 681–704 (2001). · DOI · Paper page
  15. SE Carrell, RL Fullerton, JE West, Does your cohort matter? Measuring peer effects in college achievement. J Labor Econ 27, 439–464 (2009). · DOI · Paper page
  16. S Aral, D Walker, Creating social contagion through viral product design: A randomized trial of peer influence in networks. Manage Sci 57, 1623–1639 (2011). · DOI · Paper page
  17. PW Holland, Causal inference and path analysis. Sociol Methodol 18, 449–484 (1988). · DOI · Paper page
  18. GA Bogatz S Ball The Second Year of Sesame Street: A Continuing Evaluation: A Report to the Children’s Television Workshop (Educ Test Serv Princeton) Vol 1. (1971).
  19. DE Powers, SS Swinton, Effects of self-study for coachable test item types. J Educ Psychol 76, 266–278 (1984). · DOI
  20. J Angrist, G Imbens, Two-stage lease squares estimation of average causal effects in models with variable treatment intensity. J Am Stat Assoc 90, 431–442 (1995). · DOI · Paper page
  21. JD Angrist, GW Imbens, DB Rubin, Identification of causal effects using instrumental variables. J Am Stat Assoc 91, 444−455 (1996).
  22. GW Imbens, Instrumental variables: An econometrician’s perspective. Stat Sci 29, 323−358 (2014). · DOI · Paper page
  23. S Athey D Eckles GW Imbens Exact p-values for network interference. arXiv:1506:02084. (2015). · DOI
  24. M Angelucci, G De Giorgi, Indirect effects of an aid program: How do cash transfers affect ineligibles’ consumption? Am Econ Rev 99, 486–508 (2009). · DOI · Paper page
  25. E Duflo, E Saez, The role of information and social interactions in retirement plan decisions: Evidence from a randomized experiment. Q J Econ 118, 815–842 (2003). · DOI · Paper page
  26. L Forastiere, F Mealli, TJ VanderWeele, Identification and estimation of causal mechanisms in clustered encouragement designs: Disentangling bed nets using Bayesian principal stratification. J Am Stat Assoc, December 22, 2015).
  27. E Miguel, M Kremer, Worms: Identifying impacts on education and health in the presence of treatment externalities. Econometrica 72, 159–217 (2004). · DOI · Paper page
  28. DW Nickerson, Is voting contagious? Evidence from two field experiments. Am Polit Sci Rev 102, 49–57 (2008). · DOI · Paper page
  29. J Cai, A De Janvry, E Sadoulet, Social networks and the decision to insure. Am Econ J Appl Econ 7, 81–108 (2012). · DOI
  30. A Coppock, A Guess, J Ternovski, When treatments are tweets: A network mobilization experiment over Twitter. Polit Behav 38, 105–128 (2016). · DOI
  31. BS Frey, R Jegen, Motivation crowding theory. J Econ Surv 15, 589–611 (2001). · DOI · Paper page
  32. DR Cox Planning of Experiments (Wiley New York). (1958).
  33. CF Manski, Identification of treatment response with social interactions. Econom J 16, S1–S23 (2013). · DOI · Paper page
  34. L Lochner, E Moretti, Estimating and testing models with many treatment levels and limited instruments. Rev Econ Stat 97, 387–397 (2015). · DOI
  35. R Tibshirani, Regression shrinkage and selection via the lasso. J R Stat Soc B 58, 267–288 (1996). · DOI · Paper page
  36. A Belloni, D Chen, V Chernozhukov, C Hansen, Sparse models and methods for optimal instruments with an application to eminent domain. Econometrica 80, 2369–2429 (2012). · DOI · Paper page
  37. PM Aronow, A Carnegie, Beyond LATE: Estimation of the average treatment effect with an instrumental variable. Polit Anal 21, 492–506 (2013). · DOI
  38. A Deaton, Instruments, randomization, and learning about development. J Econ Lit 48, 424–455 (2010). · DOI · Paper page
  39. GW Imbens, Better LATE than nothing: Some comments on Deaton (2009) and Heckman and Urzua (2009). J Econ Lit 48, 399–423 (2010). · DOI · Paper page
  40. JJ Heckman, EJ Vytlacil, Local instrumental variables and latent variable models for identifying and bounding treatment effects. Proc Natl Acad Sci USA 96, 4730–4734 (1999). · DOI · Paper page
  41. T Dunning Natural Experiments in the Social Sciences: A Design-Based Approach (Cambridge Univ Press, Cambridge, UK, 2012). · DOI · Paper page
  42. J Bound, DA Jaeger, RM Baker, Problems with instrumental variables estimation when the correlation between the instruments and the endogenous explanatory variable is weak. J Am Stat Assoc 90, 443–450 (1995).

Cited by

See all 103

Metadata

Authors
Eckles, D., Kizilcec, R. F., & Bakshy, E.
Affiliations
  • Sloan School of Management, Massachusetts Institute of Technology, Cambridge, MA 02139;
  • Facebook, Menlo Park, CA 94025;
Venue
Proceedings of the National Academy of Sciences
Published
2016-07-05
Volume
113
Issue
27
Pages
7316-7322
ISSN
  • 0027-8424
  • 1091-6490
Cited by
103
References
23
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.