The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Assessing respondent-driven sampling
Open accessAbstract
Respondent-driven sampling (RDS) is a network-based technique for estimating traits in hard-to-reach populations, for example, the prevalence of HIV among drug injectors. In recent years RDS has been used in more than 120 studies in more than 20 countries and by leading public health organizations, including the Centers for Disease Control and Prevention in the United States. Despite the widespread use and growing popularity of RDS, there has been little empirical validation of the methodology. Here we investigate the performance of RDS by simulating sampling from 85 known, network populations. Across a variety of traits we find that RDS is substantially less accurate than generally acknowledged and that reported RDS confidence intervals are misleadingly narrow. Moreover, because we model a best-case scenario in which the theoretical RDS sampling assumptions hold exactly, it is unlikely that RDS performs any better in practice than in our simulations. Notably, the poor performance of RDS is driven not by the bias but by the high variance of estimates, a possibility that had been largely overlooked in the RDS literature. Given the consistency of our results across networks and our generous sampling conditions, we conclude that RDS as currently practiced may not be suitable for key aspects of public health surveillance where it is now extensively applied.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Respondent-Driven Sampling: A New Approach to the Study of Hidden Populations
Heckathorn, D. D. (1997) · Social Problems · doi:10.1525/sp.1997.44.2.03x0221m · Cited by 4,409
5. Sampling and Estimation in Hidden Populations Using Respondent-Driven Sampling
Salganik, M. J., & Heckathorn, D. D. (2004) · Sociological Methodology · doi:10.1111/j.0081-1750.2004.00152.x · Cited by 1,953
Self-citationHeckathorn, D. D. (2002) · Social Problems · doi:10.1525/sp.2002.49.1.11 · Cited by 1,878
Race, School Integration, and Friendship Segregation in America
Moody, J. (2001) · American Journal of Sociology · doi:10.1086/338954 · Cited by 1,342
Review of sampling hard-to-reach and hidden populations for HIV surveillance
Magnani, R., Sabin, K., Saidel, T., & Heckathorn, D. (2005) · AIDS · doi:10.1097/01.aids.0000172879.20628.e1 · Cited by 1,043
Goodreau, S. M., Kitts, J. A., & Morris, M. (2009) · Demography · doi:10.1353/dem.0.0045 · Cited by 774
Probability based estimation theory for respondent driven sampling
Volz, E., & Heckathorn, D. D. (2008) · Journal of Official Statistics · Cited by 667
7. Respondent-Driven Sampling: An Assessment of Current Methodology
Gile, K. J., & Handcock, M. S. (2010) · Sociological Methodology · doi:10.1111/j.1467-9531.2010.01223.x · Cited by 613
Comparing Two Methods for Estimating Network Size
McCarty, C., Killworth, P. D., Bernard, H. R., Johnsen, E. C., & Shelley, G. A. (2001) · Human Organization · doi:10.17730/humo.60.1.efx5t9gjtgmga73y · Cited by 506
Kalton, G., & Anderson, D. W. (1986) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981886 · Cited by 477
Malekinejad, M., Johnston, L. G., Kendall, C., Kerr, L. R. F. S., Rifkin, M. R., & Rutherford, G. W. (2008) · AIDS and Behavior · doi:10.1007/s10461-008-9421-1 · Cited by 433 · cited 4×
“The remaining parameters of our simulations are modeled after common RDS study features (5).”
BackgroundMethodInfluentialVariance Estimation, Design Effects, and Sample Size Calculations for Respondent-Driven Sampling
Salganik, M. J. (2006) · Journal of Urban Health · doi:10.1007/s11524-006-9106-x · Cited by 424
Self-citationHeckathorn, D. D. (2007) · Sociological Methodology · doi:10.1111/j.1467-9531.2007.00188.x · Cited by 413
Social networks and infectious disease: The Colorado Springs study
Klovdahl, A. S., Potterat, J. J., Woodhouse, D. E., Muth, J. B., Muth, S. Q., & Darrow, W. W. (1994) · Social Science & Medicine · doi:10.1016/0277-9536(94)90302-6 · Cited by 387
Kendall, C., Kerr, L. R. F. S., Gondim, R. C., Werneck, G. L., Macena, R. H. M., Pontes, M. K., Johnston, L. G., Sabin, K., & McFarland, W. (2008) · AIDS and Behavior · doi:10.1007/s10461-008-9390-4 · Cited by 263
Johnston, L. G., Malekinejad, M., Kendall, C., Iuppa, I. M., & Rutherford, G. W. (2008) · AIDS and Behavior · doi:10.1007/s10461-008-9413-1 · Cited by 252
Wejnert, C., & Heckathorn, D. D. (2008) · Sociological Methods & Research · doi:10.1177/0049124108318333 · Cited by 242
Ramirez-Valles, J., Heckathorn, D. D., Vázquez, R., Diaz, R. M., & Campbell, R. T. (2005) · AIDS and Behavior · doi:10.1007/s10461-005-9012-3 · Cited by 240
Abdul‐Quader, A. S., Heckathorn, D. D., McKnight, C., Bramson, H., Nemeth, C., Sabin, K., Gallagher, K., & Des Jarlais, D. C. (2006) · Journal of Urban Health · doi:10.1007/s11524-006-9052-7 · Cited by 237
How Many People Do You Know?: Efficiently Estimating Personal Network Size
McCormick, T. H., Salganik, M. J., & Zheng, T. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap08518 · Cited by 235
Self-citationZheng, T., Salganik, M. J., & Gelman, A. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001168 · Cited by 216
Self-citationMa, X., Zhang, Q., He, X., Sun, W., Yue, H., Chen, S., Raymond, H. F., Li, Y., Xu, M., Du, H., et al. (2007) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0b013e31811eadbc · Cited by 213
Respondent‐driven sampling as Markov chain Monte Carlo
Goel, S., & Salganik, M. J. (2009) · Statistics in Medicine · doi:10.1002/sim.3613 · Cited by 203
Self-citationWejnert, C. (2009) · Sociological Methodology · doi:10.1111/j.1467-9531.2009.01216.x · Cited by 195
Lansky, A., Abdul-Quader, A. S., Cribbin, M., Hall, T., Finlayson, T. J., Garfein, R. S., Lin, L. S., & Sullivan, P. S. (2007) · Public Health Reports® · doi:10.1177/00333549071220s108 · Cited by 170
Mapping a social network of heterosexuals at high risk for HIV infection
Woodhouse, D. E., Rothenberg, R. B., Potterat, J. J., Darrow, W. W., Muth, S. Q., Klovdahl, A. S., Zimmerman, H. P., Rogers, H. L., Maldonado, T. S., Muth, J. B., et al. (1994) · AIDS · doi:10.1097/00002030-199409000-00018 · Cited by 140
Frost, S. D. W., Brouwer, K. C., Cruz, M. A. F., Ramos, R. L., Ramos, M. E., Lozada, R. M., Magis-Rodríguez, C. L., & Strathdee, S. A. (2006) · Journal of Urban Health · doi:10.1007/s11524-006-9104-z · Cited by 138
Platt, L., Wall, M., Rhodes, T., Judd, A., Hickman, M., Johnston, L. G., Renton, A. M., Bobrova, N., & Sarang, A. (2006) · Journal of Urban Health · doi:10.1007/s11524-006-9101-2 · Cited by 132
Adaptive sampling in research on risk-related behaviors
Thompson, S. K., & Collins, L. M. (2002) · Drug and Alcohol Dependence · doi:10.1016/s0376-8716(02)00215-6 · Cited by 130
Community structure and ethnic preferences in school friendship networks
González, M. C., Herrmann, H. J., Kertész, J., & Vicsek, T. (2007) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2007.01.002 · Cited by 123
Robinson, W. T., Risser, J., McGoy, S. L., Becker, A., Rehman, H., Jefferson, M., Griffin, V., Wolverton, M. L., & Tortu, S. (2006) · Journal of Urban Health · doi:10.1007/s11524-006-9100-3 · Cited by 121
Friedman, S. R., Kottiri, B. J., Neaigus, A., Curtis, R., Vermund, S. H., & Jarlais, D. C. D. (2000) · American Journal of Epidemiology · doi:10.1093/aje/152.10.913 · Cited by 114
Johnston, L. G., Khanam, R., Reza, M., Khan, S. I., Banu, S., Alam, M. S., Rahman, M., & Azim, T. (2007) · AIDS and Behavior · doi:10.1007/s10461-007-9300-1 · Cited by 106
Scott, G. (2008) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2007.11.014 · Cited by 83
Social Networks in Disease Transmission: The Colorado Springs Study
ROTHENBERG, R. B., Woodhouse, D. E., Potterat, J. J., et al. (1995) · PsycEXTRA Dataset · doi:10.1037/e495782006-003 · Cited by 80
Abramovitz, D. A., Volz, E., Strathdee, S. A., Patterson, T. L., Vera, A., & Frost, S. D. W. (2009) · Sexually Transmitted Diseases · doi:10.1097/olq.0b013e3181b0f311 · Cited by 77
(2009) · PsycEXTRA Dataset · doi:10.1037/e537712009-001 · Cited by 59
Burt, R. D., Hagan, H., Sabin, K. M., & Thiede, H. (2010) · Annals of Epidemiology · doi:10.1016/j.annepidem.2009.10.002 · Cited by 58
de Mello, M., Pinho, A. D. A., Chinaglia, M. L. M., Tun, W., Junior, A., Cristina, M., Ilario, F. J., Reis, P. M., Salles, R. C. S., Westman, S., et al. (2008) · doi:10.31899/hiv2.1004 · Cited by 29
Parsing Social Network Survey Data from Hidden Populations Using Stochastic Context-Free Grammars
Poon, A. F. Y., Brouwer, K. C., Strathdee, S. A., Cruz, M. F., Lozada, R. M., Pond, S. L. K., Heckathorn, D. D., & Frost, S. D. W. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006777 · Cited by 22
Social and Sexual Networks: The National Longitudinal Study of Adolescent Health
Morris, M. (2004) · doi:10.1093/0199269017.003.0010 · Cited by 5
Cited by
Bonevski, B., Randell, M., Paul, C., Chapman, K., Twyman, L., Bryant, J., Brozek, I., & Hughes, C. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-42 · Cited by 1,467
Internet Research in Psychology
Gosling, S. D., & Mason, W. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015321 · Cited by 458
The structure of online diffusion networks
Goel, S., Watts, D. J., & Goldstein, D. G. (2012) · Proceedings of the 13th ACM Conference on Electronic Commerce · doi:10.1145/2229012.2229058 · Cited by 385
Self-citationSampling in software engineering research: a critical review and guidelines
Baltes, S., & Ralph, P. (2022) · Empirical Software Engineering · doi:10.1007/s10664-021-10072-8 · Cited by 382
Network Sampling: From Snowball and Multiplicity to Respondent-Driven Sampling
Heckathorn, D. D., & Cameron, C. J. (2017) · Annual Review of Sociology · doi:10.1146/annurev-soc-060116-053556 · Cited by 307
Metadata
- Authors
- Goel, S., & Salganik, M. J.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2010-03-29
- Volume
- 107
- Issue
- 15
- Pages
- 6743-6747
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2134831344
- Cited by
- 385
- References
- 41
- FWCI
- 30.16
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.