The DOI matches its Crossref record; 114 of the 114 references it cites were found in a registry or an index.
Revisiting Robinson: The perils of individualistic and ecologic fallacy
Abstract
BACKGROUND: W S Robinson made a seminal contribution by demonstrating that correlations for the same two variables can be different at the individual and ecologic level. This study reanalyzes and historically situates Robinson's influential study that laid the foundation for the primacy of analyzing data at only the individual level. METHODS: We applied a binomial multilevel logistic model to analyse variation in illiteracy as enumerated by the 1930 US. Census (the same data as used by Robinson). The outcome was log odds of being illiterate, while predictors were race/nativity ('native whites', 'foreign-born whites' and 'negroes') at the individual-level, and presence of Jim Crow segregation laws for education at the state-level. We conducted historical research to identify the social and scientific context within which Robinson's study was produced and favourably received. RESULTS: Empirically, the substantial state variations in illiteracy could not be accounted by the states' race/nativity composition. Different approaches to modelling state-effects yielded considerably attenuated associations at the individual-level between illiteracy and race/nativity. Furthermore, state variation in illiteracy was different across the race/nativity groups, with state variation being largest for whites and least for foreign-born whites. Strong effects of Jim Crow education laws on illiteracy were observed with the effect being strongest for blacks. Historically, Robinson's study was consonant with the post-World War II ascendancy of methodological individualism. CONCLUSION: Applying a historically informed multilevel perspective to Robinson's profoundly influential study, we demonstrate that meaningful analysis of individual-level relationships requires attention to substantial heterogeneity in state characteristics. The implication is that perils are posed by not only ecological fallacy but also individualistic fallacy. Multilevel thinking, grounded in historical and spatiotemporal context, is thus a necessity, not an option.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,723
Keywords: A Vocabulary of Culture and Society
McKeon, M., & Williams, R. (1977) · Studies in Romanticism · doi:10.2307/25600068 · Cited by 6,816
Social conditions as fundamental causes of disease.
Link, B. G., & Phelan, J. (1995) · Journal of Health and Social Behavior · doi:10.2307/2626958 · Cited by 5,722
(2006) · Technometrics · doi:10.1198/tech.2006.s417 · Cited by 4,950
Ecological Correlations and the Behavior of Individuals
Robinson, W. S. (1950) · American Sociological Review · doi:10.2307/2087176 · Cited by 4,513
Social Conditions as Fundamental Causes of Disease
Link, B. G., & Phelan, J. (1995) · Digital Repository at the University of Maryland · doi:10.13016/rpln-eiwa · Cited by 2,679
Method in Social Science: A Realist Approach.
Harp, J., & Sayer, A. (1986) · Contemporary Sociology · doi:10.2307/2070081 · Cited by 2,603
Hennekens, C. H., Buring, J. E., & Mayrent, S. L. (1987) · Medical Entomology and Zoology · Cited by 2,319
Theories for social epidemiology in the 21st century: An ecosocial perspective
Krieger, N. (2001) · International Journal of Epidemiology · doi:10.1093/ije/30.4.668 · Cited by 2,155
Self-citationAn American Dilemma: The Negro Problem and Modern Democracy.
Young, K., Myrdal, G., Sterner, R., & Rose, A. M. (1944) · American Sociological Review · doi:10.2307/2086087 · Cited by 2,017
(1988) · Annals of Internal Medicine · doi:10.7326/0003-4819-108-2-316_4 · Cited by 1,926
Clinical Epidemiology: The Essentials.
(1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-114-9-825_10 · Cited by 1,838
Epidemiology: Beyond the Basics
Szklo, M., & Nieto, F. J. (1999) · Cited by 1,441
Epidemiology and the web of causation: has anyone seen the spider?
Krieger, N. (1994) · Social Science & Medicine · doi:10.1016/0277-9536(94)90202-x · Cited by 1,419
Self-citationMethods in Observational Epidemiology
Kelsey, J. L. (1986) · Cited by 1,307
Methods in observational epidemiology
Leck, I. (1987) · Journal of Epidemiology and Community Health · doi:10.1136/jech.41.3.263-a · Cited by 1,278
Goulias, K. (2002) · New Directions in Civil Engineering · doi:10.1201/9781420042283.ch9 · Cited by 1,270
Method in Social Science: Revised 2nd Edition
Sayer, A. (2002) · Routledge eBooks · doi:10.4324/9780203163603 · Cited by 1,248
(1977) · Annals of Internal Medicine · doi:10.7326/0003-4819-86-6-835_3 · Cited by 1,155
(2000) · doi:10.1093/oso/9780195083316.001.0001 · Cited by 1,069
Critical Realism: An Introduction to Roy Bhaskar's Philosophy
Collier, A. (1994) · Cited by 1,028
A People's History of the United States: 1492-Present
Zinn, H. (1980) · Cited by 939
Clinical epidemiology: The essentials
Valagussa, P. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90054-2 · Cited by 916
Methods in Social Epidemiology
Oakes, J. M., & Kaufman, J. S. (2006) · Cited by 781
The Strange Career of Jim Crow.
Richards, E. S., & Woodward, C. V. (1955) · American Sociological Review · doi:10.2307/2092589 · Cited by 741
Context, composition and heterogeneity: using multilevel models in health research
Duncan, C., Jones, K., & Moon, G. (1998) · Social Science & Medicine · doi:10.1016/s0277-9536(97)00148-2 · Cited by 689
Self-citationA glossary for multilevel analysis
Diez Roux, A. V. (2002) · Journal of Epidemiology and Community Health · doi:10.1136/jech.56.8.588 · Cited by 670
O'Campo, P., Marmot, M., & Wilkinson, R. (2000) · Journal of Public Health Policy · doi:10.2307/3343290 · Cited by 664
A Solution to the Ecological Inference Problem
King, G. (2013) · Princeton University Press eBooks · doi:10.1515/9781400849208 · Cited by 650
Certain Effects of Grouping upon the Size of the Correlation Coefficient in Census Tract Material
Gehlke, C. E., & Biehl, K. (1934) · Journal of the American Statistical Association · doi:10.1080/01621459.1934.10506247 · Cited by 580
An American Dilemma: The Negro Problem and Modern Democracy
Gimar, M., & Sissela, B. (2017) · Routledge eBooks · doi:10.4324/9781315082417 · Cited by 567
Proximal, Distal, and the Politics of Causation: What’s Level Got to Do With It?
Krieger, N. (2008) · American Journal of Public Health · doi:10.2105/ajph.2007.111278 · Cited by 535
Self-citationKing, G. (1997) · ICPSR Data Holdings · doi:10.3886/icpsr01132 · Cited by 506
An Assessment of Estimation Procedures for Multilevel Models with Binary Responses
Rodriguez, G., & Goldman, N. (1995) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983404 · Cited by 476
The logic in ecological: I. The logic of analysis.
Susser, M. (1994) · American Journal of Public Health · doi:10.2105/ajph.84.5.825 · Cited by 436
A Rule for Inferring Individual-Level Relationships from Aggregate Data
Firebaugh, G. (1978) · American Sociological Review · doi:10.2307/2094779 · Cited by 400
Higher mortality in deprived areas: community or personal disadvantage?
Sloggett, A., & Joshi, H. (1994) · BMJ · doi:10.1136/bmj.309.6967.1470 · Cited by 395
Ecological effects in multi-level studies
Blakely, T. A., & Woodward, A. J. (2000) · Journal of Epidemiology and Community Health · doi:10.1136/jech.54.5.367 · Cited by 385
The Changing Face of Methodological Individualism
Udéhn, L. (2002) · Annual Review of Sociology · doi:10.1146/annurev.soc.28.110601.140938 · Cited by 382
Some Alternatives to Ecological Correlation
Goodman, L. A. (1959) · American Journal of Sociology · doi:10.1086/222597 · Cited by 354
Ecological Regressions and Behavior of Individuals
Goodman, L. A. (1953) · American Sociological Review · doi:10.2307/2088121 · Cited by 349
Multilevel Methods for Public Health Research
Subramanian, S. V., Jones, K., & Duncan, C. (2003) · Neighborhoods and Health · doi:10.1093/acprof:oso/9780195138382.003.0004 · Cited by 332
Self-citationDurkheim's Suicide and Problems of Empirical Research
Selvin, H. C. (1958) · American Journal of Sociology · doi:10.1086/222356 · Cited by 328
Epidemiology: Beyond the Basics
Uzych, L. (2001) · Family & Community Health · doi:10.1097/00003727-200104000-00014 · Cited by 316
Langbein, L., & Lichtman, A. (1978) · Sage eBooks · doi:10.4135/9781412984003 · Cited by 314
Context and Consex: A Cautionary Tale
Hauser, R. M. (1970) · American Journal of Sociology · doi:10.1086/224894 · Cited by 305
An Alternative to Ecological Correlation
Duncan, O. D., & Davis, B. (1953) · American Sociological Review · doi:10.2307/2088122 · Cited by 288
Jones, K., & Duncan, C. (1995) · Health & Place · doi:10.1016/1353-8292(95)00004-6 · Cited by 287
Self-citationEpidemiology in public health practice
(2010) · Wageningen Academic Publishers eBooks · doi:10.3920/978-90-8686-140-8 · Cited by 285
Merlo, J. (2003) · Journal of Epidemiology and Community Health · doi:10.1136/jech.57.8.550 · Cited by 267
(1994) · doi:10.1093/oso/9780195050356.001.0001 · Cited by 266
A typology of ecological fallacies
Alker, H. (1969) · Cited by 265
Epidemiologic Methods: Studying the Occurrence of Illness
Koepsell, T. D., & Weiss, N. S. (2014) · Cited by 258
Estimation and Inference via Bayesian Simulation: An Introduction to Markov Chain Monte Carlo
Jackman, S. (2000) · American Journal of Political Science · doi:10.2307/2669318 · Cited by 254
Lock, M. M., & Gordon, D. (1988) · Springer eBooks · doi:10.1007/978-94-009-2725-4 · Cited by 239
The relevance of multilevel statistical methods for identifying causal neighborhood effects
Subramanian, S. V. (2003) · Social Science & Medicine · doi:10.1016/s0277-9536(03)00415-5 · Cited by 231
Self-citationMany are the Crimes: McCarthyism in America.
Whitfield, S. J., & Schrecker, E. W. (2000) · Journal of American History · doi:10.2307/2567595 · Cited by 217
Eyes Off the Prize: The United Nations and the African American Struggle for Human Rights, 1944-1955
Smith, S. A. (2017) · The SHAFR Guide Online · doi:10.1163/2468-1733_shafr_sim270020200 · Cited by 216
Essential Epidemiology: An Introduction for Students and Health Professionals
Webb, P. M., & Bain, C. (2012) · Cited by 209
Defying Dixie: the radical roots of civil rights, 1919-1950
(2009) · Choice Reviews Online · doi:10.5860/choice.46-5220 · Cited by 193
Eyes off the prize: the United Nations and the African American struggle for human rights, 1944-1955
(2003) · Choice Reviews Online · doi:10.5860/choice.41-2359 · Cited by 188
McKinlay, J. B., & Marceau, L. D. (2000) · American Journal of Public Health · doi:10.2105/ajph.90.1.25 · Cited by 187
Understanding AIDS: historical interpretations and the limits of biomedical individualism.
Fee, E., & Krieger, N. (1993) · American Journal of Public Health · doi:10.2105/ajph.83.10.1477 · Cited by 183
Self-citationMedical geography: taking space seriously
Jones, K., & Moon, G. (1993) · Progress in Human Geography · doi:10.1177/030913259301700405 · Cited by 181
Self-citationEpidemiologic Methods: Studying the Occurrence of Illness
Cole, S. R. (2004) · American Journal of Epidemiology · doi:10.1093/aje/kwh165 · Cited by 176
Why Epidemiologists Cannot Afford to Ignore Poverty
Krieger, N. (2007) · Epidemiology · doi:10.1097/ede.0b013e318156bfcd · Cited by 173
Self-citationMany are the crimes: McCarthyism in America
(1998) · Choice Reviews Online · doi:10.5860/choice.36-1173 · Cited by 163
Subramanian, S. V., Chen, J. T., Rehkopf, D. H., Waterman, P. D., & Krieger, N. (2005) · American Journal of Public Health · doi:10.2105/ajph.2003.034132 · Cited by 157
Self-citationLinde, A. (2005) · Statistica Neerlandica · doi:10.1111/j.1467-9574.2005.00278.x · Cited by 151
Bayesian Measures of Model Complexity and Fit
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00353 · Cited by 151
Defying Dixie: The Radical Roots of Civil Rights, 1919–1950
Thompson, H. A. (2009) · Labor Studies in Working-Class History of the Americas · doi:10.1215/15476715-2009-013 · Cited by 148
Population Health: Concepts and Methods
Young, T. K. (1998) · Cited by 144
THE HUMAN SCIENCES IN COLD WAR AMERICA
Isaac, J. (2007) · The Historical Journal · doi:10.1017/s0018246x07006334 · Cited by 134
Thorndike, E. L. (1939) · The American Journal of Psychology · doi:10.2307/1416673 · Cited by 132
The Health of Populations: General Theories and Particular Realities
Kunitz, S. J. (2006) · Cited by 118
Greater than the parts : holism in biomedicine, 1920-1950
Lawrence, C., & Weisz, G. (1998) · Cited by 110
Essential Epidemiology: An Introduction for Students and Health Professionals
Schoonhoven, L. (2006) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2006.01567.x · Cited by 105
Multilevel Perspectives on Modeling Census Data
Subramanian, S. V., Duncan, C., & Jones, K. (2001) · Environment and Planning A Economy and Space · doi:10.1068/a3357 · Cited by 104
Self-citationPorter, T. M., & Ross, D. (2003) · Cambridge University Press eBooks · Cited by 94
Measuring and modeling the social and geographic context of trauma: A multilevel modeling approach
Kawachi, I. I., & Subramanian, S. V. (2006) · Journal of Traumatic Stress · doi:10.1002/jts.20108 · Cited by 94
Self-citationEstimation from Grouped Observations
Hannan, M. T., & Burstein, L. (1974) · American Sociological Review · doi:10.2307/2094296 · Cited by 89
Modelling Complexity: Analysing Between-Individual and Between-Place Variation—A Multilevel Tutorial
Bullen, N., Jones, K., & Duncan, C. (1997) · Environment and Planning A Economy and Space · doi:10.1068/a290585 · Cited by 84
Self-citationBhopal, R. S. (2002) · Cited by 82
Epidemiology for Public Health Practice
Ellis‐Stoll, C. C. (1997) · AORN Journal · doi:10.1016/s0001-2092(06)62875-5 · Cited by 81
Social Injustice and Public Health
(2005) · doi:10.1093/acprof:oso/9780195171853.001.0001 · Cited by 77
Better Day Coming: Blacks and Equality, 1890-2000
Fairclough, A. (2001) · Medical Entomology and Zoology · Cited by 73
State's Laws on Race and Color
Mahoney, M., & Murray, P. (1953) · The New England Quarterly · doi:10.2307/362469 · Cited by 73
Olsen, J. (2003) · Epidemiology · doi:10.1097/01.ede.0000066300.10469.5a · Cited by 71
Population health: Concepts and methods
Wood, E., & Hogg, R. S. (2000) · American Journal of Human Biology · Cited by 67
Jones, K., & Moon, G. (2022) · Routledge eBooks · doi:10.4324/9781003283010 · Cited by 67
Self-citationChanging Contours of The Social Science Disciplines
Ross, D. (2003) · Cambridge University Press eBooks · doi:10.1017/chol9780521594424.014 · Cited by 59
Smith, G. D., Ebrahim, S., & Frankel, S. H. (2015) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198703358.001.0001 · Cited by 51
The Dixiecrat revolt and the end of the Solid South, 1932-1968
(2001) · Choice Reviews Online · doi:10.5860/choice.38-6381 · Cited by 49
The Dixiecrat Revolt and the End of the Solid South, 1932-1968
Tindall, G. B., & Frederickson, K. (2002) · Journal of American History · doi:10.2307/2700747 · Cited by 46
Greater Than the Parts: Holism in Biomedicine, 1920-1950
Risse, G. B. (1999) · JAMA · doi:10.1001/jama.281.14.1344 · Cited by 40
States' Laws on Race and Color.
Mangum, C. S., & Murray, P. (1952) · The Journal of Southern History · doi:10.2307/2955237 · Cited by 39
(2003) · Policy Press eBooks · doi:10.51952/9781447342229 · Cited by 39
Identifying Causal Ecologic Effects on Health: A Methodological Assessment
Subramanian, S. V., Glymour, M. M., & Kawachi, I. I. (2007) · Springer eBooks · doi:10.1007/978-0-387-70812-6_15 · Cited by 38
Self-citationThe House of Falk: the paranoid style in American health politics.
Derickson, A. (1997) · American Journal of Public Health · doi:10.2105/ajph.87.11.1836 · Cited by 28
Ecological Fallacy, Statistics of
Firebaugh, G. (2001) · Elsevier eBooks · doi:10.1016/b0-08-043076-7/00765-8 · Cited by 27
Researching Critical Questions On Social Justice And Public Health: An Ecosocial Perspective
Krieger, N. (2005) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195171853.003.0026 · Cited by 23
Self-citationJones, K., & Moon, G. (1991) · Progress in Human Geography · doi:10.1177/030913259101500405 · Cited by 23
Self-citationArea-based studies and the evaluation of multilevel influences on health outcomes
Moon, G., Subramanian, S. V., Jones, K., Duncan, C., & Twigg, L. (2005) · Bristol Research (University of Bristol) · Cited by 21
Self-citationKrieger, N. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym228 · Cited by 16
Self-citationEcological Fallacy, Statistics of
Firebaugh, G. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.44017-1 · Cited by 12
“Medical McCarthyism”: The Physicians Forum and the Cold War
Brickman, J. P. (1994) · Journal of the History of Medicine and Allied Sciences · doi:10.1093/jhmas/49.3.380 · Cited by 10
Badash, L. (2000) · Minerva · doi:10.1023/a:1026516820931 · Cited by 9
Epidemiology and Prevention: a systems based approach
Yarnell, J. (2006) · Cited by 7
Marginalized multilevel models and likelihood inference - Comments & Rejoinder
Lesaffre, E. M. E. H., Spiessens, B., Neuhaus, J., Raudenbush, S., Heagerty, P., & Zeger, S. (2000) · Statistical Science · Cited by 7
Schaefer, H. (1967) · PubMed · Cited by 6
Methodological Individualism in Sociology
Picavet, E. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.32089-x · Cited by 5
Methodological Individualism in Sociology
Picavet, E. (2001) · Elsevier eBooks · doi:10.1016/b0-08-043076-7/02022-2 · Cited by 4
Research works printed but not linked: 15
- Google. Google Scholar Google 2008 (10 June 2008, date last accessed) Available at Available at: http://scholar.google.com/schhp?hl=en&lr=
- Rothman, 1986, Modern Epidemiology.
- Rothman, 1998, Modern Epidemiology,.
- Gordis, 2004, Epidemiology.
- Susser, 1973, Causal Thinking in the Health Sciences.
- Hanushek, 1974, Model specification, use of aggregate data, and the ecological correlation fallacy, Pol Methodol, 1, 89
- Blakely, 2006, Multilevel studies, 316
- Macintyre, 2000, The social patterning of health: bringing the social context back in, Medl Sociol Newsl, 26, 14
- Browne, 2004, MCMC Estimation in MLwiN Version 2.0.
- Raudenbush, 2000, Marginalized Multilevel Models and Likelihood Inference: Comment, Stat Sci, 15, 22
- Morgan, 2003, Economics, 275
- Bannister, 2003, Sociology, 329
- Stevens, 1976, Equal!: TheCcase of Integration vs. Jim Crow.
- Douglas, 1997, Foreward – with synopsis of Murray, 23
- Robeson, 1950, Forge Negro-labor Unity for Peace and Jobs.
Cited by
Demographic and health surveys: a profile
Corsi, D. J., Neuman, M., Finlay, J. E., & Subramanian, S. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys184 · Cited by 1,178
Self-citationFixed and random effects models: making an informed choice
Bell, A., Fairbrother, M., & Jones, K. (2019) · Quality & Quantity · doi:10.1007/s11135-018-0802-x · Cited by 1,085
Self-citationIntra-urban vulnerability to heat-related mortality in New York City, 1997–2006
Klein Rosenthal, J., Kinney, P. L., & Metzger, K. B. (2014) · Health & Place · doi:10.1016/j.healthplace.2014.07.014 · Cited by 294
The relationship between income and oral health: a critical review
Singh, A., Peres, M. A., & Watt, R. G. (2019) · Journal of Dental Research · doi:10.1177/0022034519849557 · Cited by 243
Separate and unequal: Structural racism and infant mortality in the US
Wallace, M., Crear-Perry, J., Richardson, L., Tarver, M., & Theall, K. (2017) · Health & Place · doi:10.1016/j.healthplace.2017.03.012 · Cited by 243
Metadata
- Authors
- Subramanian, S. V., Jones, K., Kaddour, A., & Krieger, N.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2009-01-28
- Volume
- 38
- Issue
- 2
- Pages
- 342-360
- ISSN
- 1464-3685
- 0300-5771
- Cited by
- 252
- References
- 114
- Language
- en
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.