The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Unobserved Heterogeneity as an Alternative Explanation for “Reversal” Effects in Behavioral Research
Abstract
Behavioral researchers use analysis of variance (ANOVA) tests of differences between treatment means or chi-square tests of differences between proportions to provide support for empirical hypotheses about consumer behavior. These tests are typically conducted on data from “between-subjects” experiments in which participants were randomly assigned to conditions. We show that, despite using internally valid experimental designs such as this, aggregation biases can arise in which the theoretically critical pattern holds in the aggregate even though it holds for no (or few) individuals. First, we show that crossover interactions – often taken as strong evidence of moderating variables – can arise from the aggregation of two or more segments that do not exhibit such interactions when considered separately. Second, we show that certain context effects that have been reported for choice problems can result from the aggregation of two (or more) segments that do not exhibit these effects when considered separately. Given these threats to the conclusions drawn from experimental results, we describe the conditions under which observed heterogeneity can be ruled out as an alternative explanation based on one or more of the following: a priori considerations, derived properties, diagnostic statistics, and the results of latent class modelling. When these tests cannot rule out explanations based on unobserved heterogeneity, this is a serious problem for theorists who assume implicitly that the same theoretical principle works equally for everyone, but for random error. The empirical data patterns revealed by our diagnostics can expose the weakness in the theory but not fix it. It remains for the researcher to do further work to understand the underlying constructs that drive heterogeneity effects and to revise theory accordingly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elimination by aspects: A theory of choice
Tversky, A. (1972) · Psychological Review · doi:10.1037/h0032955 · Cited by 3,365
The interpretation of interaction in contingency tables
Simpson, E. H. (1951) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1951.tb00088.x · Cited by 2,301 · cited 2×
“(Simpson 1951). exhibit what we call the ignorance-is-bliss problem. They implicitly assume that their treatment mean results are representative of the individuals in their sample and in the population, but they do not test this assumption. Cook and Campbell (1979) and Lynch (1982, 1983) therefore recommended several…”
Wedel, M., & Kamakura, W. A. (2000) · International Series in Quantitative Marketing · doi:10.1007/978-1-4615-4651-1 · Cited by 782
Self-citation
Cited by
The Effect of Forced Choice on Choice
Dhar, R., & Simonson, I. (2003) · Journal of Marketing Research · doi:10.1509/jmkr.40.2.146.19229 · Cited by 631
How Online Product Reviews Affect Retail Sales: A Meta-analysis
Floyd, K., Freling, R., Alhoqail, S., Cho, H. Y., & Freling, T. (2014) · Journal of Retailing · doi:10.1016/j.jretai.2014.04.004 · Cited by 622
How collinearity affects mixture regression results
Becker, J.-M., Ringle, C. M., Sarstedt, M., & Völckner, F. (2015) · Marketing Letters · doi:10.1007/s11002-014-9299-9 · Cited by 577
New Empirical Generalizations on the Determinants of Price Elasticity
Bijmolt, T. H. A., Van Heerde, H. J., & Pieters, R. G. M. (2005) · Journal of Marketing Research · doi:10.1509/jmkr.42.2.141.62296 · Cited by 440
Strategies for revising judgment: How (and how well) people use others’ opinions.
Soll, J. B., & Larrick, R. P. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0015145 · Cited by 416
Metadata
- Authors
- Hutchinson, J. W., Kamakura, W. A., & Lynch, J. G.
- Venue
- Journal of Consumer Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2000-12
- Volume
- 27
- Issue
- 3
- Pages
- 324-344
- ISSN
- 0093-5301 (ISSN-L)
- 1537-5277
- OpenAlex
- W2081855646
- Cited by
- 151
- References
- 3
- FWCI
- 2.21
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.