Toward an explanation of the power law artifact: Insights from response surface analysis
Open accessThe DOI matches its Crossref record; 25 of the 26 references it cites were found in a registry or an index.
Abstract
The power law (y = ax-b) has been shown to provide a good description of data collected in a wide range of fields in psychology. R. B. Anderson and Tweney (1997) suggested that the model's data-fitting success may in part be artifactual, caused by a number of factors, one of which is the use of improper data averaging methods. The present paper follows up on their work and explains causes of the power law artifact. A method for studying the geometric relations among responses generated by mathematical models is introduced that shows the artifact is a result of the combined contributions of three factors: arithmetic averaging of data that are generated from a nonlinear model in the presence of individual differences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Whereas this is certainly a viable mechanism of forgetting, it can be proven mathematically that (spurious) power functions may emerge from averaging over different subjects or items [35,36]. This has also been shown in simulations considering a wide range of circumstances [37,38].”
From Replication and Analysis of Ebbinghaus’ Forgetting Curve (2015) · cites this paper as [36]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724 · cited 1×
“This is a statistical method for analyzing data in the presence of individual differences (for technical reviews of the method, see Bryk & Raudenbush, 1987, 1992; Cudeck , 1996; Kim, 1998).”
MethodNonlinear Regression Analysis and Its Applications
Bates, D. M., & Watts, D. G. (1988) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316757 · Cited by 3,979
Hierarchical Linear Models: Applications and Data Analysis Methods.
Goldstein, H., Bryk, A. S., & Raudenbush, S. W. (1993) · Journal of the American Statistical Association · doi:10.2307/2290750 · Cited by 3,321
Short-term retention of individual verbal items.
Peterson, L., & Peterson, M. J. (1959) · Journal of Experimental Psychology · doi:10.1037/h0049234 · Cited by 2,939
Memory: A Contribution to Experimental Psychology
Ebbinghaus, H. (2013) · Annals of Neurosciences · doi:10.5214/ans.0972.7531.200408 · Cited by 2,827
Application of hierarchical linear models to assessing change.
Bryk, A. S., & Raudenbush, S. W. (1987) · Psychological Bulletin · doi:10.1037//0033-2909.101.1.147 · Cited by 1,514 · cited 1×
“This is a statistical method for analyzing data in the presence of individual differences (for technical reviews of the method, see Bryk & Raudenbush, 1987, 1992; Cudeck , 1996; Kim, 1998).”
MethodMechanisms of skill acquisition and the law of practice
Newell, A., & Rosenbloom, P. S. (2018) · Figshare · doi:10.1184/r1/6607196 · Cited by 1,489
Mechanisms of skill acquisition and the law of practice
Newell, A., & Rosenbloom, P. S. (2018) · Figshare · doi:10.1184/r1/6607199.v1 · Cited by 1,365
Reflections of the Environment in Memory
Anderson, J. R., & Schooler, L. J. (1991) · Psychological Science · doi:10.1111/j.1467-9280.1991.tb00174.x · Cited by 1,085
Linear and Nonlinear Models for the Analysis of Repeated Measurements
Vonesh, E., & Chinchilli, V. M. (1996) · CRC Press eBooks · doi:10.1201/9781482293272 · Cited by 989 · cited 1×
“Fitting stochastic parameter models requires use of statistical software packages such as HLM (Bryk, Raudenbush , & Congdon, 1992) and PROC MIXLIN in the SAS programming language (Vonesh & Chinchilli, 1997).”
MethodHierarchical linear models: Applications and data analysis methods
Rumberger, R. W. (1997) · Economics of Education Review · doi:10.1016/s0272-7757(97)80188-4 · Cited by 980
One hundred years of forgetting: A quantitative description of retention.
Rubin, D. C., & Wenzel, A. E. (1996) · Psychological Review · doi:10.1037//0033-295x.103.4.734 · Cited by 814
The perils of averaging data over strategies: An example from children's addition.
Siegler, R. S. (1987) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.116.3.250 · Cited by 671 · cited 1×
“Despite many explicit warnings about its potential misleading effects (see, e.g., Ashby, Maddox, & Lee, 1994; Estes, 1956; Melton, 1936; Siegler, 1987; Singh, 1996), arithmetic averaging across subjects' data is still a common practice among researchers carrying out analyses.”
BackgroundThe problem of inference from curves based on group data.
Estes, W. K. (1956) · Psychological Bulletin · doi:10.1037/h0045156 · Cited by 654 · cited 1×
“Despite many explicit warnings about its potential misleading effects (see, e.g., Ashby, Maddox, & Lee, 1994; Estes, 1956; Melton, 1936; Siegler, 1987; Singh, 1996), arithmetic averaging across subjects' data is still a common practice among researchers carrying out analyses.”
BackgroundStevens, S. S. (1970) · Science · doi:10.1126/science.170.3962.1043 · Cited by 548
Wixted, J. T., & Ebbesen, E. B. (1991) · Psychological Science · doi:10.1111/j.1467-9280.1991.tb00175.x · Cited by 513 · cited 1×
“For each of the six two-parameter models used in Wixted and Ebbesen (1991), which have been put forth as models of forgetting, the corresponding model-preserving averaging function is shown in Table 2.”
MethodRegression Analysis and Its Application: A Data-Oriented Approach
Gunst, R. F., & Mason, R. L. (2018) · CRC Press eBooks · doi:10.1201/9780203741054 · Cited by 301
Wixted, J. T., & Ebbesen, E. B. (1997) · Memory & Cognition · doi:10.3758/bf03211316 · Cited by 237 · cited 1×
“For example, when Wixted and Ebbesen (1997) reanalyzed data from a previous study, the type of averaging (arithmetic or geometric) made little difference , probably because there were few or no individual differences in the data.”
MethodAshby, F. G., Maddox, W. T., & Lee, W. W. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00651.x · Cited by 196
Artifactual power curves in forgetting
Anderson, R. B., & Tweney, R. D. (1997) · Memory & Cognition · doi:10.3758/bf03211315 · Cited by 129 · cited 5×
“For example, R. B. Anderson and Tweney (1997) pointed out and demonstrated (see their Table 3) that averaging across trial position could also produce an artifact.”
BackgroundInfluentialMixed-effects Models in the Study of Individual Differences with Repeated Measures Data
Cudeck, R. (1996) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3103_6 · Cited by 102 · cited 1×
“This is a statistical method for analyzing data in the presence of individual differences (for technical reviews of the method, see Bryk & Raudenbush, 1987, 1992; Cudeck , 1996; Kim, 1998).”
MethodWickens, T. D. (1998) · Psychological Review · doi:10.1037/0033-295x.105.2.379 · Cited by 38
Stevenson, M. K. (1993) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.122.1.3 · Cited by 32
Stevenson, M. K. (1993) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.122.1.3 · Cited by 21
Subtractive versus Ratio Model of “Fair” Allocation: Can the Group Level Analyses Be Misleading?
Singh, R. (1996) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1996.0094 · Cited by 13 · cited 1×
“Despite many explicit warnings about its potential misleading effects (see, e.g., Ashby, Maddox, & Lee, 1994; Estes, 1956; Melton, 1936; Siegler, 1987; Singh, 1996), arithmetic averaging across subjects' data is still a common practice among researchers carrying out analyses.”
Background
Research works printed but not linked: 2
- Bryk, A. S., Raudenbush, S. W., &Congdon, R. (1992).Hierarchical linear model and nonlinear modeling with HLM/2L and HLM/3L programs. Chicago: Scientific Software.
- Kim, C. (1998).Incorporating individual differences in mathematical psychology. Unpublished doctoral dissertation, Ohio State University. Melton, A. W. (1936). The end-spurt in memorization curves as an artifact of the averaging of individual curves. Psychological Monographs, 47 (2, Whole No. 202).
Cited by
Bakdash, J. Z., & Marusich, L. R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00456 · Cited by 2,018
How Can the Human Mind Occur in the Physical Universe?
Anderson, J. R. (2007) · doi:10.1093/acprof:oso/9780195324259.001.0001 · Cited by 1,483
A temporal ratio model of memory
Brown, G. D. A., Neath, I., & Chater, N. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.539 · Cited by 798
“Code for the simulations reported in this article is available at www .warwick.ac.uk/staff/G.D.A.Brown/simple/.”
MethodReplication and Analysis of Ebbinghaus’ Forgetting Curve
Murre, J. M. J., & Dros, J. (2015) · PLOS ONE · doi:10.1371/journal.pone.0120644 · Cited by 777
“Whereas this is certainly a viable mechanism of forgetting it can be proven mathematically that (spurious) power functions may emerge from averaging over different subjects or items [35,36].”
BackgroundThe power law repealed: The case for an exponential law of practice
Heathcote, A., Brown, S., & Mewhort, D. J. K. (2000) · Psychonomic Bulletin & Review · doi:10.3758/bf03212979 · Cited by 736
Metadata
- Authors
- Myung, I. J., Kim, C., & Pitt, M. A.
- Affiliations
- The Ohio State University (US)
- Corresponding author
- Myung, In Jae
- Venue
- Memory & Cognition
- Published
- 2000-09
- Volume
- 28
- Issue
- 5
- Pages
- 832-840
- ISSN
- 0090-502X (ISSN-L)
- 1532-5946
- OpenAlex
- W2011831660
- Cited by
- 126
- References
- 26
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 2 · 2023: 6 · 2022: 6 · 2021: 4 · 2020: 5 · 2019: 4 · 2018: 6 · 2017: 5 · 2016: 5 · 2015: 5 · 2014: 3 · 2013: 2 · 2012: 7
- FWCI
- 13.24
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Memory & Cognition (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (R01MH057472, MH57472)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- power law model, response surface analysis, arithmetic averaging, nonlinear models, individual differences, psychophysics
- MeSH terms
- Behavior, Humans, Models, Psychological, Stochastic Processes, Nonlinear Dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.