Toward an explanation of the power law artifact: Insights from response surface analysis
Open accessThe DOI matches its Crossref record; 25 of the 26 references it cites were found in a registry or an index.
Abstract
The power law (y = ax-b) has been shown to provide a good description of data collected in a wide range of fields in psychology. R. B. Anderson and Tweney (1997) suggested that the model's data-fitting success may in part be artifactual, caused by a number of factors, one of which is the use of improper data averaging methods. The present paper follows up on their work and explains causes of the power law artifact. A method for studying the geometric relations among responses generated by mathematical models is introduced that shows the artifact is a result of the combined contributions of three factors: arithmetic averaging of data that are generated from a nonlinear model in the presence of individual differences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Whereas this is certainly a viable mechanism of forgetting, it can be proven mathematically that (spurious) power functions may emerge from averaging over different subjects or items [35,36]. This has also been shown in simulations considering a wide range of circumstances [37,38].”
From Replication and Analysis of Ebbinghaus’ Forgetting Curve (2015) · cites this paper as [36]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724 · cited 1×
“This is a statistical method for analyzing data in the presence of individual differences (for technical reviews of the method, see Bryk & Raudenbush, 1987, 1992; Cudeck , 1996; Kim, 1998).”
MethodNonlinear Regression Analysis and Its Applications
Bates, D. M., & Watts, D. G. (1988) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316757 · Cited by 3,979
Hierarchical Linear Models: Applications and Data Analysis Methods.
Goldstein, H., Bryk, A. S., & Raudenbush, S. W. (1993) · Journal of the American Statistical Association · doi:10.2307/2290750 · Cited by 3,321
Short-term retention of individual verbal items.
Peterson, L., & Peterson, M. J. (1959) · Journal of Experimental Psychology · doi:10.1037/h0049234 · Cited by 2,939
Memory: A Contribution to Experimental Psychology
Ebbinghaus, H. (2013) · Annals of Neurosciences · doi:10.5214/ans.0972.7531.200408 · Cited by 2,827
Application of hierarchical linear models to assessing change.
Bryk, A. S., & Raudenbush, S. W. (1987) · Psychological Bulletin · doi:10.1037//0033-2909.101.1.147 · Cited by 1,514 · cited 1×
“This is a statistical method for analyzing data in the presence of individual differences (for technical reviews of the method, see Bryk & Raudenbush, 1987, 1992; Cudeck , 1996; Kim, 1998).”
MethodMechanisms of skill acquisition and the law of practice
Newell, A., & Rosenbloom, P. S. (2018) · Figshare · doi:10.1184/r1/6607196 · Cited by 1,489
Mechanisms of skill acquisition and the law of practice
Newell, A., & Rosenbloom, P. S. (2018) · Figshare · doi:10.1184/r1/6607199.v1 · Cited by 1,365
Reflections of the Environment in Memory
Anderson, J. R., & Schooler, L. J. (1991) · Psychological Science · doi:10.1111/j.1467-9280.1991.tb00174.x · Cited by 1,085
Linear and Nonlinear Models for the Analysis of Repeated Measurements
Vonesh, E., & Chinchilli, V. M. (1996) · CRC Press eBooks · doi:10.1201/9781482293272 · Cited by 989 · cited 1×
“Fitting stochastic parameter models requires use of statistical software packages such as HLM (Bryk, Raudenbush , & Congdon, 1992) and PROC MIXLIN in the SAS programming language (Vonesh & Chinchilli, 1997).”
Method
Research works printed but not linked: 2
- Bryk, A. S., Raudenbush, S. W., &Congdon, R. (1992).Hierarchical linear model and nonlinear modeling with HLM/2L and HLM/3L programs. Chicago: Scientific Software.
- Kim, C. (1998).Incorporating individual differences in mathematical psychology. Unpublished doctoral dissertation, Ohio State University. Melton, A. W. (1936). The end-spurt in memorization curves as an artifact of the averaging of individual curves. Psychological Monographs, 47 (2, Whole No. 202).
Cited by
Bakdash, J. Z., & Marusich, L. R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00456 · Cited by 2,018
How Can the Human Mind Occur in the Physical Universe?
Anderson, J. R. (2007) · doi:10.1093/acprof:oso/9780195324259.001.0001 · Cited by 1,483
A temporal ratio model of memory
Brown, G. D. A., Neath, I., & Chater, N. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.539 · Cited by 798
“Code for the simulations reported in this article is available at www .warwick.ac.uk/staff/G.D.A.Brown/simple/.”
MethodReplication and Analysis of Ebbinghaus’ Forgetting Curve
Murre, J. M. J., & Dros, J. (2015) · PLOS ONE · doi:10.1371/journal.pone.0120644 · Cited by 777
“Whereas this is certainly a viable mechanism of forgetting it can be proven mathematically that (spurious) power functions may emerge from averaging over different subjects or items [35,36].”
BackgroundThe power law repealed: The case for an exponential law of practice
Heathcote, A., Brown, S., & Mewhort, D. J. K. (2000) · Psychonomic Bulletin & Review · doi:10.3758/bf03212979 · Cited by 736
Toward a method of selecting among computational models of cognition.
Pitt, M. A., Myung, I. J., & Zhang, S. (2002) · Psychological Review · doi:10.1037//0033-295x.109.3.472 · Cited by 506
“See Myung, Kim, and Pitt (2000) for a more detailed discussion.”
BackgroundSelf-citationCumulative prospect theory's functional menagerie
Stott, H. P. (2006) · Journal of Risk and Uncertainty · doi:10.1007/s11166-006-8289-6 · Cited by 482
An instance theory of attention and memory.
Logan, G. D. (2002) · Psychological Review · doi:10.1037/0033-295x.109.2.376 · Cited by 467
Implicit, long-term spatial contextual memory.
Chun, M. M., & Jiang, Y. (2003) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.29.2.224 · Cited by 389
“Participants were not informed that the spatial configurations of the stimuli in some trials would be repeated, nor were they told to attend to or encode the global array.”
BackgroundGeneralization guides human exploration in vast decision spaces
Wu, C. M., Schulz, E., Speekenbrink, M., Nelson, J. D., & Meder, B. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0467-4 · Cited by 242
“While aggregated learning curves should be analyzed with caution 45 , we find an overlap between elements of human intelligence responsible for successful performance in our task, and elements of participant behaviour captured by the Function Learning Model.”
MethodSerial Mechanisms in Lexical Access: The Rank Hypothesis.
Murray, W. S., & Forster, K. I. (2004) · Psychological Review · doi:10.1037/0033-295x.111.3.721 · Cited by 228
“, Anderson, 1982; Logan, 1990; Newell & Rosenbloom, 1981) or an exponential (e.g., Heathcote et al., 2000; Myung et al., 2000).”
BackgroundA hierarchical model for estimating response time distributions
Rouder, J. N., Lu, J., Speckman, P., Sun, D., & Jiang, Y. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03257252 · Cited by 194
Modeling individual differences using Dirichlet processes
Navarro, D. J., Griffiths, T. L., Steyvers, M., & Lee, M. D. (2006) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2005.11.006 · Cited by 145
“When the performance of subjects has genuine differences, however, it is well known (e.g., Ashby, Maddox, & Lee, 1994; Estes, 1956; Myung, Kim, & Pitt, 2000) that averaging produces data that do not accurately represent the behavior of individuals, and provide a misleading basis for modeling.”
BackgroundMixture models of choice under risk
Conte, A., Hey, J. D., & Moffatt, P. G. (2009) · Journal of Econometrics · doi:10.1016/j.jeconom.2009.10.011 · Cited by 150
“Similarly, the paper by Myung et al (2000) shows clearly the problems with fitting a single agent model to a heterogeneous population.”
Evidence against conflict monitoring and adaptation: An updated review
Schmidt, J. R. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1520-z · Cited by 127
Practice and retention: A unifying analysis.
Anderson, J. R., Fincham, J. M., & Douglass, S. (1999) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.25.5.1120 · Cited by 142
Estes, W. K., & Maddox, W. T. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03193784 · Cited by 160
“2. It has become well accepted in cognitive modeling that performance scores obtained in cognitive research must represent composites of true scores and error (Brown & Heathcote, 2003; Estes, 2002; Myung, Kim, & Pitt, 2000; Pitt, Myung, & Zhang, 2002).”
BackgroundMethodA diffusion model decomposition of the practice effect
Dutilh, G., Vandekerckhove, J., Tuerlinckx, F., & Wagenmakers, E. (2009) · Psychonomic Bulletin & Review · doi:10.3758/16.6.1026 · Cited by 146
“In particular, Heathcote, Brown, and Mew hort (2000) argued that the power law is an artifact of averaging practice functions over participants (see also R. B. Anderson & Tweney, 1997; Myung, Kim, & Pitt, 2000 ).”
BackgroundDoes Learning a Complex Task Have to Be Complex?: A Study in Learning Decomposition
Lee, F. J., & Anderson, J. R. (2001) · Cognitive Psychology · doi:10.1006/cogp.2000.0747 · Cited by 126
“…power functions or some other functions, such as exponential functions (cf. Anderson & Tweney, 1997; Wixted & Ebbesen, 1991, 1997; Heathcote, Brown, & Mewort, 2000; Myung, Kim, & Pitt, 2000), or mixtures of different power functions (cf. Rickard, 1997; Delaney, Reder, Staszewski, & Ritter, 1998).”
Reasoning in Reference Games: Individual- vs. Population-Level Probabilistic Modeling
Franke, M., & Degen, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154854 · Cited by 115
“Why should such a computational-level rational analysis care about individual differences? First, if only aggregate data are considered, it is possible that the phenomenon we are trying to explain is an artifact of averaging [76].”
BackgroundModeling individual differences in cognition
Lee, M. D., & Webb, M. R. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196751 · Cited by 136
Two interpretations of reports of knowledge of subpopulation sizes
Killworth, P. D., McCarty, C., Bernard, H. R., Johnsen, E. C., Domini, J., & Shelley, G. A. (2003) · Social Networks · doi:10.1016/s0378-8733(02)00040-0 · Cited by 109
Model evaluation using grouped or individual data
Cohen, A. L., Sanborn, A. N., & Shiffrin, R. M. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.4.692 · Cited by 114
Averaging learning curves across and within participants
Brown, S. D., & Heathcote, A. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195493 · Cited by 125
“Although this assertion seems intuitively plausible, Myung, Kim, and Pitt (2000) reported a very strong bias whereby the power function provided a better fit to purely random data than did the exponential function in 99% of cases.”
BackgroundSchmidt, J. R., Houwer, J. D., & Rothermund, K. (2016) · Cognitive Psychology · doi:10.1016/j.cogpsych.2016.10.004 · Cited by 118
“Indeed, the speedup in performance follows a highly predictable function: a power function in participant-averaged, blocked data, or an exponential function with individual-participant, trial-by-trial analyses (Heathcote, Brown, & Mewhort, 2000; Myung, Kim, & Pitt, 2000).”
BackgroundA Power-Law Model of Psychological Memory Strength in Short- and Long-Term Recognition
Donkin, C., & Nosofsky, R. M. (2012) · Psychological Science · doi:10.1177/0956797611430961 · Cited by 103
Modeling the distinct phases of skill acquisition.
Tenison, C., & Anderson, J. R. (2016) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000204 · Cited by 92
The power law as an emergent property
Anderson, R. B. (2001) · Memory & Cognition · doi:10.3758/bf03195767 · Cited by 93
“Following Myung et al. (2000), two-dimensional response surfaces may be constructed by first simplifying the equations in Table 2 so that the A parameter is omitted (or, equivalently, fixed at 1.0).”
BackgroundMethodInfluentialLearning the Form of Causal Relationships Using Hierarchical Bayesian Models
Lucas, C. G., & Griffiths, T. L. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01058.x · Cited by 91
A parallel architecture perspective on pre-activation and prediction in language processing
Huettig, F., Audring, J., & Jackendoff, R. S. (2022) · Cognition · doi:10.1016/j.cognition.2022.105050 · Cited by 107
Assessing the distinguishability of models and the informativeness of data
Navarro, D., Pitt, M. A., & Myung, I. J. (2004) · Cognitive Psychology · doi:10.1016/j.cogpsych.2003.11.001 · Cited by 97
“2 displays the matrix of landscapes for the experimental design of Burtt and Dobell (1925), and is fairly typical of the 25 designs.”
Self-citationIs the Mind a Network? Maps, Vehicles, and Skyhooks in Cognitive Network Science
Hills, T. T., & Kenett, Y. N. (2021) · Topics in Cognitive Science · doi:10.1111/tops.12570 · Cited by 99
“The problem with such a group-based approach relates to a larger more general issue in cognitive research related to problems of making inferences about individuals from aggregated data (Estes, 1956; Myung, Kim, & Pitt, 2000).”
Strategy Execution in Cognitive Skill Learning: An Item-Level Test of Candidate Models.
Rickard, T. C. (2004) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.30.1.65 · Cited by 81
The Aha! Experience: Insight and Discontinuous Learning in Product Usage
Lakshmanan, A., & Krishnan, H. S. (2011) · Journal of Marketing · doi:10.1509/jm.10.0348 · Cited by 103
Repeated measures correlationPreprint
Bakdash, J. Z., & Marusich, L. R. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/8kb2g · Cited by 91
Phases of learning: How skill acquisition impacts cognitive processing
Tenison, C., Fincham, J. M., & Anderson, J. R. (2016) · Cognitive Psychology · doi:10.1016/j.cogpsych.2016.03.001 · Cited by 67
Power laws from individual differences in learning and forgetting: Mathematical analyses
Murre, J. M. J., & Chessa, A. G. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0076-y · Cited by 62
“We assume that individual learning rates μ follow a gamma distribution with density function f ðmÞ ¼ 1Γ ðaÞbama 1e m=b; ð2Þ with parameters a, b > 0, where Γ(a) is the gamma function.”
BackgroundEvans, N. J., Brown, S. D., Mewhort, D. J. K., & Heathcote, A. (2018) · Psychological Review · doi:10.1037/rev0000105 · Cited by 72
Adi‐Japha, E., Karni, A., Parnes, A., Loewenschuss, I., & Vakil, E. (2008) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0013217 · Cited by 72
Forgetting curves: implications for connectionist models
Sikström, S. (2002) · Cognitive Psychology · doi:10.1016/s0010-0285(02)00012-9 · Cited by 58
Haider, H., & Frensch, P. A. (2002) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.28.2.392 · Cited by 92
Flexibility versus generalizability in model selection
Pitt, M. A., Kim, W., & Myung, I. J. (2003) · Psychonomic Bulletin & Review · doi:10.3758/bf03196467 · Cited by 56
Self-citationTrafficking in cognition: applying cognitive psychology to driving
Groeger, J. A. (2002) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/s1369-8478(03)00006-8 · Cited by 73
Piecewise power laws in individual learning curves
Donner, Y., & Hardy, J. L. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0811-x · Cited by 63
Kurtz, K. J., Levering, K. R., Stanton, R. D., Romero, J., & Morris, S. N. (2012) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0029178 · Cited by 63
Schmidt, J. R., & Houwer, J. D. (2016) · Learning and Motivation · doi:10.1016/j.lmot.2016.09.002 · Cited by 49
An Exemplar Account of the Bow and Set-Size Effects in Absolute Identification.
Kent, C. D., & Lamberts, K. (2005) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.31.2.289 · Cited by 45
A Bayesian analysis of retention functions
Lee, M. D. (2004) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2004.06.002 · Cited by 45
“These results show that more sophisticated approximations to the Bayesian posterior, such as the Stochastic Complexity Criterion (SCC: Rissanen, 1996), and the Geometric Complexity Criterion (GCC: Myung et al., 2000a), are not necessary on the grounds of accuracy.”
BackgroundSchmidt, J. R., Giesen, C. G., & Rothermund, K. (2020) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021820906397 · Cited by 50
Murre, J. M. J. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0522-0 · Cited by 63
An Episodic Model of Task Switching Effects: Erasing the Homunculus from Memory
Schmidt, J. R., Liefooghe, B., & Houwer, J. D. (2020) · Journal of Cognition · doi:10.5334/joc.97 · Cited by 42
Speed, Accuracy, and Serial Order in Sequence Production
Pfordresher, P. Q., Palmėr, C., & Jungers, M. K. (2007) · Cognitive Science · doi:10.1080/03640210709336985 · Cited by 48
“Fits were carried out in two steps, following the same procedure used by Palmer and Pfordresher (2003). First, the range model was fit to each participant’s movement gradient using one free parameter, a, which was allowed to vary between .”
MethodSnoddy (1926) Revisited: Time Scales of Motor Learning
Stratton, S. M., Liu, Y.-T., Hong, S. L., Mayer‐Kress, G., & Newell, K. M. (2007) · Journal of Motor Behavior · doi:10.3200/jmbr.39.6.503-516 · Cited by 38
“In recent assessments of learning functions in the cognitive domain, researchers have also begun challenging the veridicality of the power law for behavioral change and the effects of data averaging (Gallistel, Fairhurst, & Balsam, 2004; Heathcote et al., 2000; Myung et al., 2000).”
Elementary Signal Detection and Threshold Theory
Kellen, D., & Klauer, K. C. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn505 · Cited by 41
Beyond Curve Fitting: A Dynamical Systems Account of Exponential Learning in a Discrete Timing Task
Liu, Y.-T., Mayer‐Kress, G., & Newell, K. M. (2003) · Journal of Motor Behavior · doi:10.1080/00222890309602133 · Cited by 42
Memory hazard functions: A vehicle for theory development and test.
Chechile, R. A. (2006) · Psychological Review · doi:10.1037/0033-295x.113.1.31 · Cited by 37
Asking better questions: How presentation formats influence information search.
Wu, C. M., Meder, B., Filimon, F., & Nelson, J. D. (2017) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000374 · Cited by 37
Hierarchical Bayes Models for Response Time Data
Craigmile, P. F., Peruggia, M., & Zandt, T. V. (2010) · Psychometrika · doi:10.1007/s11336-010-9172-6 · Cited by 34
“Most commonly a researcher will derive a hypothesis about the behavior of a summary statistic (such as the mean) with changes in an experimental condition: for example, mean RT should decrease with increased practice (Heathcote, Brown, & Mewhort, 2000; Myung, Kim, & Pitt, 2000; Newell & Rosenblum, 1981).”
BackgroundEffectiveness of solid waste management policies in Australia: An Exploratory Study
Du, L., Zuo, J., Chang, R., Zillante, G., Li, L., & Carbone, A. (2022) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2022.106966 · Cited by 37
Cognitive skill acquisition and transfer in younger and older adults.
Touron, D. R., Hoyer, W. J., & Cerella, J. (2001) · Psychology and Aging · doi:10.1037//0882-7974.16.4.555 · Cited by 43
Fisher, J. S., & Radvansky, G. A. (2019) · Journal of Memory and Language · doi:10.1016/j.jml.2019.104035 · Cited by 37
Revisiting the learning curve (once again)
Glautier, S. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00982 · Cited by 30
Once and for all—How people change strategy to ignore irrelevant information in visual tasks
Gaschler, R., Marewski, J. N., & Frensch, P. A. (2014) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2014.961933 · Cited by 29
Comparing time-accuracy curves: Beyond goodness-of-fit measures
Liu, C. C., & Smith, P. L. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.1.190 · Cited by 32
“When the data are sufficiently precise, it is often preferable to analyze each individual separately; fitting nonlinear functions (such as the shifted exponential) to averaged data may yield distorted estimates that do not reflect the true underlying process for any individual (Brown & Heathcote, 2003; Estes & Maddox,…”
MethodAre item-level strategy shifts abrupt and collective? Age differences in cognitive skill acquisition
Touron, D. R. (2006) · Psychonomic Bulletin & Review · doi:10.3758/bf03193997 · Cited by 27
“One notable exception, a study by Rickard (2004), demonstrated that item-level RT data from younger adults exhibited step-function decreases that were better predicted by fits to his component power laws (CMPL) model than by the smooth speedup functions that govern parallel execution models (such as the instance model…”
BackgroundMark Steyvers, B., & Benjamin, A. S. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1128-2 · Cited by 32
“A standard approach is to use fit statistics that quantify the balance between model fit and model complexity (Myung, 2000; Myung et al., 2000) such as AIC and BIC (Donner & Hardy, 2015), MDL (Pitt et al., 2002), WAIC (Evans et al., 2018), and Bayes Factors (Lee, 2004).”
MethodAn ACT-R Model of the Spacing Effect
Pavlik, P. I., & Anderson, J. R. (2018) · KiltHub Repository · doi:10.1184/r1/6613424 · Cited by 28
Myung, I. J., & Pitt, M. A. (2002) · Wiley eBooks · doi:10.1002/0471214426.pas0411 · Cited by 26
Self-citationThe Quest for Simplicity in Human Learning: Identifying the Constraints on Attention
Galdo, M., Weichart, E. R., Sloutsky, V. M., & Turner, B. M. (2021) · Cognitive Psychology · doi:10.1016/j.cogpsych.2022.101508 · Cited by 30
On the whats and hows of retrieval in the acquisition of a simple skill.
Wenger, M. J. (1999) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.25.5.1137 · Cited by 29
“Complicating the issue further, there are long-standingproblems associated with artifacts of averaging across participantsgenerally (eg, Ashby, Maddox, & Lee, 1994; Estes, 1956) and specific to power functions (eg, Myung, Kim, &Pitt, 1998).”
BackgroundHow to model the neurocognitive dynamics of decision making: A methodological primer with ACT-R
Dimov, C. M., Khader, P. H., Marewski, J. N., & Pachur, T. (2019) · Behavior Research Methods · doi:10.3758/s13428-019-01286-2 · Cited by 25
Time Scales, Difficulty/Skill Duality, and the Dynamics of Motor Learning
Newell, K. M., Liu, Y.-T., & Mayer‐Kress, G. (2008) · Advances in experimental medicine and biology · doi:10.1007/978-0-387-77064-2_24 · Cited by 25
“Additional challenges to power law interpretations of other learning data sets have been advanced in several recent papers (Gallistel et al., 2004; Heathcote et al., 2000; Myung et al., 2000; Newell et al., 2001).”
BackgroundParallel and Serial Processing
Logan, G. D. (2002) · Wiley eBooks · doi:10.1002/0471214426.pas0407 · Cited by 27
Response time analysis in cognitive tasks with increasing difficulty
Dodonov, Y. S., & Dodonova, Y. A. (2012) · Intelligence · doi:10.1016/j.intell.2012.07.002 · Cited by 23
Perceptual similarity affects the learning curve (but not necessarily learning).
Wifall, T., McMurray, B., & Hazeltine, E. (2012) · Journal of Experimental Psychology General · doi:10.1037/a0030865 · Cited by 22
Kim, S. H., Choi, Y. J., Lee, H., Lee, S., Ahn, J., Noh, B., & Min, S. C. (2012) · Journal of the Korean Society for Applied Biological Chemistry · doi:10.1007/s13765-012-1039-3 · Cited by 18
“RSA is a method for studying geometric relationships among response variables, which are generated by mathematical models (Myung et al., 2000).”
MethodA Psychophysical Law for Linguistic Judgments
Keller, F. (2003) · eScholarship (California Digital Library) · Cited by 16
Effect of low concentrations of indoor toluene on cognitive performance: EEG-based evidence
Wang, Z., Liu, J., Wang, J., Guo, D., Pei, J., Zhao, L., Zhang, X., Liu, J., Li, Y., Deng, M., et al. (2022) · Building and Environment · doi:10.1016/j.buildenv.2022.109494 · Cited by 17
Learning to drive: A reconceptualization
Mirman, J. H., Curry, A. E., & Mirman, D. (2019) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2019.01.010 · Cited by 14
“Indeed, Myung, Kim, and Pitt (2000) demonstrated that a power-law ‘‘artifact” can occur when data from non-linear models are arithmetically averaged in the presence of individual difference factors (Myung et al., 2000).”
BackgroundAn Introduction to Cognitive Modeling
Farrell, S., & Lewandowsky, S. (2015) · Springer eBooks · doi:10.1007/978-1-4939-2236-9_1 · Cited by 17
Bias in exponential and power function fits due to noise: Comment on Myung, Kim, and Pitt
Brown, S. D., & Heathcote, A. (2003) · Memory & Cognition · doi:10.3758/bf03196105 · Cited by 12
“First, we replicated the work of Myung et al. (2000) by fitting one-parameter (simple) power and exponential functions to binomial noise.”
BackgroundMethodInfluentialJeong, D., & Hills, T. T. (2024) · Cognitive Science · doi:10.1111/cogs.70008 · Cited by 11
White, A. S., Cerella, J., & Hoyer, W. J. (2007) · Memory & Cognition · doi:10.3758/bf03192942 · Cited by 12
“Myung, Kim, and Pitt (2000) were able to show analytically that negative exponentials converge to a power function very rapidly as traces are added to the average.”
BackgroundThe Prep statistic as a measure of confidence in model fitting
Ashby, F. G., & O’Brien, J. B. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.1.16 · Cited by 11
Dennis, S. J., & Kintsch, W. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804632.010 · Cited by 10
Beyond Curve Fitting to Inferences About Learning
Liu, Y.-T., Mayer‐Kress, G., & Newell, K. M. (2004) · Journal of Motor Behavior · doi:10.3200/jmbr.36.2.233-238 · Cited by 9
Murre, J. M. J. (2023) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2023.102816 · Cited by 9
Learning Habits: Does Overtraining Lead to Resistance to New Learning?
Schmidt, J. R., Houwer, J. D., & Moors, A. (2020) · Collabra Psychology · doi:10.1525/collabra.320 · Cited by 13
Davletyarova, K. V., Vacher, P., Nicolas, M., Капилевич, Л. В., & Mourot, L. (2020) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000003760 · Cited by 9
“This solution resolves the issue of nonindependence but may lead to misleading results, notably in the case of meaningful individual differences, as previously stated (14,28).”
ResultStrategy inference during learning via cognitive activity-based credit assignment models
James, A., Reynaud-Bouret, P., Mezzadri, G., Sargolini, F., Bethus, I., & Muzy, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-33604-2 · Cited by 11
Double jeopardy in inferring cognitive processes
Fifić, M. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01130 · Cited by 10
“…who are ready to switch from the subject aggregating procedures, and instead consider using individual subject analysis, if they are not already en route to developing and using such methods (e.g., Myung et al., 2000; Brown and Heathcote, 2003; Estes and Maddox, 2005; Soto et al., 2014).”
MethodNavarro, D. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194107 · Cited by 8
Speed, Accuracy, and Serial Order in Sequence Production
Pfordresher, P. Q., Palmėr, C., & Jungers, M. K. (2007) · Cognitive Science · doi:10.1207/s15516709cog3101_3 · Cited by 8
Transfer of training and its effect on learning curves
Speelman, G. P., & Kirsner, K. (2006) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.02.2.p052 · Cited by 6
Addendum to Killeen's (2019) Bidding for Delayed Rewards
Killeen, P. R. (2020) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.600 · Cited by 7
A first-principles mathematical model integrates the disparate timescales of human learning
Lu, M., Marghetis, T., & Yang, V. C. (2025) · npj Complexity · doi:10.1038/s44260-025-00039-x · Cited by 5
Rasul, R. B., Avedisian, C. T., Xu, Y., Hicks, M., & Reeves, A. P. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3170926 · Cited by 5
“tial and power law [38], [39], [40], as shown below were explored to obtain the best fit model for precision.”
MethodWeiss, D. J., & Edwards, W. (2005) · Behavior Research Methods · doi:10.3758/bf03192740 · Cited by 5
Katô, J., & Okada, K. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020693 · Cited by 5
Developing a Drawing Task to Differentiate Group Average Time Course vs. Dynamics in the Individual
Blech, C., & Gaschler, R. (2017) · Psychology Learning & Teaching · doi:10.1177/1475725717700516 · Cited by 4
Metadata
- Authors
- Myung, I. J., Kim, C., & Pitt, M. A.
- Affiliations
- The Ohio State University (US)
- Corresponding author
- Myung, In Jae
- Venue
- Memory & Cognition
- Published
- 2000-09
- Volume
- 28
- Issue
- 5
- Pages
- 832-840
- ISSN
- 0090-502X (ISSN-L)
- 1532-5946
- OpenAlex
- W2011831660
- Cited by
- 126
- References
- 26
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 2 · 2023: 6 · 2022: 6 · 2021: 4 · 2020: 5 · 2019: 4 · 2018: 6 · 2017: 5 · 2016: 5 · 2015: 5 · 2014: 3 · 2013: 2 · 2012: 7
- FWCI
- 13.24
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Memory & Cognition (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (R01MH057472, MH57472)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- power law model, response surface analysis, arithmetic averaging, nonlinear models, individual differences, psychophysics
- MeSH terms
- Behavior, Humans, Models, Psychological, Stochastic Processes, Nonlinear Dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.