The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Response Time Effort: A New Measure of Examinee Motivation in Computer-Based Tests
Abstract
When low-stakes assessments are administered, the degree to which examinees give their best effort is often unclear, complicating the validity and interpretation of the resulting test scores. This study introduces a new method, based on item response time, for measuring examinee test-taking effort on computer-based test items. This measure, termed response time effort (RTE), is based on the hypothesis that when administered an item, unmotivated examinees will answer too quickly (i.e., before they have time to read and fully consider the item). Psychometric characteristics of RTE scores were empirically investigated and supportive evidence for score reliability and validity was found. Potential applications of RTE scores and their implications are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Probabilistic Models for Some Intelligence and Attainment Tests
(1961) · Information and Control · doi:10.1016/s0019-9958(61)80061-2 · Cited by 6,939
Motivation in Education: Theory, Research, and Applications
Pintrich, P. R., & Schunk, D. H. (1995) · Cited by 6,248
Low Examinee Effort in Low-Stakes Assessment: Problems and Potential Solutions
Wise, S. L., & DeMars, C. E. (2005) · Educational Assessment · doi:10.1207/s15326977ea1001_1 · Cited by 591
Self-citationMethodology Review: Evaluating Person Fit
Meijer, R. R., & Sijtsma, K. (2001) · Applied Psychological Measurement · doi:10.1177/01466210122031957 · Cited by 417
Comparing the Aberrant Response Detection Performance of Thirty-Six Person-Fit Statistics
Karabatsos, G. (2003) · Applied Measurement in Education · doi:10.1207/s15324818ame1604_2 · Cited by 288
Modeling Item Response Times With a Two‐State Mixture Model: A New Method of Measuring Speededness
Schnipke, D. L., & Scrams, D. J. (1997) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1997.tb00516.x · Cited by 243
The Consequence of Consequence: Motivation, Anxiety, and Test Performance
Wolf, L. F., & Smith, J. K. (1995) · Applied Measurement in Education · doi:10.1207/s15324818ame0803_3 · Cited by 230
Consequence of Performance, Test, Motivation, and Mentally Taxing Items
Wolf, L. F., Smith, J. K., & Birnbaum, M. E. (1995) · Applied Measurement in Education · doi:10.1207/s15324818ame0804_4 · Cited by 132
Exploring Issues of Examinee Behavior: Insights Gained from Response-Time Analyses
Mills, C. N., Potenza, M. T., Fremer, J. J., & Ward, W. C. (2005) · Routledge eBooks · doi:10.4324/9781410612250-20 · Cited by 111
Diagnosing item score patterns on a test using item response theory-based person-fit statistics.
Meijer, R. R. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.1.72 · Cited by 81
Cited by
PISA 2018 Results (Volume I): What Students Know and Can Do
OECD (2019) · PISA · doi:10.1787/5f07c754-en · Cited by 2,350
Douglas, B. D., Ewell, P. J., & Brauer, M. (2023) · PLOS ONE · doi:10.1371/journal.pone.0279720 · Cited by 1,532
Detecting and Deterring Insufficient Effort Responding to Surveys
Huang, J. L., Curran, P. G., Keeney, J., Poposki, E. M., & DeShon, R. P. (2012) · Journal of Business and Psychology · doi:10.1007/s10869-011-9231-8 · Cited by 1,295
Berinsky, A. J., Margolis, M. F., & Sances, M. W. (2014) · American Journal of Political Science · doi:10.1111/ajps.12081 · Cited by 951
A latent profile analysis of college students’ achievement goal orientation
Pastor, D. A., Barron, K. E., Miller, B. J., & Davis, S. L. (2007) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2006.10.003 · Cited by 750
Metadata
- Authors
- Wise, S. L., & Kong, X.
- Venue
- Applied Measurement in Education
- Publisher
- Informa UK Limited
- Published
- 2005-04
- Volume
- 18
- Issue
- 2
- Pages
- 163-183
- ISSN
- 0895-7347 (ISSN-L)
- 1532-4818
- OpenAlex
- W1968779470
- Cited by
- 601
- References
- 11
- FWCI
- 13.60
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Response Time Effort: A New Measure of Examinee Motivation in Computer-Based Tests. https://app.cochat.ai/papers/10.1207/s15324818ame1802_2
- The paper
- Wise, S. L., & Kong, X. (2005). Response Time Effort: A New Measure of Examinee Motivation in Computer-Based Tests. Applied Measurement in Education. https://doi.org/10.1207/s15324818ame1802_2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.