The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Is the selection of statistical methods governed by level of measurement?
Abstract
AbstractThe notion that nonparametric methods are required as a replacement of parametric statistical methods when the scale of measurement in a research study does not achieve a certain level was discussed in light of recent developments in representational measurement theory. A new approach to examining the problem via computer simulation was introduced. Some of the beliefs that have been widely held by psychologists for several decades were examined by means of a computer simulation study that mimicked measurement of an underlying empirical structure and performed two - sample Student t - tests on the resulting sample data. It was concluded that there is no need to replace parametric statistical tests by nonparametric methods when the scale of measurement is ordinal and not interval.Stevens' (1946) classic paper on the theory of scales of measurement triggered one of the longest standing debates in behavioural science methodology. The debate -- referred to as the levels of measurement controversy, or measurement - statistics debate -- is over the use of parametric and nonparametric statistics and its relation to levels of measurement. Stevens (1946; 1951; 1959; 1968), Siegel (1956), and most recently Siegel and Castellan (1988) and Conover (1980) argue that parametric statistics should be restricted to data of interval scale or higher. Furthermore, nonparametric statistics should be used on data of ordinal scale. Of course, since each scale of measurement has all of the properties of the weaker measurement, statistical methods requiring only a weaker scale may be used with the stronger scales. A detailed historical review linking Stevens' work on scales of measurement to the acceptance of psychology as a science, and a pedagogical presentation of fundamental axiomatic (i.e., representational) measurement can be found in Zumbo and Zimmerman (1991).Many modes of argumentation can be seen in the debate about levels of measurement and statistics. This paper focusses almost exclusively on an empirical form of rhetoric using experimental mathematics (Ripley, 1987). The term experimental mathematics comes from mathematical physics. It is loosely defined as the mimicking of the rules of a model of some kind via random processes. In the methodological literature this is often referred to as simulation. However, for the purpose of this paper, the terms experimental mathematics or computer simulation are preferred to because the latter is typically referred to when examining the robustness of a test in relation to particular statistical assumptions. Measurement level is not an assumption of the parametric statistical model (see Zumbo & Zimmerman, 1991 for a discussion of this issue) and to call the method used herein monte carlo would imply otherwise. The term experimental mathematics emphasizes the modelling aspect of the present approach to the debate.The purpose of this paper is to present a new paradigm using experimental mathematics to examine the claims made in the levels of measurement controversy. As Michell (1986) demonstrated, the concern over levels of measurement is inextricably tied to the differing notions of measurement and scaling. Michell further argued that fundamental axiomatic measurement or representational theory (see, for example, Narens & Luce, 1986) is the only measurement theory which implies a relation between measurement scales and statistics. Therefore, the approach advocated in this paper is linked closely to representational theory. The novelty of this approach, to the authors knowledge, is in the use of experimental mathematics to mimic representational measurement. Before describing the methodology used in this paper, we will briefly review its motivation.Admissible TransformationsRepresentational theory began in the late 1950's with Scott and Suppes (1958) and later with Suppes and Zinnes (1963), Pfanzagl (1968), and Krantz, Luce, Suppes & Tversky (1971). …
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonparametric Statistics for the Behavioral Sciences
Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,245
Practical Nonparametric Statistics
Groggel, D. J. (2000) · Technometrics · doi:10.1080/00401706.2000.10486067 · Cited by 11,041
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
On the Theory of Scales of Measurement
Stevens, S. S. (1946) · Science · doi:10.1126/science.103.2684.677 · Cited by 4,761
Non-Uniform Random Variate Generation
Devroye, L. (1986) · Springer eBooks · doi:10.1007/978-1-4613-8643-8 · Cited by 4,041
Rank transformations as a bridge between parametric and nonparametric statistics
Conover, W. J., & Iman, R. L. (1981) · The American Statistician · doi:10.1080/00031305.1981.10479327 · Cited by 3,922
A Note on the Generation of Random Normal Deviates
Box, G. E. P., & Muller, M. E. (1958) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706645 · Cited by 3,401
Ripley, B. D. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316726 · Cited by 2,241
Handbook of Experimental Psychology
(1952) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1952.02930050088038 · Cited by 2,219
Handbook of mathematical psychology: I.
Luce, R. D., Bush, R. R., & Galanter, E. (1963) · Wiley eBooks · Cited by 1,999
Mathematics, measurement, and psychophysics.
Stevens, S. S. (1951) · Cited by 975
The effects of violations of assumptions underlying the t test.
Boneau, C. A. (1960) · Psychological Bulletin · doi:10.1037/h0041412 · Cited by 790
Foundations of Measurement, Vol. I: Additive and Polynomial Representations
Krantz, D. H., Luce, D., Suppes, P., & Tversky, A. (1971) · Cited by 764
Measurement theory with applications to decisionmaking, utility, and the social sciences
Roberts, F. S. (1979) · Cited by 535
Causey, R. L. (1971) · Journal of Symbolic Logic · doi:10.2307/2270274 · Cited by 518
Pfanzagl, J. (1971) · Physica-Verlag eBooks · doi:10.1007/978-3-662-41488-0 · Cited by 423
Sawilowsky, S. S., & Blair, R. C. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.111.2.352 · Cited by 395
A pseudo-random number generator for the System/360
Lewis, P. A. W., Goodman, A. S., & Miller, J. M. (1969) · IBM Systems Journal · doi:10.1147/sj.82.0136 · Cited by 370
On the Statistical Treatment of Football Numbers.
Lord, F. M. (1953) · American Psychologist · doi:10.1037/h0063675 · Cited by 342
Measurement scales and statistics: A clash of paradigms.
Michell, J. (1986) · Psychological Bulletin · doi:10.1037//0033-2909.100.3.398 · Cited by 331
Practical Nonparametric Statistics. 2nd Edition.
Reese, R. A., & Conover, W. J. (1983) · Applied Statistics · doi:10.2307/2348049 · Cited by 299
Morgan, B. J. T. (1984) · Springer eBooks · doi:10.1007/978-1-4899-3282-2 · Cited by 257
Measurement scales and statistics: The misconception misconceived.
Townsend, J. T., & Ashby, F. G. (1984) · Psychological Bulletin · doi:10.1037//0033-2909.96.2.394 · Cited by 237
Measurement, Statistics, and the Schemapiric View
Stevens, S. S. (1968) · Science · doi:10.1126/science.161.3844.849 · Cited by 214
Nonparametric Tests of Interaction in Experimental Design
Sawilowsky, S. S. (1990) · Review of Educational Research · doi:10.2307/1170226 · Cited by 162
Foundations of the Theory of Prediction
Glass, G. V., & Rozeboom, W. W. (1967) · American Educational Research Journal · doi:10.2307/1161775 · Cited by 157
Measurement: The theory of numerical assignments.
Narens, L., & Luce, R. D. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.99.2.166 · Cited by 145
A Theory of Appropriate Statistics
Adams, E. W., Fagot, R. F., & Robinson, R. E. (1965) · Psychometrika · doi:10.1007/bf02289443 · Cited by 124
Analysis of Likert-scale data: A reinterpretation of Gregoire and Driver.
Rasmussen, J. L. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.1.167 · Cited by 118
Probability Spaces, Hilbert Spaces, and the Axioms of Test Theory
Zimmerman, D. W. (1975) · Psychometrika · doi:10.1007/bf02291765 · Cited by 111
Self-citationA Handbook for Data Analysis in the Behavioral Sciences:
Wasserman, S. S., Keren, G. B., & Lewis, C. (1994) · Journal of the American Statistical Association · doi:10.2307/2290884 · Cited by 94
The relative power of parametric and nonparametric statistical methods.
Zimmerman, D. W., & Zumbo, B. D. (1993) · Cited by 78
Self-citationScaling theory and the nature of measurement
Rozeboom, W. W. (1966) · Synthese · doi:10.1007/bf00485356 · Cited by 74
Sawilowsky, S. S., Blair, R. C., & Higgins, J. J. (1989) · Journal of Educational Statistics · doi:10.3102/10769986014003255 · Cited by 74
Analysis of ordinal data to detect population differences.
Gregoire, T. G., & Driver, B. L. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.1.159 · Cited by 65
Meaningful inference: The role of measurement in statistics.
Stine, W. W. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.1.147 · Cited by 53
Parametric statistics and levels of measurement: Factorial designs and multiple regression.
Davison, M. L., & Sharma, A. R. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.3.394 · Cited by 40
Interobserver relational agreement.
Stine, W. W. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.106.2.341 · Cited by 26
Zimmerman, D. W., & Zumbo, B. D. (1990) · The Journal of General Psychology · doi:10.1080/00221309.1990.9921148 · Cited by 22
Self-citationZimmerman, D. W., & Zumbo, B. D. (1989) · Perceptual and Motor Skills · Cited by 9
Self-citation
Cited by
Gadermann, A., Guhn, M., & Zumbo, B. D. (2020) · PubMed · doi:10.7275/n560-j767 · Cited by 1,200
Self-citationAssessing the visual quality of rural landscapes
Arriaza, M., Cañas-Ortega, J. F., Cañas-Madueño, J. A., & Ruiz-Aviles, P. (2004) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2003.10.029 · Cited by 707
Relative Power of the Wilcoxon Test, the Friedman Test, and Repeated-Measures ANOVA on Ranks
Zimmerman, D. W., & Zumbo, B. D. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.9943832 · Cited by 496
Self-citationA sense of belonging at university: student retention, motivation and enjoyment
Pedler, M. L., Willis, R., & Nieuwoudt, J. E. (2022) · Journal of Further and Higher Education · doi:10.1080/0309877x.2021.1955844 · Cited by 473
Factors influencing digital technology use in early childhood education
Blackwell, C. K., Lauricella, A. R., & Wartella, E. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.04.013 · Cited by 427
Metadata
- Authors
- Zumbo, B. D., & Zimmerman, D. W.
- Venue
- Canadian Psychology / Psychologie canadienne
- Published
- 1993-10
- Volume
- 34
- Issue
- 4
- Pages
- 390-400
- ISSN
- 0708-5591 (ISSN-L)
- 1878-7304
- OpenAlex
- W2009315055
- Cited by
- 300
- References
- 40
- FWCI
- 2.95
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.