Preparing Card Sort Data for Multidimensional Scaling Analysis in Social Psychological Research: A Methodological Approach
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Card sorting is a popular data-gathering technique. Although multidimensional scaling (MDS) is a statistical analogue of the technique, researchers rarely apply it to this type of data. The authors' contention is that a barrier to applying MDS to card sorting data is the lack of guidance in the literature about how to organize and prepare the data for analysis. The authors describe a method that gives guidance to researchers in the field of social psychology who want to analyze card sort data using MDS, which can be used to confirm or validate hypotheses about specific social psychological structures hidden in data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The sample size for the tasks was based on estimates of between six and 36 participants shown as sufficient for sort and cluster analysis tasks [22-28].”
From Validation of the theoretical domains framework for use in behaviour change and implementation research (2012) · cites this paper as [23]
Citations
Cites
Nonmetric Multidimensional Scaling: A Numerical Method
Kruskal, J. B. (1964) · Psychometrika · doi:10.1007/bf02289694 · Cited by 4,846 · cited 1×
“, numerical values indicating the degree of dissimilarity among stimuli such as Euclidean distance measures) into a geometric configuration or map of points in n-dimensional space (Kruskal, 1964; Kruskal & Wish, 1978; Takane, Young, & de Leeuw, 1976).”
BackgroundA multidimensional approach to the structure of personality impressions.
Rosenberg, S., Nelson, C., & Vivekananthan, P. S. (1968) · Journal of Personality and Social Psychology · doi:10.1037/h0026086 · Cited by 960 · cited 2×
“Several studies using MDS analyses in social psychological research were published over the past 3 decades (Forsyth & Pope, 1984; Giles et al., 1979; Green & Manzi, 2002; Isenberg & Ennis, 1981; Johnston, 1995; Lickel et al., 2000; Rosenberg & Kim, 1975; Rosenberg et al., 1968; Russell & Bullock, 1985).”
MethodTakane, Y., Young, F. W., & de Leeuw, J. (1977) · Psychometrika · doi:10.1007/bf02293745 · Cited by 947
Varieties of groups and the perception of group entitativity.
Lickel, B. A., Hamilton, D. L., Wieczorkowska, G., Lewis, A. C., Sherman, S. J., & Uhles, A. N. (2000) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.78.2.223 · Cited by 934
Multidimensional scaling of emotional facial expressions: Similarity from preschoolers to adults.
Russell, J. A., & Bullock, M. (1985) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.48.5.1290 · Cited by 385
SPSS 13.0 advanced statistical procedures companion
Norušis, M. J. (2005) · Medical Entomology and Zoology · Cited by 376
The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts
Rugg, G., & McGeorge, P. (1997) · Expert Systems · doi:10.1111/1468-0394.00045 · Cited by 311
The Method of Sorting as a Data-Gathering Procedure in Multivariate Research
Rosenberg, S., & Park Kim, M. (1975) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1004_7 · Cited by 277
Making sense of card sorting data
Fincher, S., & Tenenberg, J. (2005) · Expert Systems · doi:10.1111/j.1468-0394.2005.00299.x · Cited by 198
Ethical ideology and judgments of social psychological research: Multidimensional analysis.
Forsyth, D. R., & Pope, W. R. (1984) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.46.6.1365 · Cited by 153
Giguère, G. (2006) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.02.1.p026 · Cited by 109 · cited 1×
“MDS can be used to confirm or validate hypotheses about specific social-psychological structures hidden in data (Giguere, 2006).”
The Rokeach Value Survey: Underlying Structure and Multidimensional Scaling
Johnston, C. S. (1995) · The Journal of Psychology · doi:10.1080/00223980.1995.9914930 · Cited by 84 · cited 4×
“Other researchers have examined individual differences by grouping the participants according to characteristics of interest and performing separate MDS analyses for the different groups (e.g., Giles et al., 1979; Forsyth & Pope, 1984; Johnston, 1995; Russell & Bullock, 1985).”
BackgroundMethodInfluentialUsing edit distance to analyze card sorts
Deibel, K., Anderson, R., & Anderson, R. (2005) · Expert Systems · doi:10.1111/j.1468-0394.2005.00304.x · Cited by 63
Whaley, A. L., & Longoria, R. A. (2008) · Psychological Services · doi:10.1037/1541-1559.5.2.169 · Cited by 30
Self-citationPerceiving group members: A comparison of derived and imposed dimensions.
Isenberg, D. J., & Ennis, J. G. (1981) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.41.2.293 · Cited by 29
SOCIAL IDENTITY IN PUERTO RICO*
Giles, H., Llado, N., McKirnan, D. J., & Taylor, D. M. (1979) · International Journal of Psychology · doi:10.1080/00207597908246730 · Cited by 24 · cited 3×
“There are also studies involving the application of MDS to card sorting data (Giles et al., 1979).”
BackgroundMethodA COMPARISON OF METHODOLOGIES FOR UNCOVERING THE STRUCTURE OF RACIAL STEREOTYPE SUBGROUPING
Green, R. J., & Manzi, R. (2002) · Social Behavior and Personality An International Journal · doi:10.2224/sbp.2002.30.7.709 · Cited by 15
Statistical models of implicit personality theory: A comparison.
Powell, R. S., & Juhnke, R. G. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.44.5.911 · Cited by 10
Cited by
Cane, J., O’Connor, D., & Michie, S. (2012) · Implementation Science · doi:10.1186/1748-5908-7-37 · Cited by 4,888
“The sample size for the tasks was based on estimates of between six and 36 participants shown as sufficient for sort and cluster analysis tasks [22-28].”
MethodComparison of the CIELab and CIEDE2000 color difference formulas
Gómez‐Polo, C., Muñoz, M. P., Luengo, M. C. L., Vicente, P., Galindo, P., & Casado, A. M. M. (2015) · Journal of Prosthetic Dentistry · doi:10.1016/j.prosdent.2015.07.001 · Cited by 435
Trust and distrust: Polar opposites, or independent but co-existing?
Saunders, M. N. K., Dietz, G., & Thornhill, A. R. (2014) · Human Relations · doi:10.1177/0018726713500831 · Cited by 195
“Such sorting techniques provide a method of eliciting categorizations (Whaley and Longoria, 2009) that is simple to administer and easy for the participant to understand (Fincher and Tenenberg, 2005).”
MethodMapping Espoused Organizational Values
Bourne, H., Jenkins, M., & Parry, E. (2017) · Journal of Business Ethics · doi:10.1007/s10551-017-3734-9 · Cited by 120
“MDS is designed to convert proximities, such as those in the similarity matrix, into a geometric configuration or map of points in low-dimensional space (Kruskal 1964; Whaley and Longoria 2009).”
BackgroundMaking it tangible: hybrid card sorting within qualitative interviews
Conrad, L. Y., & Tucker, V. M. (2018) · Journal of Documentation · doi:10.1108/jd-06-2018-0091 · Cited by 118
Metadata
- Authors
- Whaley, A. L., & Longoria, R. A.
- Affiliations
- The University of Texas at Austin (US)
- ORCID
- Whaley, Arthur L.
- Venue
- The Journal of Social Psychology
- Publisher
- Informa UK Limited
- Published
- 2009-02
- Volume
- 149
- Issue
- 1
- Pages
- 105-115
- ISSN
- 0022-4545 (ISSN-L)
- 1940-1183
- OpenAlex
- W1966896954
- Semantic Scholar
- 5f3f790fab3809fb9a636a8c02f9e2ebab3f8475
- Cited by
- 50
- References
- 18
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 3 · 2022: 2 · 2021: 5 · 2020: 1 · 2019: 5 · 2018: 4 · 2017: 7 · 2016: 3 · 2015: 7 · 2014: 1 · 2013: 3 · 2012: 2
- FWCI
- 2.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Social Psychology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Social Sciences › General Social Sciences › Q Methodology Applications
- Keywords
- card sorting, multidimensional scaling, data preparation, data organization, hypothesis verification
- MeSH terms
- Humans, Psychological Tests, Psychology, Social
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.