Fuzzy constructs in technology usage scales
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
The mass adoption of digital technologies raises questions about how they impact people and society. Associations between technology use and negative correlates (e.g., depression and anxiety) remain common. However, pre-registered studies have failed to replicate these findings. Regardless of direction, many designs rely on psychometric scales that claim to define and quantify a construct associated with technology engagement. These often suggest clinical manifestations present as disorders or addictions. Given their importance for research integrity, we consider what these scales might be measuring. Across three studies, we observe that many psychometric scales align with a single, identical construct despite claims they capture something unique. We conclude that many technology measures appear to measure a similar, poorly defined construct that sometimes overlaps with pre-existing measures of well-being. Social scientists should critically consider how they proceed methodologically and conceptually when developing psychometric scales in this domain to ensure research findings sit on solid foundations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Abdi, H., & Williams, L. J. (2010) · WIREs Computational Statistics · doi:10.1002/wics.101 · Cited by 11,104
On the Theory of Scales of Measurement
Stevens, S. S. (1946) · Science · doi:10.1126/science.103.2684.677 · Cited by 4,761
A “components” model of addiction within a biopsychosocial framework
Griffiths, M. (2005) · Journal of Substance Use · doi:10.1080/14659890500114359 · Cited by 3,088
Effect size guidelines for individual differences researchers
Gignac, G. E., & Szodorai, E. T. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2016.06.069 · Cited by 2,860
The Smartphone addiction scale: development and validation of a short version for adolescents
Kwon, M., Kim, D.-J., Cho, H., & Yang, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0083558 · Cited by 2,177
Andreassen, C. S., Billieux, J., Griffiths, M. D., Kuss, D. J., Demetrovics, Z., Mazzoni, E., & Pallesen, S. (2016) · Psychology of Addictive Behaviors · doi:10.1037/adb0000160 · Cited by 2,095
Development of a Facebook Addiction Scale
Andreassen, C. S., Torsheim, T., Brunborg, G. S., & Pallesen, S. (2012) · Psychological Reports · doi:10.2466/02.09.18.pr0.110.2.501-517 · Cited by 1,884
Development and Validation of a Smartphone Addiction Scale (SAS)
Kwon, M., Lee, J.-Y., Won, W.-Y., Park, J.-W., Min, J.-A., Hahn, C., Gu, X., Choi, J.-H., & Kim, D.-J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0056936 · Cited by 1,670
Objectifying content validity: Conducting a content validity study in social work research
Rubio, D. M., Berg-Weger, M., Tebb, S. S., Lee, E. S., & Rauch, S. (2003) · Social Work Research · doi:10.1093/swr/27.2.94 · Cited by 1,591
Psychological Predictors of Problem Mobile Phone Use
Bianchi, A., & Phillips, J. G. (2005) · CyberPsychology & Behavior · doi:10.1089/cpb.2005.8.39 · Cited by 1,514
The association between adolescent well-being and digital technology use
Orben, A., & Przybylski, A. K. (2019) · Nature Human Behaviour · doi:10.1038/s41562-018-0506-1 · Cited by 1,500
Online Social Network Site Addiction: A Comprehensive Review
Andreassen, C. S. (2015) · Current Addiction Reports · doi:10.1007/s40429-015-0056-9 · Cited by 1,212
Measuring DSM-5 Internet gaming disorder: Development and validation of a short psychometric scale
Pontes, H. M., & Griffiths, M. D. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.12.006 · Cited by 1,151
Ten Steps in Scale Development and Reporting: A Guide for Researchers
Carpenter, S. (2018) · Communication Methods and Measures · doi:10.1080/19312458.2017.1396583 · Cited by 1,141
Exploring the dimensions of nomophobia: Development and validation of a self-reported questionnaire
Yildirim, C., & Correia, A.-P. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.02.059 · Cited by 1,106
Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them
Flake, J. K., & Fried, E. I. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920952393 · Cited by 969
Parry, D. A., Davidson, B. I., Sewall, C. J. R., Fisher, J. T., Mieczkowski, H., & Quintana, D. S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01117-5 · Cited by 793
Self-citationThe Media and Technology Usage and Attitudes Scale: An empirical investigation
Rosen, L. D., Whaling, K., Carrier, L. M., Cheever, N. A., & Rokkum, J. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2013.06.006 · Cited by 788
Addiction: definition and implications
GOODMAN, A. (1990) · British Journal of Addiction · doi:10.1111/j.1360-0443.1990.tb01620.x · Cited by 766
The 52 symptoms of major depression: lack of content overlap among seven common depression scales
Fried, E. I. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.10.019 · Cited by 649
Using Principal Components and Factor Analysis in Animal Behaviour Research: Caveats and Guidelines
Budaev, S. V. (2010) · Ethology · doi:10.1111/j.1439-0310.2010.01758.x · Cited by 460
Beyond self-report: tools to compare estimated and real-world smartphone use
Andrews, S., Ellis, D. A., Shaw, H., & Piwek, L. (2015) · PLOS ONE · doi:10.1371/journal.pone.0139004 · Cited by 408
Self-citationRozgonjuk, D., Levine, J. C., Hall, B. J., & Elhai, J. D. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.05.019 · Cited by 327
Do smartphone usage scales predict behavior?
Ellis, D. A., Davidson, B. I., Shaw, H., & Geyer, K. (2019) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2019.05.004 · Cited by 326
Self-citationThe Sisyphean Cycle of Technology Panics
Orben, A. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620919372 · Cited by 316
Ellis, D. A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.03.006 · Cited by 186
Self-citationRosen, L., Carrier, L. M., Miller, A., Rokkum, J., & Ruiz, A. (2016) · Sleep Health · doi:10.1016/j.sleh.2015.11.003 · Cited by 157
Sewall, C. J. R., Bear, T. M., Merranko, J., & Rosen, D. (2020) · Mobile Media & Communication · doi:10.1177/2050157920902830 · Cited by 139
Quantifying smartphone ‘use’: Choice of measurement impacts relationships between ‘usage’ and health
Shaw, H., Ellis, D. A., Geyer, K., Davidson, B. I., Ziegler, F. V., & Smith, A. (2020) · doi:10.31234/osf.io/mpxra · Cited by 59
Self-citationMieczkowski, H., Lee, A. Y., & Hancock, J. T. (2020) · Social Media + Society · doi:10.1177/2056305120961784 · Cited by 50
Cited by
Parry, D. A., Davidson, B. I., Sewall, C. J. R., Fisher, J. T., Mieczkowski, H., & Quintana, D. S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01117-5 · Cited by 793
Self-citationMechanisms linking social media use to adolescent mental health vulnerability
Orben, A., Meier, A., Dalgleish, T., & Blakemore, S.-J. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00307-y · Cited by 220
How students' self-control and smartphone-use explain their academic performance
Troll, E. S., Friese, M., & Loschelder, D. D. (2020) · doi:10.31234/osf.io/27stp · Cited by 107
Quantifying smartphone ‘use’: Choice of measurement impacts relationships between ‘usage’ and health
Shaw, H., Ellis, D. A., Geyer, K., Davidson, B. I., Ziegler, F. V., & Smith, A. (2020) · doi:10.31234/osf.io/mpxra · Cited by 59
Self-citationSepas, A., Bangash, A. H., Nielsen, R. E., Yang, W., & El-Hussuna, A. (2024) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2023.0222 · Cited by 9
Metadata
- Authors
- Davidson, B. I., Shaw, H., & Ellis, D. A.
- Venue
- Computers in Human Behavior
- Publisher
- Elsevier BV
- Published
- 2022-08
- Volume
- 133
- Pages
- 107206
- ISSN
- 0747-5632 (ISSN-L)
- OpenAlex
- W4210444898
- Cited by
- 57
- References
- 31
- FWCI
- 14.70
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.