The Development and Validation of the Technology-Supported Reflection Inventory
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Reflection is an often addressed design goal in Human-Computer Interaction (HCI) research. An increasing number of artefacts for reflection have been developed in recent years. However, evaluating if and how an interactive technology helps a user reflect is still complex. This makes it difficult to compare artefacts (or prototypes) for reflection, impeding future design efforts. To address this issue, we developed the Technology-Supported Reflection Inventory (TSRI), which is a scale that evaluates how effectively a system supports reflection. We first created a list of possible scale items based on past work in defining reflection. The items were then reviewed by experts. Next, we performed exploratory factor analysis to reduce the scale to its final length of nine items. Subsequently, we confirmed test-retest validity of our instrument, as well as its construct validity. The TSRI enables researchers and practitioners to compare prototypes designed to support reflection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00149 · Cited by 5,925 · cited 3×
“There is no consensus over what metrics to use to test for test-retest reliability [7].”
BackgroundMethodInfluentialContent validity in psychological assessment: A functional approach to concepts and methods.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995) · Psychological Assessment · doi:10.1037//1040-3590.7.3.238 · Cited by 2,387
THE SELF-REFLECTION AND INSIGHT SCALE: A NEW MEASURE OF PRIVATE SELF-CONSCIOUSNESS
Grant, A. M., Franklin, J., & Langford, P. (2002) · Social Behavior and Personality: an international journal · doi:10.2224/sbp.2002.30.8.821 · Cited by 772 · cited 11×
“We conducted a Pearson ProductMoment correlation test to investigate if the TSRI was correlated with the SRIS.”
BackgroundMethodInfluentialReflecting on reflection: framing a design landscape
Fleck, R., & Fitzpatrick, G. (2010) · Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction · doi:10.1145/1952222.1952269 · Cited by 319 · cited 9×
“However, there is no consensus on the definition of reflection [5], and past research also used alternative definitions by Dewey [6, 8], Moon [10], Mezirow [18, 22, 30] and Boud [23].”
BackgroundMethodResultInfluentialReviewing reflection: on the use of reflection in interactive system design
Baumer, E. P. S., Khovanskaya, V., Matthews, M., Reynolds, L., Schwanda Sosik, V., & Gay, G. (2014) · Proceedings of the 2014 conference on Designing interactive systems · doi:10.1145/2598510.2598598 · Cited by 266 · cited 9×
“However, there is no consensus on the definition of reflection [5], and past research also used alternative definitions by Dewey [6, 8], Moon [10], Mezirow [18, 22, 30] and Boud [23].”
BackgroundMethodInfluentialEchoes from the past: how technology mediated reflection improves well-being
Isaacs, E., Konrad, A., Walendowski, A., Lennig, T., Hollis, V., & Whittaker, S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466137 · Cited by 251
Ayobi, A., Marshall, P., & Cox, A. L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376809 · Cited by 110 · cited 1×
“These design efforts span a wide spectrum of applications, including mental health [27], personal informatics [15], health [3, 4], as well as reflection on daily life [19].”
BackgroundPrescriptive persuasion and open-ended social awareness: expanding the design space of mobile health
Baumer, E. P. S., Katz, S. J., Freeman, J. E., Adams, P., Gonzales, A. L., Pollak, J., Retelny, D., Niederdeppe, J., Olson, C. M., & Gay, G. K. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145279 · Cited by 107 · cited 1×
“These design efforts span a wide spectrum of applications, including mental health [27], personal informatics [15], health [3, 4], as well as reflection on daily life [19].”
Background
Cited by
Revisiting Reflection in HCI: Four Design Resources for Technologies that Support Reflection
Bentvelzen, M., Woźniak, P. W., Herbes, P. S. F., Stefanidi, E., & Niess, J. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3517233 · Cited by 137
Self-citationTowards a Reflection in Creative Experience Questionnaire
Ford, C., & Bryan-Kinns, N. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581077 · Cited by 15
“[10] and the TSRI [8], calculating the Intra-cClass Correlation (ICC) coefficient for RiCE’s factors.”
Influential
Metadata
- Authors
- Bentvelzen, M., Niess, J., Woźniak, M. P., & Woźniak, P. W.
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-8
- OpenAlex
- W3143015243
- Cited by
- 68
- References
- 9
- FWCI
- 7.51
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.