Cultural Variations in Human-AI Partnership: Initial Cross-Cultural Validation of the Transactive Memory System with GenAI (TMS-GenAI) Measurement Tool
Open accessThe DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
This study introduces and examines the Transactive Memory System with GenAI (TMS-GenAI) measurement tool, an instrument designed to capture transactive memory processes in human–AI partnership. Drawing from Transactive Memory System theory, Extended Mind theory, and Cognitive Self-Esteem, the tool encompasses six theoretically grounded dimensions: Ability to Think, Ability to Remember, Specialization, Coordination, Credibility, and Generative AI Offloading. Using exploratory factor analysis across culturally distinct samples (Turkiye, N=437; United States, N=476), we evaluated structural consistency and cultural divergence of these dimensions. Results indicate strong cross-cultural stability for self-evaluative and offloading constructs (Ability To Think, Ability to Remember, and Generative AI Offloading), alongside culturally specific structuring of teamwork-related dimensions. As the first phase of a multi-stage development process, this study provides foundational evidence for the TMS-GenAI measurement tool. Future research employing confirmatory factor analysis, measurement invariance testing, and item refinement will enable its progression into a validated scale. The findings offer practical insights for assessing human–AI partnership across educational, professional, and organizational contexts.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
An Index of Factorial Simplicity
Kaiser, H. F. (1974) · Psychometrika · doi:10.1007/bf02291575 · Cited by 14,898 · cited 3×
“According to Kaiser [32], KMO values above .90 are considered "marvelous" and strongly support the suitability of data for factor analysis.”
InfluentialWhat is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 2×
“These results indicate stable internal consistency, with somewhat lower reliability for the Credibility subscale, which is expected given its smaller number of items [14, 42].”
Hubert, L., & Arabie, P. (1985) · Journal of Classification · doi:10.1007/bf01908075 · Cited by 8,219
Clark, A., & Chalmers, D. (1998) · Analysis · doi:10.1093/analys/58.1.7 · Cited by 6,333 · cited 2×
“Extended Mind Theory posits that external devices can become part of an individual’s cognitive system if they are reliably accessible and regularly used [13].”
Sample size in factor analysis.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.1.84 · Cited by 5,497 · cited 5×
“Items with low communalities ( .20) or high cross-loadings were considered for removal, following standard psychometric guidelines [45, 60].”
InfluentialApplied multivariate statistics for the social sciences
Stevens, J. P., & Stevens, J. P. (2001) · doi:10.4324/9781410604491 · Cited by 4,993
Putnick, D. L., & Bornstein, M. H. (2016) · Developmental Review · doi:10.1016/j.dr.2016.06.004 · Cited by 4,369 · cited 5×
“All analyses were conducted in SPSS 28.0 (IBM Corp.) and cross-verified for consistency with recommended practices in factor analysis and measurement invariance research [50].”
InfluentialTransactive Memory: A Contemporary Analysis of the Group Mind
Wegner, D. M. (1987) · Theories of Group Behavior · doi:10.1007/978-1-4612-4634-3_9 · Cited by 2,700 · cited 5×
“A particularly novel contribution of this research lies in the empirical validation of the TMS-GenAI measurement tool, which adapts and extends classic TMS theory [39, 65] to the context of human–AI partnership in diverse fields.”
InfluentialTeacher Technology Change: How Knowledge, Confidence, Beliefs, and Culture Intersect
Ertmer, P. A., & Ottenbreit-Leftwich, A. T. (2010) · Journal of Research on Technology in Education · doi:10.1080/15391523.2010.10782551 · Cited by 2,556
The Teaching Gap: Best Ideas from the World's Teachers for Improving Education in the Classroom
(2000) · Journal of Curriculum Studies · doi:10.1080/00220270050167215 · Cited by 2,546
Risko, E. F., & Gilbert, S. J. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.07.002 · Cited by 1,502 · cited 1×
“Cognitive offloading—the strategic externalization of cognitive tasks to reduce internal processing demands [51]—provides the mechanism through which individuals may establish transactive memory relationships with external systems.”
Surfing Uncertainty: Prediction, Action, and the Embodied Mind
Clark, A. (2016) · doi:10.1093/acprof:oso/9780190217013.001.0001 · Cited by 1,358
Tucker's Congruence Coefficient as a Meaningful Index of Factor Similarity
Lorenzo-Seva, U., & ten Berge, J. M. F. (2006) · Methodology · doi:10.1027/1614-2241.2.2.57 · Cited by 1,115 · cited 3×
“Tucker’s coefficient provides a quantitative measure of similarity between matched factors; values above .85 indicate fair similarity and above .95 indicate near identity [43].”
InfluentialMeasuring transactive memory systems in the field: Scale development and validation.
Lewis, K. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.4.587 · Cited by 1,114 · cited 5×
“A particularly novel contribution of this research lies in the empirical validation of the TMS-GenAI measurement tool, which adapts and extends classic TMS theory [39, 65] to the context of human–AI partnership in diverse fields.”
InfluentialThe media and the literacies: media literacy, information literacy, digital literacy
Koltay, T. (2011) · Media, Culture & Society · doi:10.1177/0163443710393382 · Cited by 796
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
In Search of East Asian Self-Enhancement
Heine, S. J., & Hamamura, T. (2007) · Personality and Social Psychology Review · doi:10.1177/1088868306294587 · Cited by 590 · cited 4×
“Cross-cultural psychology research has shown that trust, cognitive self-perceptions, and collaboration styles vary significantly across cultural contexts [24, 25], potentially affecting how TMS manifests in AI-supported environments.”
InfluentialGovernance of artificial intelligence
Taeihagh, A. (2021) · Policy and Society · doi:10.1080/14494035.2021.1928377 · Cited by 562 · cited 1×
“While our tool focuses on individual-level dynamics, we recognize that human-AI collaboration operates within broader organizational contexts that include governance structures, accountability frameworks, and collective oversight mechanisms [9, 10, 30, 55–57 , 61 ].”
Understanding and Improving Teamwork in Organizations: A Scientifically Based Practical Guide
Salas, E., Shuffler, M. L., Thayer, A. L., Bedwell, W. L., & Lazzara, E. H. (2015) · Human Resource Management · doi:10.1002/hrm.21628 · Cited by 528 · cited 1×
“These adaptations were informed by recent research in educational technology and human–AI collaboration [12, 18, 46, 53].”
Lee, H.-P. (., Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713778 · Cited by 490
Transactive Memory Systems: Current Issues and Future Research Directions
Lewis, K., & Herndon, B. (2011) · Organization Science · doi:10.1287/orsc.1110.0647 · Cited by 451 · cited 1×
“This focus is grounded in extensive prior work conceptualizing transactive memory as individual cognitive and interpersonal processes [40, 65].”
Human-Centered Artificial Intelligence: Three Fresh Ideas
University of Maryland, C. P., & Shneiderman, B. (2020) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00131 · Cited by 421
Camilleri, M. A. (2024) · Expert Systems · doi:10.1111/exsy.13406 · Cited by 331
OECD Skills Strategy 2019: Skills to Shape a Better Future
OECD (2019) · OECD eBooks · doi:10.1787/9789264313835-en · Cited by 241
Designing the Intelligent Organization: Six Principles for Human-AI Collaboration
Kolbjørnsrud, V. (2023) · California Management Review · doi:10.1177/00081256231211020 · Cited by 202
Leichtmann, B., Humer, C., Hinterreiter, A., Streit, M., & Mara, M. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107539 · Cited by 200
Peltokorpi, V. (2008) · Review of General Psychology · doi:10.1037/1089-2680.12.4.378 · Cited by 194 · cited 4×
“These components have been extensively validated in human teams [39, 49], but their extension to human-AI partnership requires understanding how individuals decide to externalize cognitive work to technological agents.”
InfluentialWhat Explains Teachers’ Trust in AI in Education Across Six Countries?
Viberg, O., Cukurova, M., Feldman-Maggor, Y., Alexandron, G., Shirai, S., Kanemune, S., Wasson, B., Tømte, C., Spikol, D., Milrad, M., et al. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00433-x · Cited by 179
Extending Minds with Generative AI
Clark, A. (2025) · Nature Communications · doi:10.1038/s41467-025-59906-9 · Cited by 171
Black, R. W., & Tomlinson, B. (2025) · Scientific Reports · doi:10.1038/s41598-025-92937-2 · Cited by 163
Communicating the cultural other: trust and bias in generative AI and large language models
Jenks, C. J. (2024) · Applied Linguistics Review · doi:10.1515/applirev-2024-0196 · Cited by 116
An Introduction to Psychological Tests and Scales
Kate, M. L., & Christopher, A. L. (2020) · Routledge eBooks · doi:10.4324/9781315561387 · Cited by 84
Fostering Collective Intelligence in Human–AI Collaboration: Laying the Groundwork for COHUMAIN
Gupta, P., Nguyen, T. N., Gonzalez, C., & Woolley, A. W. (2025) · Topics in Cognitive Science · doi:10.1111/tops.12679 · Cited by 78
Interface and interaction design: How mobile touch devices foster cognitive offloading
Grinschgl, S., Meyerhoff, H. S., & Papenmeier, F. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106317 · Cited by 61 · cited 2×
“This principle extends to interaction modalities: research demonstrates that touch-based interactions, perceived as more intuitive than mouse-based inputs, increase cognitive offloading tendencies precisely because they reduce the cognitive cost of accessing external information [21].”
Baron, S. (2025) · Philosophy & Technology · doi:10.1007/s13347-024-00837-6 · Cited by 53
AI Trust: Can Explainable AI Enhance Warranted Trust?
de Brito Duarte, R., Correia, F., Arriaga, P., & Paiva, A. (2023) · Human Behavior and Emerging Technologies · doi:10.1155/2023/4637678 · Cited by 52
Carter, D. (2020) · Business Information Review · doi:10.1177/0266382120923962 · Cited by 51
Wahn, B., Schmitz, L., Gerster, F. N., & Weiss, M. (2023) · PLOS ONE · doi:10.1371/journal.pone.0286102 · Cited by 49
Transactive memory in trauma resuscitation
Sarcevic, A., Marsic, I., Lesk, M., & Burd, R. S. (2008) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/1460563.1460597 · Cited by 44 · cited 1×
“HCI enables this through interface features such as expertise directories, knowledge visualization tools, and transparent capability signaling [3, 23, 54].”
Three lines of defense against risks from AI
Schuett, J. (2025) · AI & SOCIETY · doi:10.1007/s00146-023-01811-0 · Cited by 41 · cited 1×
“While our tool focuses on individual-level dynamics, we recognize that human-AI collaboration operates within broader organizational contexts that include governance structures, accountability frameworks, and collective oversight mechanisms [9, 10, 30, 55–57 , 61 ].”
Evaluating Human-AI Collaboration: A Review and Methodological Framework
Fragiadakis, G., Diou, C., Kousiouris, G., & Νικολαϊδου, Μ. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.19098 · Cited by 41
Human-AI teaming: leveraging transactive memory and speaking up for enhanced team effectiveness
Bienefeld, N., Kolbe, M., Camen, G., Huser, D., & Buehler, P. K. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1208019 · Cited by 39
Understanding University Students’ Adoption of ChatGPT: Insights from TAM, SDT, and Beyond
Zogheib, S., & Zogheib, B. (2024) · Journal of Information Technology Education Research · doi:10.28945/5377 · Cited by 33 · cited 2×
“First, university students are among the earliest and active adopters of GenAI tools [7, 52, 67], providing rich natural variation in usage patterns, comfort levels, and partnership strategies with these technologies.”
Gauselmann, P., Runge, Y., Jilek, C., Frings, C., Maus, H., & Tempel, T. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2041882 · Cited by 31
Kang, S., Potinteu, A. E., & Said, N. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3720222 · Cited by 31
Gupta, P., & Woolley, A. W. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274331 · Cited by 29
Köse, N., Şimşek, E., & Demir, M. C. (2025) · Current Psychology · doi:10.1007/s12144-025-07418-6 · Cited by 27
The cross-cultural generalizability of cognitive ability measures: A systematic literature review.
Wilson, C. J., Bowden, S. C., Byrne, L. K., Joshua, N. R., Marx, W., & Weiss, L. G. (2023) · Intelligence · doi:10.1016/j.intell.2023.101751 · Cited by 20
Ehrhardt, N., Renn, M., & Utz, S. (2025) · AI & Society · doi:10.1007/s00146-025-02354-2 · Cited by 15
Assessing the Measurement Invariance of the Human–Computer Trust Scale
Beltrão, G., Sousa, S., & Lamas, D. (2025) · Electronics · doi:10.3390/electronics14091806 · Cited by 15
Hong, J. (2023) · Social Science Computer Review · doi:10.1177/08944393231167211 · Cited by 14
Agrawal, V., Kandul, S., Kneer, M., & Christen, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.15452 · Cited by 14
'Who Knows What': Audience Targeting for Question Asking on Facebook
Oeldorf-Hirsch, A., & Gergle, D. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3375191 · Cited by 13
Perceptions of the generative AI-enabled cognitive offload instruction in English writing
Hong, H., Vate-U-Lan, P., & Viriyavejakul, C. (2025) · International Journal of Evaluation and Research in Education (IJERE) · doi:10.11591/ijere.v14i3.33138 · Cited by 10
Liu, Y., Zhou, X., Liao, S., Liao, J., & Guo, Z. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16183390 · Cited by 9 · cited 1×
“The TMS-GenAI measurement tool is designed to capture trans-active memory processes at the individual level, examining how individuals form beliefs, trust, and patterns of task delegation within human-AI partnerships [39, 41, 49].”
Daga, M., Mohanty, P., Krishna, R., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.13495 · Cited by 3
Knowing Who Knows What: Designing Socially Assistive Robots with Transactive Memory SystemPreprint
Hu, Y., Stegner, L., & Mutlu, B. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.05115 · Cited by 1
Research works printed but not linked: 8
- Hossam Ali-Hassan and Dorit Nevo. 2016. How social media can enhance access to information through transactive memory development. AIS Transactions on Human-Computer Interaction 8 4 (2016) 185–212.
- Aras Bozkurt and Ramesh C Sharma. 2024. Trust credibility and transparency in human-AI interaction: Why we need explainable and trustworthy AI and why we need it now. Asian Journal of Distance Education 19 2 (2024).
- Institute of Internal Auditors. 2020. The IIA’s Three Lines Model: An Update of the Three Lines of Defense. Technical Report. The Institute of Internal Auditors. https://www.theiia.org/globalassets/documents/resources/the-iias-three-lines-model-an-update-of-the-three-lines-of-defense-july-2020/three-lines-model-updated-english.pdf Available at https://www.theiia.org/globalassets/documents/resources/the-iias-three-lines-model-an-update-of-the-three-lines-of-defense-july-2020/three-lines-model-updated-english.pdf.
- 10.1787/2e40fd2e-en · doi:10.1787/2e40fd2e-en
- Hui Rong and Charlene Chun. 2024. AI or Not AI: What Students Want. Global AI Student Survey. Digital Education Council, Digital Education Council. https://digitaleducationcouncil.com 3839 responses across 16 countries from bachelor, masters, and doctorate students.
- Ananya Singla, Alex Sukharevsky, Lareina Yee, Michael Chui, Bryce Hall, and Tara Balakrishnan. 2025. The State of AI: How Organizations Are Rewiring to Capture Value. Technical Report. McKinsey & Company. https://www.mckinsey.com/ /media/mckinsey/business%20functions/quantumblack/our%20insights/the%20state%20of%20ai/2025/the-state-of-ai-how-organizations-are-rewiring-to-capture-value_final.pdf
- Barbara G. Tabachnick and Linda S. Fidell. 2013. Using Multivariate Statistics (6th ed.). Pearson Education.
- Adrian F. Ward. 2013. One with the Cloud: Why People Mistake the Internet’s Knowledge for Their Own. Doctoral dissertation. Harvard University. http://nrs.harvard.edu/urn-3:HUL.InstRepos:11004901
Cited by
(2000) · Time to knit · doi:10.1145/3772318.3809037
Islam, M. T., Akgün, M., & Billah, S. M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29770-9_18
Self-citationRovetta, A., Bortolotti, A., & Berardino, C. D. (2026) · Frontiers in Organizational Psychology · doi:10.3389/forgp.2026.1941058
“…tasks involving newly composed human-AI teams (Bienefeld et al., 2023), exploratory cross-cultural self-report measurement at the individual level (Akgun and Toker, 2026), and multimodal modeling of specialization, credibility, and coordination in human-only teams ( Biancardi et al., 2024).”
Metadata
- Authors
- Akgun, M., & Toker, S.
- Affiliations
- College of Information Sciences and Technology, Pennsylvania State University, University Park, Pennsylvania, USA
- Information Systems Engineering, Atilim University, Ankara, Turkiye
- Venue
- Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2026-04-13
- Pages
- 1-18
- OpenAlex
- W7153994701
- Semantic Scholar
- 11a97bc6dcdcd4c8991bc47300eb12a9de63ecef
- Cited by
- 2
- References
- 50
- Citations by year
- 2026: 2
- FWCI
- 26.90
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Social Psychology › Team Dynamics and Performance
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- human-AI collaboration, transactive memory systems, generative AI, cross-cultural validation, scale development, cognitive offloading, extended mind, teamwork, cultural differences, scale validation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.