The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
A New Era of Online Search? A Large-Scale Study of User Behavior and Personal Preferences during Practical Search Tasks with Generative AI versus Traditional Search Engines
Abstract
Generative AI chatbots like ChatGPT are emerging as popular alternatives to traditional search engines for finding information online. However, their impact on user behavior and experience in everyday tasks is still unclear. We conducted a large-scale study (n = 1,526) with a diverse U.S. sample, using a custom-build software to track participants’ behavior during practical search tasks with either ChatGPT or Google. ChatGPT users compared to Google users were faster and more likely to find the correct answers. Nevertheless, participants expressed a subjective preference for Google. Importantly, ChatGPT users relied significantly less on primary web sources, suggesting it is more often seen as a one-stop solution rather than a connective hub for information retrieval.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2012) · MIS Quarterly · doi:10.2307/41410412 · Cited by 15,756
Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., et al. (2025) · ACM Transactions on Information Systems · doi:10.1145/3703155 · Cited by 4,688
Roberts, B. W., Kuncel, N. R., Shiner, R., Caspi, A., & Goldberg, L. R. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00047.x · Cited by 2,361 · cited 2×
“Since neuroticism is associated with a general pessimistic outlook [18, 19], it stands to reason that people higher in neuroticism are less likely to be among early adopters for new technologies [2].”
Feuerriegel, S., Hartmann, J., Janiesch, C., & Zschech, P. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00834-7 · Cited by 2,267
Experimental evidence on the productivity effects of generative artificial intelligence
Noy, S., & Zhang, W. (2023) · Science · doi:10.1126/science.adh2586 · Cited by 2,150
Dell'Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4573321 · Cited by 794
Lebovitz, S., Lifshitz-Assaf, H., & Levina, N. (2022) · Organization Science · doi:10.1287/orsc.2021.1549 · Cited by 632 · cited 1×
“Although these risks are relatively low in consumer-oriented scenarios such as investigated in this study (e.g., shopping for a phone), the consequences could be more severe in domains requiring high-stakes decision-making, such as healthcare or finance [13].”
Five-factor model personality traits as predictors of perceived and actual usage of technology
Barnett, T., Pearson, A. W., Pearson, R., & Kellermanns, F. W. (2015) · European Journal of Information Systems · doi:10.1057/ejis.2014.10 · Cited by 281
The 10-Item Big Five Inventory
Rammstedt, B. (2007) · European Journal of Psychological Assessment · doi:10.1027/1015-5759.23.3.193 · Cited by 211
The Rapid Adoption of Generative AI
Bick, A., Blandin, A., & Deming, D. (2024) · NBER Working Paper · doi:10.3386/w32966 · Cited by 200
Research works printed but not linked: 2
- OpenAI. 2024. Introducing ChatGPT with Search. Retrieved January 21, 2025 from https://openai.com/index/introducing-chatgpt-search/
- Statista. 2023. Threads shoots past one million user mark at lightning speed. Retrieved January 21, 2025 from https://cdn.statcdn.com/Infographic/images/normal/29174.jpeg
Cited by
Haddad, D., Bareket, D., Chang, J. C., DeYoung, J., Hwang, J. D., Katz, U., Polak, M., Suh, S., Surana, H., Tiktinsky, A., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.23335 · Cited by 4
Bogers, T., Gäde, M., Hall, M. M., Koolen, M., Petras, V., & Skov, M. (2026) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3786304.3787864 · Cited by 1
The effects of goal-setting on learning during information seeking with generative AI
Urgo, K., Li, Y., Arguello, J., & Capra, R. (2026) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3786304.3788847
When Attention Becomes Exposure in Generative Search
Alipour, S., Kargar, M., & Zihayat, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21324-2_39 · Cited by 2
Are LLM Web Search Engines Sustainable? A Web-Measurement Study of Real-Time Fetching
Sayyid-Ali, A.-R. I., Khan, D. U., & Bhatti, N. A. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792278
Metadata
- Authors
- Kaiser, C., Kaiser, J., Schallner, R., & Schneider, S.
- Affiliations
- Nürnberg Institut für Marktentscheidungen e.V. (DE)
- Nuremberg Institute for Marker Decisions, Nuremberg, Germany
- Nuremberg Institute for Market Decisions, Nuremberg, Germany
- Management Center Innsbruck (AT)
- Venue
- Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2025-04-25
- Pages
- 1-7
- OpenAlex
- W4409720206
- Cited by
- 11
- References
- 24
- Citations by year
- 2026: 10 · 2025: 1
- FWCI
- 13.13
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- generative AI chatbots, ChatGPT, online search behavior, search engines, Google, user preferences, personality profiles, information retrieval, trust in AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A New Era of Online Search? A Large-Scale Study of User Behavior and Personal Preferences during Practical Search Tasks with Generative AI versus Traditional Search Engines. https://app.cochat.ai/papers/10.1145/3706599.3720123
- The paper
- Kaiser, C., Kaiser, J., Schallner, R., & Schneider, S. (2025). A New Era of Online Search? A Large-Scale Study of User Behavior and Personal Preferences during Practical Search Tasks with Generative AI versus Traditional Search Engines. Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3706599.3720123
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.