Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 84 of the 85 references it cites were found in a registry or an index; 5 of the 84 sources its claims cite were checked for support.

Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation

Open access
Kim, Soyoung, Priluck, Randi · 2025 · Journal of Theoretical and Applied Electronic Commerce Research

Abstract

This research examines differences in consumer responses to large language model AI chatbots versus search engines when reviewing and evaluating product information. The findings suggest that consumers prefer search engines over AI chatbots and are more willing to self-disclose their personal information to search engines due to perceived familiarity. However, consumers evaluate AI chatbot-based results as less biased than traditional search engine results.

Overview

CoChat Summary

TL;DR

In an online experiment comparing search engine versus AI chatbot results for a laptop search, consumers preferred search engines and were more willing to self-disclose personal information to them, driven by greater perceived familiarity. However, relationship quality moderated these effects, and consumers rated AI chatbot results as less biased than search engine results.

Key findings

  • Participants reported greater familiarity with search engine results (M = 5.58, SD = 1.33) than AI-generated results (M = 5.13, SD = 1.47; F(1, 208) = 5.63, p = 0.02, ηp² = 0.032).
  • Search preference was higher for the search engine (M = 3.50, SD = 0.95) than the AI chatbot (M = 3.24, SD = 1.09; F(1, 208) = 5.23, p = 0.023, ηp² = 0.03), and self-disclosure intention was higher for the search engine (M = 3.01, SD = 1.12) than the AI chatbot (M = 2.71, SD = 1.22; F(1, 208) = 3.78, p = 0.02, ηp² = 0.03).
  • Familiarity mediated both effects: indirect effect on search preference = −0.13 (95% CI: −0.255, −0.028) and on self-disclosure = −0.14 (95% CI: −0.266, −0.030).
  • Relationship quality moderated the mediation for search preference (95% CI: −0.099, −0.004; familiarity × relationship quality β = 0.07, SE = 0.03, t = 2.19, p = 0.03) and for self-disclosure (95% CI: −0.133, −0.015; β = 0.13, SE = 0.03, t = 3.48, p < 0.001). AI chatbot results were perceived as less biased than search engine results (M AI = 2.28, SD = 0.75 vs. M search engine = 2.54, SD = 0.87; F(1, 209) = 5.28, p = 0.02, ηp² = 0.03). All six hypotheses (H1–H6) were supported.

Methods

  • Quantitative experiment: participants imagined searching "buy a laptop" online and were randomly assigned to view either search engine results or AI chatbot results, with identical text and images across conditions and only the interface format differing.
  • Online survey distributed to students (N = 260) for partial course credit; those reporting attention of "very little" or "not at all" were excluded, leaving N = 211. Laptop purchase plan in the next year served as a covariate.
  • One-way ANOVAs tested main effects of information source on familiarity, search preference, self-disclosure intention, and bias perception; Process Model 4 tested mediation via familiarity and Process Model 15 tested moderated mediation with relationship quality as moderator (5000 bootstrap CIs). Harman's single-factor test was used to rule out common method bias.

Limitations

  • Stated: the sample focused on young adults (Gen Z) and students, may represent particular social classes, and skewed female, reducing response variability; the authors note Druckman and Kam's argument that student and non-student samples do not differ on many factors.
  • Stated: the controlled experiment used a static search engine results page versus a non-interactive AI chatbot page, a trade-off between internal and external validity that may limit real-world generalizability.
  • Stated: familiarity and self-disclosure were measured with single items; the authors defend this for unidimensional, well-defined constructs but recommend multi-item measures in future research.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3390/jtaer20020093

Cites

84 of 84 references verified0 citation errors · 0 not checkable

Statistics

4 tests recomputed · 0 with the reported and recomputed p on opposite sides of .05

Verification

Claims the paper makes

5 Valid · 2 Not valid · 54 Not checked · 60 Own results and interpretations

38 more claims

Create a free account to see all 121 claims and to verify the 6 references still open.

See all claims — free account
  • Probably not a substantial claim. 62
  • It may state two separate claims as one. 38
  • The quote only partly states this claim. 4

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistics that don’t add up

Each reported p-value recomputed from its test statistic and degrees of freedom.

1 of 1

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Doesn’t add upF(1, 208) = 3.78reported p = .02 · recomputed p = .053

    “F (1, 208) = 3.78, p = .02”

  • ConsistentF(1, 208) = 5.63reported p = .02 · recomputed p = .019

    “F (1, 208) = 5.63, p = .02”

  • ConsistentF(1, 208) = 5.23reported p = .023 · recomputed p = .023

    “F (1, 208) = 5.23, p = .023”

  • ConsistentF(1, 209) = 5.28reported p = .02 · recomputed p = .023

    “F (1, 209) = 5.28, p = .02”

4 of 4

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

5 of 5

Citations

Cites

Show all 85 references

Research works printed but not linked: 2

  1. Ghose, A., Impeirotis, P., and Li, B. (2012). Surviving Social Media Overload: Predicting Consumer Footprints on Product Search Engines. Workshop Inf. Syst. Econ. (WISE), 1–33.
  2. Derlega, V.J., Metts, S., Petronio, S., and Margulis, S.T. (1993). Self-Disclosure, Sage Publications, Inc.

Cited by

See all 20

Metadata

Authors
Kim, S., & Priluck, R.
Affiliations
Pace University (US)
Corresponding author
Kim, Soyoung
Venue
Journal of Theoretical and Applied Electronic Commerce Research
Publisher
MDPI AG
Published
2025-05-05
Volume
20
Issue
2
Pages
93
ISSN
0718-1876 (ISSN-L)
OpenAlex
W4410081533
Cited by
20
References
85
Citations by year
2026: 15 · 2025: 5
FWCI
7.99
Type
journal article
Language
en
Open access
Locations
  • Journal of theoretical and applied electronic commerce research (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
  • Social Sciences › Business, Management and Accounting › Marketing › Digital Marketing and Social Media
  • Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
Keywords
generative AI chatbots, search engines, product evaluation, information search, mere exposure effect, consumer-brand relationships, self-disclosure, perceived familiarity, search result bias, purchase decision, purchase decision process

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation. https://app.cochat.ai/papers/10.3390/jtaer20020093
The paper
Kim, S., & Priluck, R. (2025). Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation. Journal of Theoretical and Applied Electronic Commerce Research. https://doi.org/10.3390/jtaer20020093

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.