PreprintCited by 0Ethics and Social Impacts of AIDigital Marketing and Social MediaInformation Retrieval and Search Behavior

A Cue's Hidden Price: Auditing Seller Influence on AI Shoppers

Open access
Buecheler, Felix, Berbeglia, Gerardo, Guo, Mingyu·2026·arXiv

Abstract

Large language models are increasingly asked to shop on a user's behalf, which lets seller-controlled content such as badges, endorsements, and framing steer what they recommend. That poses the question at the core of generative engine optimization (GEO): not whether seller content shifts an agent's choice, but how much. The usual gauge of that influence, how often a cue wins the choice, has a blind spot: once a cue is strong enough to be picked almost every time, the choice rate can no longer show how much stronger one cue is than another. We introduce price-equivalent (PE) auditing, which removes this ceiling by pricing the cue in money. In a counterbalanced, position-controlled forced choice, we raise the cued product's price until it is chosen only half the time, and report that premium as the cue's price-equivalent: a formally defined, policy-conditioned parity threshold that makes very different cues comparable. Priced this way, cues that look equally strong at equal price differ by a wide margin, so choice-rate audits substantially under-resolve seller influence. We run the audit over 113,472 trials, seven models across families, and two product categories. To our knowledge, we also run the first price-equivalent audit of a decision-native model, Jev, which outputs a choice probability directly instead of generating text; strikingly, its profile is unlike any text model we tested, resisting most cues yet remaining susceptible to the strongest social-proof claims. We release the stimuli, logs, and code as a benchmark that reports each model's cue-price profile rather than a single score, giving developers and auditors a common, reproducible way to measure how content moves AI shopping agents.

AI snapshot

Written from the paper’s full text.

TL;DR

The paper introduces price-equivalent (PE) auditing, which prices seller-controlled cues by raising the cued product’s price until it is chosen only half the time, yielding a money-denominated parity threshold. Across 113,472 trials, seven models, and two categories, equal-price choice rates saturate and under-resolve cue influence, while PE reveals selective, model-specific susceptibility profiles.

Key findings

  • Six cue conditions are chosen in at least 95% of equal-price trials yet their price-equivalents span 1.6% to 21.4%; scarcity is chosen more often than gain/loss framing (0.95 vs. 0.72) but commands a fourteen-times-smaller premium (1.6% vs. 22.3%), reversing the equal-price ranking.
  • On GPT-4o headphones, social proof shows a monotonic dose-response: weak 0.7%, moderate 1.3%, strong 12.9%, very strong 21.4%; authority ≈19.8%, gain/loss framing ≈22.3%, scarcity 1.6%, and number-preserving reformatting ≈0%.
  • The first-presented option is chosen in 56.3% of trials overall (n = 14,976), rising to ≈65% in low-signal conditions; the cue-free first-slot premium is at most 3.2% on price-sensitive models, 14.0% on GPT-4o mini, and beyond 80% on Nova Micro and Llama-3.1-8B.
  • The decision-native model Jev replicates the equal-price ceiling but has a distinct profile: very strong social proof 15.4%, authority 1.5%, gain/loss framing 0.0%; PE-guided selection of the top of nine cues beats the mean by +13.3 percentage points (95% CI [8.7, 17.8]).

Methods

  • Two-alternative forced choice between matched product pairs, one carrying a cue; the cued product’s price is raised across eight premia (0, 2, 4, 6, 8, 12, 18, 26%), and PE is the premium at which the cued product’s selection share falls to 0.5. Position and cue target are counterbalanced within every (pair, price-point) cell; N = 24 repetitions per cell; six pairs per category (headphones, coffee machines); total 113,472 trials.
  • Eight LLMs from four providers are audited as strong/weak pairs, with GPT-4o as the reference model; Nova Pro is excluded for a 21% non-response rate, and Llama-3.1-8B is excluded from cross-model claims for being position-driven, leaving six task-engaged models. Jev is audited separately with the same protocol (49,824 queries).
  • The primary estimator is model-free, locating the 0.5 crossing by linear interpolation, with pair-clustered bootstrap 95% CIs; a cue-free price-only control calibrates price sensitivity, and a primacy diagnostic guards choice-based readings. Robustness checks include four task paraphrases and a length-matched 2³ additivity factorial.

Limitations

  • The paper states that the audit is a synthetic two-alternative forced choice, not a live shopping environment; the “non-human” characterization is a contrast with the human-persuasion literature, not a matched human baseline. Each construct is tested in a single formulation, especially one scarcity sentence, so the low scarcity PE should be read as low for that formulation, not immunity. PE combines cue pull with price sensitivity, so cross-model magnitudes conflate the two; price-insensitive models have unidentified PEs, and several cues are censored at the top of the sweep. The composition test covers one model and one cue per family.
  • The paper also states that the headline trial count is not independent product-level observations because each condition repeats only six product pairs; two consumer-electronics categories give initial cross-category evidence but leave structurally different domains untested; four prompt paraphrases give limited robustness; and the audited models are a diverse convenience sample, not a random draw. With only six pair-clusters, confidence intervals may understate broader product-level uncertainty.
  • Evident from the text: PE is prompt-conditional and not economic willingness to pay; Jev’s prices depend on input format, and its length/presence controls do not transfer; under vision, near-deterministic primacy prevents identifying an image cue’s PE.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2610.25843

Cites

0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 38 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    The same pricing turns the well-documented first-option (primacy) bias from a nuisance into a priced channel that the platform controls.

    “The same pricing turns the welldocumented first-option (primacy) bias from a nuisance into a priced channel that the platform controls.”
    Quote in the paperSubstantial claim
  • Findingown data

    A single equal-price rate loses the sixfold difference between the neutral sentence and social proof.

    “A single equal-price rate loses this sixfold difference (Figure 2).”
    Quote in the paperSubstantial claim
  • Findingown data

    Across 113,472 trials, seven models, and two categories, a price axis resolves what an equal-price choice rate cannot.

    “Across 113,472 trials, seven models, and two categories, a price axis resolves what an equal-price choice rate cannot.”
    Quote in the paperSubstantial claim
  • Findingown data

    Gain/loss differs already at equal price, from immune (Llama-3.3-70B, 0.50) to strong (Nova Micro, 0.97).

    “Gain/loss, by contrast, differs already at equal price, from immune (Llama-3.3-70B,0.50) to strong (Nova Micro, 0.97).”
    Quote in the paperSubstantial claim
  • Findingown data

    Four prompt paraphrases give limited robustness across task wording (the social-proof intensity ordering is preserved, while absolute magnitudes drift a few points).

    “Four prompt paraphrases give limited robustness across task wording (the social-proof intensity ordering is preserved, while absolute magnitudes drift a few points).”
    Quote in the paperNot a substantial claim
  • May combine two claims. 135
  • The quote only partly states this claim. 3
  • Classified as probably not a substantial claim. 68
  • May combine two claims.

    Findingown data

    At equal price the agent chose the strong social-proof product in 100% of trials (144/144), and kept choosing it well into the positive-premium range.

    “At equal price the agent chose the strong social-proof product in 100% of trials (144/144), and kept choosing it well into the positivepremium range.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Jev, a decision-native model, has a profile unlike any text model tested: it resists most cues yet remains susceptible to the strongest social-proof claims.

    “strikingly, its profile is unlike any text model we tested, resisting most cues yet remaining susceptible to the strongest social-proof claims.”
    • Also stated in: § 1 Introduction · plain
      “Jev also shows a susceptibility profile of its own: it resists most cues but is moved by the strongest social-proof claims (Section 4.7).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The resulting susceptibility profile is selective and model-specific, and it replicates in a second category.

    “The resulting susceptibility profile is selective and model-specific, and it replicates in a second category.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Priced this way, cues that look equally strong at equal price differ by a wide margin, so choice-rate audits substantially under-resolve seller influence.

    “Priced this way, cues that look equally strong at equal price differ by a wide margin, so choice-rate audits substantially under-resolve seller influence.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Six conditions share S_Q(0) ≥ 0.95, yet their price-equivalents differ by an order of magnitude: equal selection share at g=0, very different price.

    “In the notation of Section 3.1, these conditions share 𝑆 𝑄 (0) ≥ 0.95, yet their price-equivalents PE 𝑄 differ by an order of magnitude: equal selection share at 𝑔=0, very different price.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Scarcity is chosen more often at equal price (0.95) than a gain/loss framing (0.72), yet its premium is fourteen times smaller (1.6% vs. 22.3%, disjoint intervals).

    “Scarcity is chosen more often at equal price (0.95) than a gain/loss framing (0.72), yet its premium is fourteen times smaller (1.6% vs. 22.3%, disjoint intervals).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    A strong social-proof cue and a neutral factual sentence are each chosen in approximately 100% of trials at equal price, so they are indistinguishable at the ceiling.

    “A strong social-proof cue and a neutral factual sentence are each chosen in ≈ 100% of trials at equal price, so they are indistinguishable at the ceiling.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The strong social-proof cue's price-equivalent is approximately 13% (approximately $17 on a $130 item); the model-free estimator gives 12.9% (CI [10.9, 17.1]).

    “Its price-equivalent is ≈ 13% (≈ $17 on a $130 item): the model-free estimator gives 12.9% (CI [10.9, 17.1]).”
    Quote in the paperSubstantial claim
  • May combine two claims. The quote only partly states this claim.

    Findingown data

    The equal-price ceiling and its resolution by price reappear in Jev, so they are not artifacts of text generation.

    “The equal-price ceiling and its resolution by price reappear, so they are not artifacts of text generation.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The price sweep separates the neutral sentence from social proof: the neutral sentence is abandoned almost immediately (approximately 2% premium), while social proof holds to approximately 13%.

    “The neutral sentence is abandoned almost immediately (≈ 2% premium), while social proof holds to ≈ 13%.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Six cue conditions are each chosen in at least 95% of trials and are indistinguishable at equal price, yet their price-equivalents range from 1.6% to 21.4%.

    “Six cue conditions are each chosen in at least 95% of trials and are thus indistinguishable at equal price, yet their price-equivalents range from 1.6% to 21.4%.”
    • Also stated in: § 4.1 A cue's price, and why a choice rate under-resolves it · plain
      “Six conditions sit at a base rate of 0.95 or above and are thus indistinguishable on the conventional axis.Priced, they span nearly 20 percentage points, from 1.6% to 21.4%.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The equal-price ranking can invert: gain/loss framing commands one of the largest premiums but is chosen less often than scarcity.

    “The equal-price ranking can even invert: gain/loss framing commands one of the largest premiums but is chosen less often than scarcity.”
    • Also stated in: § 4.1 A cue's price, and why a choice rate under-resolves it · plain
      “Scarcity is chosen more often at equal price (0.95) than a gain/loss framing (0.72), yet its premium is fourteen times smaller (1.6% vs. 22.3%, disjoint intervals).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Framing shows a clean dissociation: the agent is indifferent to number-preserving reformatting (a rescaled rating and a percent-vs-fraction restatement, both approximately 0%), yet it is strongly swayed by a gain/loss framing of the same fact (approximately 22%).

    “Framing shows a clean dissociation.The agent is indifferent to number-preserving reformatting (a rescaled rating and a percent-vs-fraction restatement, both ≈ 0%), yet it is strongly swayed by a gain/loss framing of the same fact (≈ 22%).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Reframing identical information has a sharply content-dependent effect: the agent is indifferent to number-preserving reformatting (a rescaled rating and a percent-vs-fraction restatement both cross parity at approximately 0%) yet strongly swayed by a gain/loss framing of the same fact.

    “Reframing identical information has a sharply content-dependent effect (Table 22).The agent is indifferent to number-preserving reformatting (a rescaled rating and a percent-vs-fraction restatement both cross parity at ≈ 0%) yet strongly swayed by a gain/loss framing of the same fact.Only the gain/loss valence moves the agent.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
    • Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
  • May combine two claims.

    Findingown data

    Across six product pairs, no interaction is detectable, neither pairwise nor three-way.

    “Across six product pairs, no interaction is detectable, neither pairwise nor three-way.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Price sensitivity varies markedly: GPT-4o, Claude Sonnet, and Llama-3.3-70B abandon the pricier of two identical products almost completely by a +10% gap (P ≤ 0.01; and exactly 0.50 at equal price, confirming the design is unbiased), GPT-4o mini and Haiku do so gradually, and Nova Micro and the position-driven Llama-3.1-8B barely respond to price at all.

    “Price sensitivity varies markedly: GPT-4o, Claude Sonnet, and Llama-3.3-70Babandon the pricier of two identical products almost completely by a +10% gap (𝑃 ≤ 0.01; and exactly 0.50 at equal price, confirming the design is unbiased), GPT-4o mini and Haiku do so gradually, and Nova Micro and the position-driven Llama-3.1-8Bbarely respond to price at all.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Two things are less stable than for GPT-4o: weak social proof outprices moderate social proof under every phrasing (0.4-1.0 vs. 0.0-0.6%), and the strong cues drift more (1.8-7.0% for strong, 14.2 to beyond 26% for very strong social proof, against 10.2-17.7 and 16.4-24.7% for GPT-4o).

    “Two things are less stable than for GPT-4o (Table 20): weak social proof outprices moderate social proof under every phrasing (0.4-1.0 vs. 0.0-0.6%),and the strong cues drift more (1.8-7.0%for strong, 14.2 to beyond 26% for very strong social proof, against 10.2-17.7 and 16.4-24.7%for GPT-4o).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Table 20

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    For scarcity, the slot-specific crossings are 6.1% and 0.9% (mean 3.5%), while the pooled PE is 1.6%.

    “For scarcity, the slot-specific crossings are 6.1% and 0.9% (mean 3.5%), while the pooled PE is 1.6% (Table 5).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The ceiling replicates, but the profile does not.

    “The ceiling replicates, but the profile does not.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingcitation

    The filler sentence of Jev's length-matched control is itself dispreferred, so that control does not transfer.

    “In addition, the filler sentence of its length-matched control is itself dispreferred, so that control does not transfer (Appendix K).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Appendix K

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    Nova Micro keeps choosing the cued product at more than double the price (an extended sweep to +110%); its PE is therefore not identified, and its apparent susceptibility is price-insensitivity.

    “Nova Micro keeps choosing the cued product at more than double the price (an extended sweep to +110%).Its PE is therefore not identified, and its apparent susceptibility is price-insensitivity.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingnone given

    In the price-only control, for the vacuous claim, and for percent/fraction and gain/loss framing Jev chooses the first card in every equal-price trial and the second in none.

    “In the price-only control, for the vacuous claim, and for percent/fraction and gain/loss framing Jev chooses the first card in every equal-price trial and the second in none.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Reading the cue-free price-only control per position, at equal price the first slot sits at the choice-rate ceiling on every model, yet its price is gated by price sensitivity exactly as PE is.

    “We read the cue-free price-only control per position.At equal price, the first slot sits at the choicerate ceiling on every model, yet its price is gated by price sensitivity exactly as PE is.”
    Quote in the paperSubstantial claim
  • May combine two claims. The quote only partly states this claim.

    Findingnone given

    Number-preserving reformatting is not neutral: Jev dislikes '4.8 out of 5' against '9.6 out of 10' (base rates 0.21 and 0.42).

    “Number-preserving reformatting is not neutral either: Jev dislikes”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Very strong social proof holds beyond 26% when shown first but crosses at 4.2 and 1.8% when shown second; for strong social proof the slot-specific crossings are 10.3 versus 1.2% (headphones), against 16.2 versus 10.1% for GPT-4o.

    “Very strong social proof holds beyond 26% when shown first but crosses at 4.2 and 1.8% when shown second; for strong social proof the slot-specific crossings are 10.3 versus 1.2% (headphones), against 16.2 versus 10.1% for GPT-4o (Table 5).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Table 5

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    Across the six task-engaged models, the social-proof series keeps its step pattern: the weak and moderate tiers stay at or below 4%, and at least one strong tier lies clearly above them.

    “Across these six, the social-proof series keeps its step pattern: the weak and moderate tiers stay at or below 4%, and at least one strong tier lies clearly above them (Table 4).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The same authority sentence naming an irrelevant domain is nearly inert (approximately 1.9%), whereas a domain-matched version commands the full approximately 22%.

    “The same authority sentence naming an irrelevant domain (”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Social proof switches on only at the very strong claim (15.4%), authority is worth little (1.5% against 19.8% for GPT-4o), and gain/loss framing is worth nothing.

    “Social proof switches on only at the very strong claim (15.4%), authority is worth little (1.5% against 19.8% for GPT-4o), and gain/loss framing is worth nothing.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The dose-response, the gain/loss framing, the length and presence controls, the inert scarcity cue, and the null number-preserving framings all track their headphone values.

    “The dose-response, the gain/loss framing, the length and presence controls, the inert scarcity cue, and the null number-preserving framings all track their headphone values (Table 3).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Under four task phrasings the cue ranking is stable, but the strong cues drift more than for GPT-4o.

    “Under four task phrasings the cue ranking is stable, but the strong cues drift more than for GPT-4o (Appendix J).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Appendix J

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    The cued-first crossing is uniformly higher than the cued-second crossing, adding a real per-trial advantage, while the two orders preserve the cue ordering and bracket the counterbalanced pooled value.

    “The cued-first crossing is uniformly higher than the cued-second crossing-position adds a real per-trial advantage-but the two are consistent: they preserve the cue ordering and bracket the counterbalanced pooled value.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
    • Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
  • May combine two claims.

    Findingown data

    Under vision, primacy bias becomes near-deterministic: at equal price the agent chooses the first option in 100% of trials, so P(choose cued) is 0.50 for every pair by construction, relaxing only as price diverges; that it responds to price at all confirms it reads the rendered cards.

    “Under vision the primacy bias becomes near-deterministic: at equal price the agent chooses the first option in 100% of trials, so 𝑃 (choose cued) is 0.50 for every pair by construction, relaxing only as price diverges (Table 23); that it responds to price at all confirms it reads the rendered cards.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
  • Classified as probably not a substantial claim.

    Findingnone given

    Four cues (strong, very strong, and length-matched social proof, and authority) are chosen in every equal-price trial in both categories.

    “Four cues (strong, very strong, and length-matched social proof, and authority) are chosen in every equal-price trial in both categories.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Jev's prices depend on its input format: an earlier run that passed the same cards as a structured object with slot-named options gave strong social proof 10.8% on headphones and more than 26% on coffee machines, against 2.0 and 1.6% with the chat prompt.

    “Second, Jev's prices depend on its input format: an earlier run that passed the same cards as a structured object with slot-named options gave strong social proof 10.8% on headphones and more than 26% on coffee machines, against 2.0 and 1.6% with the chat prompt.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Jev's social-proof series switches on only at the very strong claim (0.5, 0.0, 2.0, and 15.4% on headphones, against GPT-4o's 0.7, 1.3, 12.9, and 21.4%); authority is worth little (1.5 and 1.2% against 19.8 and 21.6%), and gain/loss framing nothing.

    “Jev's social-proof series switches on only at the very strong claim (0.5, 0.0, 2.0, and 15.4% on headphones, against GPT-4o's 0.7, 1.3, 12.9, and 21.4%); authority is worth little (1.5 and 1.2% against 19.8 and 21.6%), and gain/loss framing nothing.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The off-domain sentence 'recommended by audio experts' on a coffee machine is never chosen at equal price (0 of 144 trials), whereas GPT-4o treats it as nearly inert (1.9%).

    “The off-domain sentence”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Raw authority (1.6-19.8%) and gain/loss PEs (0-22.3%, beyond 110% on Nova Micro) look wildly model-specific.

    “Raw authority (1.6-19.8%)and gain/loss PEs (0-22.3%,beyond 110% on Nova Micro) look wildly model-specific.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Across the battery, the agent chooses the first option in 56.3% of trials (n = 14,976), rising to approximately 65% in low-signal conditions (one-sided cues with a PE below 3%).

    “Across the battery, it chooses the first option in 56.3% of trials (𝑛 = 14,976), rising to ≈ 65% in low-signal conditions (one-sided cues with a PE below 3%).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Combining cues is consistent with additivity: no interaction between cues was detectable.

    “Combining cues, by contrast, is consistent with additivity (Section 4.3, Appendix H): no interaction between cues was detectable”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Appendix H

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    The position channel is worth at most 3.2% on the price-sensitive models, 14.0% on GPT-4o mini, and beyond 80% on the price-blind Nova Micro and Llama-3.1-8B.

    “It is worth at most 3.2% on the price-sensitive models, 14.0% on GPT-4o mini, and beyond 80% on the price-blind Nova Micro and Llama-3.1-8B(Appendix D).”
    Quote in the paperSubstantial claim
  • May combine two claims. The quote only partly states this claim.

    Findingown data

    The length and presence controls do not transfer: the 'neutral' identification-code sentence is itself dispreferred by Jev (presence control, base rates 0.32 and 0.17), so the length-matched social-proof condition (16.6 and 19.6%) exceeds social proof alone (2.0 and 1.6%) instead of isolating its content.

    “First, the length and presence controls do not transfer: the”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    For the strong social-proof cue, the six per-pair price-equivalents are 10.2, 14.6, 10.0, 19.1, 11.2, and beyond 26 (no crossing), with a pooled value of 12.9%, showing real product heterogeneity around a stable pooled value.

    “For the strong social-proof cue the six per-pair price-equivalents are (GPT-4o, model-free, 𝑁 = 24 per price point): In-ear ANC ($89.99)10.2; On-ear ($79.99)14.6; Over-ear ANC ($129.99)10.0; Over-ear premium ($199.99)19.1; Sport earbuds ($59.99)11.2; Wired studio ($149.99)beyond 26 (no crossing); pooled 12.9%-real product heterogeneity around a stable pooled value”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
    • Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
  • May combine two claims.

    Findingown data

    For Nova Micro, censored at 26%, extending the cue sweep to +110% shows Nova Micro keeps choosing the cued product throughout, on a flat plateau near 0.7 that never crosses 0.5 even at more than double the price.

    “for Nova Micro, censored at 26%, we extend the cue sweep to +110%, and Nova Micro keeps choosing the cued product throughout, on a flat plateau near 0.7 that never crosses 0.5 even at more than double the price.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Models that do not respond to price even at large premiums have unidentified price-equivalents and are reported observationally, and several cues are censored at the top of the sweep (their true premia are lower bounds).

    “Models that do not respond to price even at large premiums have unidentified price-equivalents and are reported observationally, and several cues are censored at the top of the sweep (their true premia are lower bounds).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Weak and moderate social-proof claims sit near zero, and the premium switches on only at the strong claim.

    “Weak and moderate claims sit near zero, and the premium switches on only at the strong claim.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    At +10%, GPT-4o, Claude Sonnet, and Llama-3.3-70B almost never keep the pricier of two identical products, whereas Nova Micro does so about half the time.

    “At +10%, GPT-4o, Claude Sonnet, and Llama-3.3-70Balmost never keep the pricier of two identical products, whereas Nova Micro does so about half the time (column 𝑝 ↑ ; Appendix E).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Holding a product's facts and cues fixed, twelve truthful rewrites of one full description move GPT-4o's PE from 2.3% to 8.0% (disjoint intervals, single pair, N=30 per price point, logistic estimator).

    “Holding a product's facts and cues fixed, twelve truthful rewrites of one full description (strong social proof and scarcity woven in, LLMgenerated) move GPT-4o's PE from 2.3% to 8.0% (disjoint intervals, single pair, 𝑁 =30 per price point, logistic estimator).”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Stable audit environment: fixed model snapshot, prompt, decoding, and card template.
    • The authors state this as an assumption: Explicit comparator: the comparator content c0 is part of the estimand.
    • The authors state this as an assumption: Joint design control: the four (T,R) cells carry weight 1/4, exactly balanced in our data.
    • The authors state this as an assumption: Single crossing: S_Q is weakly decreasing over the search domain.
    • The authors state this as an assumption: Support: the price sweep brackets the crossing; otherwise a bound is reported.
    • The authors state this as an assumption: Local smoothness: the curve is approximately linear between the two bracketing grid points.
    • The authors state this as an assumption: Stable repeated sampling: no model drift during collection (Appendix O).
    • The authors state this as an assumption: Explicit population: the product distribution Q is part of the estimand.
    • The authors state this as an assumption: Forced-choice scope: the threshold pertains to the stated two-option protocol.
    • The authors state this as an assumption: Relative-price scale: PE is a proportional premium on the reference price.
  • May combine two claims.

    Findingown data

    The ordering of the four social-proof intensities is preserved across all four phrasings; the broader ranking is mostly stable but not exact-strong social proof (12.0% at v0) and gain/loss framing (17.2% at v0) exchange rank at v1 (17.7 vs. 14.0), and the neutral sentence drifts to 4.5% at v1 rather than sitting at the floor-and absolute magnitudes of the strong cues vary by a few points-up to ≈ 8

    “The ordering of the four social-proof intensities is preserved across all four phrasings; the broader ranking is mostly stable but not exact-strong social proof (12.0% at v0) and gain/loss framing (17.2% at v0) exchange rank at v1 (17.7 vs. 14.0), and the neutral sentence drifts to 4.5% at v1 rather than sitting at the floor-and absolute magnitudes of the strong cues vary by a few points-up to ≈ 8”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Table 19

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Figure 4

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    Under vision the bias becomes near-deterministic, which prevents identifying an image cue's PE.

    “Under vision the bias becomes near-deterministic, which prevents identifying an image cue's PE (Appendix M).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The no-interaction result holds on the log-odds scale (no term survives Holm correction) and on the price scale (contrasts within a few points, all CIs spanning zero).

    “This holds on the log-odds scale , no term survives Holm correction [14]) and on the price scale (contrasts within a few points, all CIs spanning zero).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [14]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    No term in the length-matched 2^3 factorial is significant after Holm correction on the log-odds scale, and every price-scale contrast is within a few points with a CI spanning zero; combined influence is consistent with additivity at our precision.

    “No term is significant after Holm correction on the log-odds scale, and every price-scale contrast is within a few points with a CI spanning zero: combined influence is consistent with additivity at our precision.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
    • Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
  • May combine two claims.

    Findingown data

    At equal price, GPT-4o and GPT-4o mini prefer the scarcity-marked product (base rates 0.95 and 0.88), whereas Claude Sonnet finds it aversive (0.19, PE at most 0).

    “Yet at equal price, GPT-4o and GPT-4o mini prefer the scarcity-marked product (base rates 0.95 and 0.88), whereas Claude Sonnet finds it aversive (0.19, PE at most 0).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The weak, moderate, and strong social-proof intervals do not overlap on headphones, so the steps are separated in the price metric, not merely ordered by point estimates.

    “The steps are separated in the price metric, not merely ordered by point estimates: the weak, moderate, and strong social-proof intervals do not overlap on headphones (Appendix C).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Strong social proof and gain/loss exchange rank under one phrasing, and strong-cue premia drift by up to ≈ 8 points.

    “Strong social proof and gain/loss, however, exchange rank under one phrasing, and strong-cue premia drift by up to ≈ 8 points (Appendix J).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Appendix J

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    Priced, these four cues span 1.5-16.6% (headphones) and 1.2-19.6% (coffee machines).

    “Priced, they nevertheless span 1.5-16.6%(headphones) and 1.2-19.6%(coffee machines).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Authority commands approximately 19.8%, comparable to the strongest social-proof cue, and gain/loss framing approximately 22%, whereas scarcity and number-preserving reformatting sit near the floor.

    “Authority commands ≈ 19.8%, comparable to the strongest social-proof cue, and gain/loss framing ≈ 22%, whereas scarcity and number-preserving reformatting sit near the floor.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Scarcity commands a price-equivalent of only 1.6% (CI [1.4, 1.9]), below 3%, the level treated as the instrument's practical resolution.

    “Yet it commands a price-equivalent of only 1.6% (CI [1.4,1.9]), below 3%, the level we treat as the instrument's practical resolution.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The same instrument also prices the position channel, which the platform rather than the seller controls.

    “The same instrument also prices this channel, which the platform rather than the seller controls.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    In the perception probe, the optimised image is rated slightly more premium than the standard image, so the manipulation is perceptible; yet its price-equivalent cannot be identified, because primacy saturates the response channel in the small-premium regime that matters for elicitation.

    “In the perception probe the optimised image is rated slightly more premium than the standard image, so the manipulation is perceptible; yet its price-equivalent cannot be identified, because primacy saturates the response channel in the small-premium regime that matters for elicitation.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    PE is a formally defined, policy-conditioned parity threshold that makes very different cues comparable.

    “a formally defined, policy-conditioned parity threshold that makes very different cues comparable.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Visual Persuasion shows that image edits steer vision-language model choices.

    “Visual Persuasion shows that image edits steer vision-language model choices [6]”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [6]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Chu and Hou map an authority cue's breakthrough rate to an equivalent rating gain, percentage price discount, or review-count multiplier.

    “In concurrent work, Chu and Hou map an authority cue's breakthrough rate to an equivalent rating gain, percentage price discount, or review-count multiplier [7].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [7]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Study design and conductown data

    Counterbalance position and cue target within every (pair, price-point) cell; a first-option lean otherwise leaks into the estimate, and the pooled value is the crossing of the averaged curves, not the mean of the per-order crossings.

    “(1) Counterbalance position and cue target within every (pair, price-point) cell (Section 3.2).A first-option lean of the size we document (Section 4.5) otherwise leaks into the estimate, and the pooled value is the crossing of the averaged curves, not the mean of the per-order crossings.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Price-equivalent auditing turns qualitative susceptibility into a single monetary number and places text and framing cues on one comparable scale.

    “Price-equivalent auditing turns qualitative susceptibility into a single monetary number and places text and framing cues on one comparable scale.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Neutral and vacuous sentences test content-free additions.

    “Neutral and vacuous sentences test content-free additions.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    The resolving power comes from the price intervention, not from PE per se: any audit that adds a common cardinal axis escapes the ceiling, whereas a single equal-price rate cannot.

    “The resolving power comes from the price intervention, not from PE per se: any audit that adds a common cardinal axis escapes the ceiling, whereas a single equal-price rate cannot.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    In a length control, a cue competes against a neutral sentence of matched length, which separates content from the mere presence of an added sentence.

    “In a length control, a cue competes against a neutral sentence of matched length, which separates content from the mere presence of an added sentence.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductown data

    The 26% ceiling is an empirical bracket, not a fixed constant; it sits above the largest price-equivalents observed, so the crossing falls inside the window for all but a few cues.

    “The 26% ceiling is an empirical bracket, not a fixed constant.It sits above the largest price-equivalents we observe (the strongest cues cross near 13-22%), so the crossing falls inside the window for all but a few cues.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    If the curve never reaches 0.5 within the sweep, PE is right-censored to a lower bound.

    “If the curve never reaches 0.5 within the sweep, PE is right-censored to a lower bound ( †).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    Strong cues saturate choice near 100% and become indistinguishable, and a counterbalanced first-option bias averages to a 50% rate that looks like indifference.

    “Strong cues saturate the choice near 100% and become indistinguishable, and a counterbalanced first-option bias averages to a 50% rate that looks like indifference.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductreasoning

    Within every (pair, pricepoint) cell the paper counterbalances both position and cue target, with six calls in each of the four target-position states per cell, ruling out slot-and product-identity confounds.

    “Within every (pair, pricepoint) cell we therefore counterbalance both position (the cued product is first in exactly half of trials) and cue target (the cue sits on product A and B equally often), with six calls in each of the four target-position states per cell, ruling out slot-and product-identity confounds.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A stronger willingness-to-pay reading would require a specified user, a budget constraint, and a utility model with a truth-inducing payoff, as in discrete-choice WTP estimation.

    “A stronger willingness-to-pay reading would require a specified user, a budget constraint, and a utility model with a truth-inducing payoff, as in discrete-choice WTP estimation [23].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The paper treats the possibility that a model reads price as a quality signal as a matter of interpretation rather than a design confound.

    “We treat this as a matter of interpretation rather than a design confound.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    ABxLab manipulates prices, ratings, product order, and textual nudges across multiple LLM agents and finds large and predictable shifts in choice.

    “Closest to our setting, ABxLab manipulates prices, ratings, product order, and textual nudges across multiple LLM agents and finds large and predictable shifts in choice [5].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [5]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    If a cue is already dispreferred at equal price (base rate <0.5), the paper reports PE ≤ 0 and flags it, with the base rate giving the identified sign.

    “If a cue is already dispreferred at equal price (equal-price choice rate, hereafter base rate, <0.5), we report PE ≤ 0 and flag it ( ‡), and the base rate gives the identified sign.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Prior work establishes that LLM shopping agents are susceptible to seller-controlled cues and that presentation can move them.

    “Prior work establishes that LLM shopping agents are susceptible to such cues and that presentation can move them [5,6,11].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [5]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [6]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [11]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    The position-driven Llama-3.1-8B is excluded from cross-model claims, leaving the six task-engaged models those claims rest on.

    “The position-driven Llama-3.1-8B is additionally excluded from cross-model claims, which leaves the six task-engaged models those claims rest on.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    The primary estimator is model-free and locates the point where the pooled P(choose cued) curve crosses 0.5 by linear interpolation between the two neighbouring price points.

    “Our primary estimator is model-free.It locates the point where the pooled 𝑃 (choose cued) curve crosses 0.5 by linear interpolation between the two neighbouring price points (details in Appendix B).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Bias Beware frames cognitive-bias cues as black-box attacks on recommender systems.

    “Bias Beware frames cognitive-bias cues as black-box attacks on recommender systems [11]”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [11]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    PE is conditional on the cue contrast, audited products, presentation-policy weights, model, prompt, and decoding configuration, and should not generally be interpreted as individual indifference or willingness to pay.

    “It is conditional on the cue contrast, audited products, presentation-policy weights, model, prompt, and decoding configuration; it should not generally be interpreted as individual indifference or willingness to pay (Appendix B).”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Across 126,000 conversations, prompts instantiating seven of Cialdini's principles increased pooled partial-or-full compliance from 35.3% to 51.3% across three frontier models from different developers.

    “Across 126,000 conversations, prompts instantiating seven of Cialdini's principles increased pooled partial-or-full compliance from 35.3% to 51.3% across three frontier models from different developers, a susceptibility the authors describe as parahuman [20].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [20]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    A position-controlled logistic fit and a price×position interaction check agree with the model-free values within about 3 points wherever a crossing is identified.

    “A position-controlled logistic fit and a price×position interaction check agree with the model-free values within about 3 points wherever a crossing is identified (Appendix D).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    The paper varies price within a single trial across two fully specified, visible product cards; the reference product's price is displayed and held constant, so the swept gap is the only quantity that moves.

    “We vary price within a single trial across two fully specified, visible product cards.The reference product's price is displayed and held constant, so the swept gap is the only quantity that moves.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    Framing pairs hold information constant and vary only its form, so any premium reflects form rather than content.

    “Framing pairs hold information constant and vary only its form (percentage vs. fraction, a rescaled rating, and a gain/loss framing), so any premium reflects form rather than content.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Both information-bearing cues and information-preserving framing matter for auditing what a seller can change, even though they are interpreted differently.

    “Both matter for auditing what a seller can change, even though they are interpreted differently.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    In Chu and Hou, cue and price are evaluated in separate experiments, and the price equivalent is obtained by linearly interpolating a five-level price grid rather than by letting price and cue compete within the same trial.

    “There, however, cue and price are evaluated in separate experiments, and the price equivalent is obtained by linearly interpolating a five-level price grid rather than by letting price and cue compete within the same trial.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [7]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Authority, social proof, and scarcity each significantly increased compliance in that study, showing that these cue families act on LLMs and not only on humans.

    “authority, social proof, and scarcity each significantly increased compliance, showing that these cue families act on LLMs and not only on the humans they were formulated for.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [20]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    Always run the cue-free price-only control alongside the sweep; PE combines cue pull with price sensitivity (under the single-index model exactly their ratio), so a raw magnitude is uninterpretable on its own, and a cross-model comparison of raw PE compares two things at once.

    “(3) Always run the cue-free price-only control alongside the sweep.PE combines cue pull with price sensitivity (under the single-index model of Appendix B it is exactly their ratio), so a raw magnitude is uninterpretable on its own, and a cross-model comparison of raw PE compares two things at once (Appendix E).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    WTP elicited from GPT-3 can be of realistic magnitude relative to human estimates.

    “WTP elicited from GPT-3 can be of realistic magnitude relative to human estimates [3]”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [3]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationown data

    Agents over-select the first-presented option, which near the parity crossing can bias PE.

    “Agents over-select the first-presented option (Section 4.5), which near the parity crossing can bias PE.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Demand curves elicited from GPT-3 are broadly downward-sloping but generally not monotone in price.

    “Demand curves elicited from GPT-3 are broadly downward-sloping but generally not monotone in price [3].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [3]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    Because the estimate is read from a prompt, the paper re-measures a cue subset under four semantically equivalent task paraphrases.

    “Because the estimate is read from a prompt, we re-measure a cue subset under four semantically equivalent task paraphrases (Appendix J).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    In a counterbalanced, position-controlled forced choice, raising the cued product's price until it is chosen only half the time yields the cue's price-equivalent: the price premium that just offsets the cue's pull on the agent's recommendation.

    “In a counterbalanced, position-controlled forced choice, we raise the cued product's price until it is chosen only half the time.We call that premium the cue's price-equivalent (PE): the price premium that just offsets the cue's pull on the agent's recommendation.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    Make censoring explicit: a cue dispreferred at equal price is floor-censored; a curve that never crosses within the sweep is right-censored; a censored cell is a bound, not a value, and must not enter a ranking as one.

    “(4) Make censoring explicit.A cue dispreferred at equal price is floor-censored ( ‡); a curve that never crosses within the sweep is right-censored ( †).A censored cell is a bound, not a value, and must not enter a ranking as one (Section 3.1).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Reusens et al. infer an LLM's WTP for travel attributes and compare it to human estimates.

    “Reusens et al. infer an LLM's WTP for travel attributes and compare it to human estimates [23].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Study design and conductown data

    Read PE as ordinal-to-interval: rankings and coarse magnitude bands survive task rephrasing and re-sampling; exact percentages drift by a few points across phrasings and vary widely across product pairs.

    “(5) Read PE as ordinal-to-interval.Rankings and coarse magnitude bands survive task rephrasing and re-sampling; exact percentages drift by a few points across phrasings and vary widely across product pairs (Section 4.6, Appendix F and Appendix J).”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    Cues are single sentences appended to a product's neutral description; price, rating, and specifications stay untouched, so a cue competes only through its wording.

    “Cues are single sentences appended to a product's neutral description.Price, rating, and specifications stay untouched, so a cue competes only through its wording.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Because the first-option bias can look like indifference, it is a caution for any choice-based evaluation of agents, including LLM-as-judge.

    “Because this bias can look like indifference, it is a caution for any choice-based evaluation of agents, including LLM-as-judge (Section 4).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    For 95% CIs the paper uses a nonparametric bootstrap resampled by product pair.

    “For 95% CIs we use a nonparametric bootstrap resampled by product pair [10].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [10]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    PE audits seller-controlled influence relative to price and does not by itself show that a cue induces an irrational bias.

    “PE audits seller-controlled influence relative to price and does not by itself show that a cue induces an irrational bias.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductown data

    Each neutral description was checked for persuasive content by an LLM judge on nine persuasion dimensions for headphones and by a manual read of all pairs.

    “Each neutral description was checked for persuasive content by an LLM judge on nine persuasion dimensions (headphones) and by a manual read of all pairs (Appendix N).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Altering only an item's title can raise its exposure in LLM-based recommenders while leaving overall recommendation performance largely unchanged.

    “altering only an item's title can raise its exposure in LLM-based recommenders while leaving overall recommendation performance largely unchanged [31].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [31]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Study design and conductown data

    Nova Pro is dropped for a high non-response rate, leaving the seven models of the main dataset over which aggregate figures are reported.

    “Nova Pro is dropped for a high non-response rate, which leaves the seven models of the main dataset over which we report aggregate figures (e.g. the headline trial count).”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    PE auditing is framed as a reusable auditing protocol with three components: a counterbalanced, position-controlled price sweep yielding PE; a cue-free price-sensitivity control calibrating cross-model comparison; and a primacy diagnostic guarding choice-based readings.

    “We frame PE auditing as a reusable auditing protocol with three components: a counterbalanced, position-controlled price sweep that yields the price-equivalent (Section 3.1); a cue-free price-sensitivity control that calibrates cross-model comparison (Section 4.4, Appendix E); and a primacy diagnostic that guards choice-based readings (Section 3.2, Section 4.5).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The divergence between choice and price echoes a long-documented human dissociation between choice and valuation, in which the two elicitations weight attributes differently and can even reverse.

    “This divergence between choice and price echoes a longdocumented human dissociation between choice and valuation, in which the two elicitations weight attributes differently and can even reverse [17,29].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [17]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [29]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Optimising content for generative engines has been formalised as Generative Engine Optimization.

    “Optimising content for generative engines has already been formalised as Generative Engine Optimization [1].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [1]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S4 (based).

    Study design and conductnone given

    The protocol applies unchanged to any seller-controlled intervention, model, or category.

    “The protocol applies unchanged to any seller-controlled intervention, model, or category; we instantiate it here on marketing cues across two categories and seven models (Table 1).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductreasoning

    The estimator needs no parametric form, which matters because cues routinely saturate the equal-price choice (P=1), distorting a global logistic fit.

    “The estimator also needs no parametric form.This matters because cues routinely saturate the equal-price choice (𝑃=1), which distorts a global logistic fit.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Raw PE must be read alongside price sensitivity and therefore resists a single cross-model ranking.

    “It reports each model's cue-price profile rather than a single score, because raw PE must be read alongside price sensitivity and therefore resists a single cross-model ranking (Section 4.4).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Study design and conductreasoning

    In a presence control, a neutral sentence competes against a second neutral sentence and should command no premium.

    “In a presence control, that neutral sentence competes against a second neutral sentence and should command no premium.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Study design and conductnone given

    Social proof comes in four intensities, which serve as a dose-response calibration.

    “Social proof comes in four intensities, which serve as a dose-response calibration.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    Jev's interface fixes the output format, so it answers through its choice API rather than a free-text reply, and it has no temperature; its choice rate is largely the share of the counterbalanced layouts a card wins.

    “Jev's interface fixes the output format, so it answers through its choice API rather than a free-text reply, and it has no temperature; its choice rate is largely the share of the counterbalanced layouts a card wins.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    A cue can be broad and shallow (scarcity) or narrow and deep (gain/loss framing).

    “A cue can be broad and shallow (scarcity) or narrow and deep (gain/loss framing).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The headline trial count gives high precision with respect to each model's stochastic sampling within a condition.

    “The headline trial count gives high precision with respect to each model's stochastic sampling within a condition.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductreasoning

    This is a best-of-N selection with an out-of-sample confirmation that guards against the winner's curse.

    “This is a best-of-𝑁 selection with an out-of-sample confirmation that guards against the winner's curse.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The audit measures susceptibility under clean conditions rather than predicting behaviour in a live shopping environment.

    “It therefore measures susceptibility under clean conditions rather than predicting behaviour in a live shopping environment, where cues compete with search, reviews, and multistep navigation.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data

    The core cue set is run on the seven main-dataset models, with Nova Pro excluded for a 21% non-response rate.

    “We run the core cue set on the seven main-dataset models (Nova Pro is excluded for a 21% non-response rate).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductreasoning

    The social-proof levels co-vary wording, customer count, and superlatives, so the series is an intensity gradient as a seller would write it, not a single-factor dose.

    “The levels co-vary wording, customer count, and superlatives, so the series is an intensity gradient as a seller would write it, not a single-factor dose.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    A price-equivalent rises with a cue's pull and falls with the model's sensitivity to price.

    “A price-equivalent rises with a cue's pull and falls with the model's sensitivity to price”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Study design and conductnone given

    Every cue here is a single, factually plausible sentence stipulated true of the product.

    “Every cue here is a single, factually plausible sentence stipulated true of the product.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Because each condition contains only six product pairs, the cluster bootstrap generalizes over six units, and a percentile interval on six clusters can understate uncertainty.

    “Because each condition contains only six product pairs, the cluster bootstrap generalizes over six units, and a percentile interval on six clusters can understate uncertainty [4, Sec.VI].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [4]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Study design and conductown data

    Counterbalancing removes the first-option lean from the pooled estimate, and a price×position test finds no distortion.

    “Counterbalancing removes this lean from the pooled estimate, and a price×position test finds no distortion (Appendix D).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    For weak cues, the order dependence is large relative to the pooled value, so the policy-level PE should be read as a balanced-order summary rather than a position-free cue strength.

    “For weak cues this order dependence is large relative to the pooled value, so the policy-level PE should be read as a balanced-order summary rather than a position-free cue strength.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
    • Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
  • Classified as probably not a substantial claim.

    Premisereasoning

    A pooled PE is the crossing of the averaged curve and need not equal the median of the pair-level crossings.

    “A pooled PE is the crossing of the averaged curve and need not equal the median of the pair-level crossings (Appendix B).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    We neither fabricate false claims nor optimize toward deception.

    “We neither fabricate false claims nor optimize toward deception”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    The agents' susceptibility is selective and does not mirror the profile that classic persuasion accounts would predict.

    “Second, the agents' susceptibility is selective and does not mirror the profile that classic persuasion accounts would predict.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The composition test covers one model and one cue per family.

    “The composition test covers one model and one cue per family.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    The first-option bias matters in itself: any method that reads preferences off agent choices, including LLM-as-judge evaluation, must control option order or risk reporting position as preference.

    “The bias nonetheless matters in itself.Any method that reads preferences off agent choices, including LLM-as-judge evaluation, must control option order or risk reporting position as preference.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    The paper reports such models observationally rather than ranking a censored number.

    “We report such models observationally rather than ranking a censored number.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    A cross-model audit should not be presumed to transfer, and raw PE must be read alongside price sensitivity, not as cue strength.

    “The upshot is that a cross-model audit should not be presumed to transfer, and raw PE must be read alongside price sensitivity, not as cue strength.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Counterbalancing does not mean averaging the two crossings; the pooled PE is the crossing of the averaged position-specific curves, which in general differs from the mean of their crossings.

    “Counterbalancing does not mean averaging the two crossings.The pooled PE is the crossing of the averaged position-specific curves, which in general differs from the mean of their crossings.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The audited models are a diverse convenience sample rather than a random draw, so claims hold for these models, not for 'LLMs' in general.

    “Finally, the audited models are a diverse convenience sample rather than a random draw, so claims hold for these models, not for”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data

    Reading the equal-price base rate as a validity gate, the paper reports over the six task-engaged models.

    “Reading the equal-price base rate as a validity gate, we report over the six task-engaged models.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Because raw magnitudes must be read alongside price sensitivity rather than as cue strength, the response resists a single cross-model ranking.

    “Because raw magnitudes must be read alongside price sensitivity rather than as cue strength, the response resists a single cross-model ranking.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    A PE combines a cue's pull with the model's price sensitivity, and price sensitivity itself varies sharply.

    “A PE, however, combines a cue's pull with the model's price sensitivity, and price sensitivity itself varies sharply.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    It is further shaped by a strong primacy bias that any choice-based evaluation must control.

    “It is further shaped by a strong primacy bias that any choice-based evaluation must control.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    The scarcity result departs from scarcity's potency on human shoppers, a contrast with the persuasion literature, not a measured human baseline, and tested in a single formulation.

    “This departs from scarcity's potency on human shoppers (a contrast with the persuasion literature, not a measured human baseline, and tested in a single formulation).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    The two quantities measure different things: how often a cue wins when price is tied, and how much price it can absorb.

    “The two quantities measure different things: how often a cue wins when price is tied, and how much price it can absorb.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Because GPT-4o is so price-sensitive, its double-digit PEs reflect a genuinely strong cue pull that overcomes a steep price response-not price-blindness.

    “Because GPT-4o is so price-sensitive, its double-digit PEs reflect a genuinely strong cue pull that overcomes a steep price response-not price-blindness.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Each construct in the main battery is tested in a single formulation, in particular one scarcity sentence.

    “Each construct in the main battery is also tested in a single formulation, in particular one scarcity sentence.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    PE is ordinal-to-interval: rankings and coarse bands are trustworthy, exact percentages are not.

    “PE is therefore ordinal-to-interval: rankings and coarse bands are trustworthy, exact percentages are not.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    The per-pair spread (10 to over 26%) is genuine product heterogeneity, which the pooled estimand averages over by design.

    “The per-pair spread (10 to over 26%) is genuine product heterogeneity, which the pooled estimand averages over by design.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
    • Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
  • May combine two claims.

    Interpretationown data

    Wording is a real lever, but several times smaller than the choice of cue (0.7-21.4%).

    “Wording is thus a real lever, but several times smaller than the choice of cue (0.7-21.4%).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The study uses no human subjects and no personal data.

    “The study uses no human subjects and no personal data.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    On this scale, the agents' response is selective, not a simple copy of the human profile, and partly shared across models.

    “On this scale, the agents' response is selective, not a simple copy of the human profile, and partly shared across models.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductown data

    Jev received the chat models' prompt verbatim, counterbalanced as in Section 3.2 (24 queries per pair and price point, 49,824 queries, none failed).

    “Jev received the chat models' prompt verbatim, counterbalanced as in Section 3.2 (24 queries per pair and price point, 49,824 queries, none failed).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    With only six clusters, the pair-clustered 95% bootstrap intervals are wide and, near zero, lumpy; they are coarse bands rather than precise limits.

    “With only six clusters the intervals are wide and, near zero, lumpy.They are coarse bands rather than precise limits (Appendix F).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Where pooled and median diverge, pairs with steep curves cross early and pull the pooled crossing down; the pooled value answers the policy-level question over the product mixture, while the pair-level distribution shows how that threshold varies across products.

    “Where pooled and median diverge (e.g.Claude Sonnet, strong social proof: pooled 1.8%, pair median 10.0%), pairs with steep curves cross early and pull the pooled crossing down; the pooled value answers the policy-level question over the product mixture, the pair-level distribution how that threshold varies across products.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
    • Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
  • May combine two claims.

    Study design and conductreasoning

    Composition is tested with a length-matched 2^3 factorial; three cross-family cues are each present or absent in a fixed slot that otherwise holds a neutral filler, so sentence count is constant and the length/presence confound cancels in every interaction contrast.

    “We test composition with a length-matched 2 3 factorial.Three cross-family cues (social proof, authority, scarcity) are each present or absent in a fixed slot that otherwise holds a neutral filler.Sentence count is therefore constant, and the length/presence confound cancels in every interaction contrast (Appendix H).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Two categories give initial cross-category evidence, but both are consumer-electronics durable goods, so generalization to structurally different domains (e.g., services such as travel or lodging) is untested.

    “Two categories give initial cross-category evidence, but both are consumer-electronics durable goods, so generalization to structurally different domains (e.g., services such as travel or lodging) is untested.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The saturated equal-price rate cannot make this choice.

    “The saturated equal-price rate cannot make this choice.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    The fixed seed pins only stimulus construction and counterbalancing, not model sampling; for closed APIs this does not guarantee identical outputs, so per-trial logs are released and results are reported as distributions over N repeats rather than single deterministic outputs.

    “Our fixed seed therefore pins only stimulus construction and counterbalancing, not model sampling; for closed APIs this does not guarantee identical outputs, so we release per-trial logs and report results as distributions over 𝑁 repeats rather than single deterministic outputs.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Neither the OpenAI nor the Bedrock calls pass a provider-side seed.

    “Neither the OpenAI nor the Bedrock calls pass a provider-side seed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    The cue-free price-only control was gathered eight days later; its cross-model use as a price-sensitivity reference therefore carries a date offset of eight days.

    “The one exception is the cue-free price-only control, gathered eight days later; its cross-model use as a price-sensitivity reference therefore carries a date offset of eight days.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductown data

    The first author read all twelve pairs in both categories and checked them for persuasive wording and for balanced wording between the two sides; all twelve pairs passed.

    “In addition, the first author read all twelve pairs in both categories and checked them for persuasive wording (social proof, scarcity, authority, evaluative wording, superlatives, embedded price or rating) and for balanced wording between the two sides.All twelve pairs passed.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductown data

    On the reference model (GPT-4o) all cue conditions and their controls were collected within each category in a single same-day session (headphones on 17 July, coffee machines on 19 July), so condition is not confounded with collection date for the within-model cue comparisons.

    “on the reference model (GPT-4o) all cue conditions and their controls were collected within each category in a single same-day session (headphones on 17 July, coffee machines on 19 July), so condition is not confounded with collection date for the within-model cue comparisons.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    After the audit, the judge rubric was extended by a tenth dimension (normative/eco valence), because the judge had passed a sustainability-coded sentence that nonetheless commanded a premium; this extension was not used to re-score the stimuli.

    “After the audit, the judge rubric was extended by a tenth dimension (normative/eco valence), because the judge had passed a sustainability-coded sentence that nonetheless commanded a premium.This extension was not used to re-score the stimuli.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    Sampling temperature 0.7; N=24 trials per (pair, price-point) (N=12 for robustness paraphrases); premium levels 0, 2, 4, 6, 8, 12, 18, and 26%, extended to 60% for additivity; bootstrap of 2000 resamples clustered by product pair; fixed random seed; position and cue-target counterbalancing within each (pair, price-point) cell.

    “Sampling temperature 0.7; 𝑁 =24 trials per (pair, price-point) (𝑁 =12 for the robustness paraphrases); premium levels 0, 2, 4, 6, 8, 12, 18, and 26%, extended to 60% for the additivity runs; bootstrap of 2000 resamples clustered by product pair; fixed random seed; position and cue-target counterbalancing within each (pair, price-point) cell.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    We accessed the OpenAI models via the rolling aliases gpt-4o and gpt-4o-mini rather than pinned dated snapshots-a reproducibility caveat, since the served snapshot can change over time.

    “We accessed the OpenAI models via the rolling aliases gpt-4o and gpt-4o-mini rather than pinned dated snapshots-a reproducibility caveat, since the served snapshot can change over time”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    The main audit is 113,472 trials over 107 conditions.

    “The main audit is 113,472 trials over 107 conditions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    Conditions were collected in blocks-one run per condition-rather than temporally interleaved, so a change in the served model during collection could in principle confound with condition.

    “Conditions were collected in blocks-one run per condition-rather than temporally interleaved, so a change in the served model during collection could in principle confound with condition.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    Structural checks additionally enforce identical specifications, identical price and rating, and matched description length.

    “Structural checks additionally enforce identical specifications, identical price and rating, and matched description length.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Nova Pro's 21% non-response rate is why it is excluded; all other models parse at ≥99.9%.

    “Nova Pro's 21% non-response rate is why it is excluded; all other models parse at ≥ 99.9%.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    When option-order choice is near-deterministic, the policy average is pinned at 0.50 and PE is not identified; this is a boundary case of the counterbalanced policy estimand, not evidence of a null.

    “This is a boundary case of our counterbalanced (50/50) policy estimand (Section 3.1)-when option-order choice is near-deterministic, the policy average is pinned at 0.50 and PE is not identified-not evidence of a null; a position-free paradigm (single-product valuation, or an image-only 2AFC) is required to estimate an image premium.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
  • May combine two claims.

    Study design and conductown data

    Within a pair, price, rating, rating count, and specifications are identical, and the two neutral descriptions are length-matched (word count within ±15%).

    “Within a pair, price, rating, rating count, and specifications are identical, and the two neutral descriptions are length-matched (word count within ±15%).”
    Quote in the paperSubstantial claim
165 of 165
  • The paper relies on this without support.

    Large language models are increasingly asked to shop on a user's behalf.

    “Large language models are increasingly asked to shop on a user's behalf, which lets seller-controlled content such as badges, endorsements, and framing steer what they recommend.”
  • The authors state this as an assumption.

    The agent trades price against the cue when it forms its recommendation.

    “Our measure requires only that the agent trades price against the cue when it forms its recommendation.”
  • The authors state this as an assumption.

    The cue enters as an additive utility term in a single-index model.

    “a single-index model in which the cue enters as an additive utility term.”
  • The authors state this as an assumption.

    Stable audit environment: fixed model snapshot, prompt, decoding, and card template.

    “A1 Stable audit environment: fixed model snapshot, prompt, decoding, and card template.”
  • The authors state this as an assumption.

    Explicit comparator: the comparator content c0 is part of the estimand.

    “A2 Explicit comparator: the comparator content 𝑐 0 is part of the estimand.”
  • The authors state this as an assumption.

    Joint design control: the four (T,R) cells carry weight 1/4, exactly balanced in our data.

    “A3 Joint design control: the four (𝑇 , 𝑅) cells carry weight 1 4 , exactly balanced in our data.”
  • The authors state this as an assumption.

    Single crossing: S_Q is weakly decreasing over the search domain.

    “A4 Single crossing: 𝑆 𝑄 is weakly decreasing over the search domain.”
  • The authors state this as an assumption.

    Support: the price sweep brackets the crossing; otherwise a bound is reported.

    “A5 Support: the price sweep brackets the crossing; otherwise a bound is reported.”
  • The authors state this as an assumption.

    Local smoothness: the curve is approximately linear between the two bracketing grid points.

    “A6 Local smoothness: the curve is approximately linear between the two bracketing grid points.”
  • The authors state this as an assumption.

    Stable repeated sampling: no model drift during collection (Appendix O).

    “A7 Stable repeated sampling: no model drift during collection (Appendix O).”
  • The authors state this as an assumption.

    Explicit population: the product distribution Q is part of the estimand.

    “A8 Explicit population: the product distribution 𝑄 is part of the estimand.”
  • The authors state this as an assumption.

    Forced-choice scope: the threshold pertains to the stated two-option protocol.

    “A9 Forced-choice scope: the threshold pertains to the stated two-option protocol.”
  • The authors state this as an assumption.

    Relative-price scale: PE is a proportional premium on the reference price.

    “A10 Relative-price scale: PE is a proportional premium on the reference price.”
  • The paper relies on this without support.

    This is the first price-equivalent audit of a decision-native model.

    “To our knowledge, this is the first price-equivalent audit of a decisionnative model.”
  • The paper relies on this without support.

    The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.

    “For the headphone pairs, each description was rated 1-5 on nine persuasion dimensions (social proof, scarcity, authority, exclusivity, urgency, discount framing, storytelling, emotional language, comparative language) by an LLM judge (Claude Opus) instructed to score strictly, so that any hint of a cue scores ≥ 3.”
  • The paper relies on this without support.

    The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.

    “The agent is indifferent to number-preserving reformatting (a rescaled rating and a percent-vs-fraction restatement both cross parity at ≈ 0%) yet strongly swayed by a gain/loss framing of the same fact.”
16 of 16

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Position-specific crossings do not preserve cue ordering

    Minor

    The text says the first- and second-slot crossings preserve cue ordering. Table 5 ranks authority above very strong social proof when cued first (25.7% versus 22.8%), but below it when cued second (13.1% versus 20.4%).

1 of 1

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 1

  1. D. McFadden. 1974. Conditional Logit Analysis of Qualitative Choice Behavior. In Frontiers in Econometrics, P. Zarembka (Ed.). Academic Press, 105-142.

Authors
Buecheler, F., Berbeglia, G., & Guo, M.
Affiliations
  • Adelaide University (AU)
  • The University of Melbourne (AU)
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
OpenAlex
W7223059013
Cited by
0
References
0
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › Sociology and Political Science › Digital Marketing and Social Media
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
Keywords
generative engine optimization, large language models, social validation, recommendation bias, Jev

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-29.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-29.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review