A Cue's Hidden Price: Auditing Seller Influence on AI Shoppers
Open accessAbstract
Large language models are increasingly asked to shop on a user's behalf, which lets seller-controlled content such as badges, endorsements, and framing steer what they recommend. That poses the question at the core of generative engine optimization (GEO): not whether seller content shifts an agent's choice, but how much. The usual gauge of that influence, how often a cue wins the choice, has a blind spot: once a cue is strong enough to be picked almost every time, the choice rate can no longer show how much stronger one cue is than another. We introduce price-equivalent (PE) auditing, which removes this ceiling by pricing the cue in money. In a counterbalanced, position-controlled forced choice, we raise the cued product's price until it is chosen only half the time, and report that premium as the cue's price-equivalent: a formally defined, policy-conditioned parity threshold that makes very different cues comparable. Priced this way, cues that look equally strong at equal price differ by a wide margin, so choice-rate audits substantially under-resolve seller influence. We run the audit over 113,472 trials, seven models across families, and two product categories. To our knowledge, we also run the first price-equivalent audit of a decision-native model, Jev, which outputs a choice probability directly instead of generating text; strikingly, its profile is unlike any text model we tested, resisting most cues yet remaining susceptible to the strongest social-proof claims. We release the stimuli, logs, and code as a benchmark that reports each model's cue-price profile rather than a single score, giving developers and auditors a common, reproducible way to measure how content moves AI shopping agents.
AI snapshot
Written from the paper’s full text.
TL;DR
The paper introduces price-equivalent (PE) auditing, which prices seller-controlled cues by raising the cued product’s price until it is chosen only half the time, yielding a money-denominated parity threshold. Across 113,472 trials, seven models, and two categories, equal-price choice rates saturate and under-resolve cue influence, while PE reveals selective, model-specific susceptibility profiles.
Key findings
- Six cue conditions are chosen in at least 95% of equal-price trials yet their price-equivalents span 1.6% to 21.4%; scarcity is chosen more often than gain/loss framing (0.95 vs. 0.72) but commands a fourteen-times-smaller premium (1.6% vs. 22.3%), reversing the equal-price ranking.
- On GPT-4o headphones, social proof shows a monotonic dose-response: weak 0.7%, moderate 1.3%, strong 12.9%, very strong 21.4%; authority ≈19.8%, gain/loss framing ≈22.3%, scarcity 1.6%, and number-preserving reformatting ≈0%.
- The first-presented option is chosen in 56.3% of trials overall (n = 14,976), rising to ≈65% in low-signal conditions; the cue-free first-slot premium is at most 3.2% on price-sensitive models, 14.0% on GPT-4o mini, and beyond 80% on Nova Micro and Llama-3.1-8B.
- The decision-native model Jev replicates the equal-price ceiling but has a distinct profile: very strong social proof 15.4%, authority 1.5%, gain/loss framing 0.0%; PE-guided selection of the top of nine cues beats the mean by +13.3 percentage points (95% CI [8.7, 17.8]).
Methods
- Two-alternative forced choice between matched product pairs, one carrying a cue; the cued product’s price is raised across eight premia (0, 2, 4, 6, 8, 12, 18, 26%), and PE is the premium at which the cued product’s selection share falls to 0.5. Position and cue target are counterbalanced within every (pair, price-point) cell; N = 24 repetitions per cell; six pairs per category (headphones, coffee machines); total 113,472 trials.
- Eight LLMs from four providers are audited as strong/weak pairs, with GPT-4o as the reference model; Nova Pro is excluded for a 21% non-response rate, and Llama-3.1-8B is excluded from cross-model claims for being position-driven, leaving six task-engaged models. Jev is audited separately with the same protocol (49,824 queries).
- The primary estimator is model-free, locating the 0.5 crossing by linear interpolation, with pair-clustered bootstrap 95% CIs; a cue-free price-only control calibrates price sensitivity, and a primacy diagnostic guards choice-based readings. Robustness checks include four task paraphrases and a length-matched 2³ additivity factorial.
Limitations
- The paper states that the audit is a synthetic two-alternative forced choice, not a live shopping environment; the “non-human” characterization is a contrast with the human-persuasion literature, not a matched human baseline. Each construct is tested in a single formulation, especially one scarcity sentence, so the low scarcity PE should be read as low for that formulation, not immunity. PE combines cue pull with price sensitivity, so cross-model magnitudes conflate the two; price-insensitive models have unidentified PEs, and several cues are censored at the top of the sweep. The composition test covers one model and one cue per family.
- The paper also states that the headline trial count is not independent product-level observations because each condition repeats only six product pairs; two consumer-electronics categories give initial cross-category evidence but leave structurally different domains untested; four prompt paraphrases give limited robustness; and the audited models are a diverse convenience sample, not a random draw. With only six pair-clusters, confidence intervals may understate broader product-level uncertainty.
- Evident from the text: PE is prompt-conditional and not economic willingness to pay; Jev’s prices depend on input format, and its length/presence controls do not transfer; under vision, near-deterministic primacy prevents identifying an image cue’s PE.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 38 cited sources checked · 0 supported · 0 flagged
- Findingown data
The same pricing turns the well-documented first-option (primacy) bias from a nuisance into a priced channel that the platform controls.
“The same pricing turns the welldocumented first-option (primacy) bias from a nuisance into a priced channel that the platform controls.”
Quote in the paperSubstantial claim - Findingown data
A single equal-price rate loses the sixfold difference between the neutral sentence and social proof.
“A single equal-price rate loses this sixfold difference (Figure 2).”
Quote in the paperSubstantial claim - Findingown data
Across 113,472 trials, seven models, and two categories, a price axis resolves what an equal-price choice rate cannot.
“Across 113,472 trials, seven models, and two categories, a price axis resolves what an equal-price choice rate cannot.”
Quote in the paperSubstantial claim - Findingown data
Gain/loss differs already at equal price, from immune (Llama-3.3-70B, 0.50) to strong (Nova Micro, 0.97).
“Gain/loss, by contrast, differs already at equal price, from immune (Llama-3.3-70B,0.50) to strong (Nova Micro, 0.97).”
Quote in the paperSubstantial claim - Findingown data
Four prompt paraphrases give limited robustness across task wording (the social-proof intensity ordering is preserved, while absolute magnitudes drift a few points).
“Four prompt paraphrases give limited robustness across task wording (the social-proof intensity ordering is preserved, while absolute magnitudes drift a few points).”
Quote in the paperNot a substantial claim
- Findingown data
Read against the equal-price rates, authority is broadly attractive on every task-engaged model (0.75-1.00).
“Read against the equal-price rates (Appendix E), authority is broadly attractive on every taskengaged model (0.75-1.00).”
Quote in the paperSubstantial claim - Findingown data
Re-running the battery on a second product category, coffee machines, reproduces the whole pattern.
“Re-running the battery on a second product category, coffee machines, reproduces the whole pattern.”
Quote in the paperSubstantial claim - Findingown data
On five headphone pairs, the PE-selected cue (top-scoring of nine cues) commands +13.3 points more PE than the mean of the nine out of sample (95% CI [8.7, 17.8]).
“On five headphone pairs, we score nine cues (three families × three intensities) by PE, freeze the top-scoring cue, and re-measure it out of sample.It commands +13.3 points more PE than the mean of the nine (95% CI [8.7, 17.8], Appendix I).”
- Also stated in: § 5 Discussion · plain
“the top-scoring of nine cues carries +13.3 percentage points more PE than the mean of the nine out of sample (Section 4.6).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Appendix I
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Also stated in: § 5 Discussion · plain
- Findingown data
The off-domain 'audio experts' sentence on a coffee machine is never chosen at equal price (0 of 144 trials).
“Relevance, by contrast, matters sharply: the off-domain”
Quote in the paperSubstantial claim - Findingown data
Authority replicates (approximately 21.6%) once its wording is made domain-appropriate.
“Authority also replicates (≈ 21.6%) once its wording is made domain-appropriate.”
Quote in the paperSubstantial claim - Findingown data
The agent disproportionately selects the first-presented option.
“The agent disproportionately selects the first-presented option.”
Quote in the paperSubstantial claim - Findingown data
A length-matched control (approximately 10.6%) confirms that the premium comes from the sentence's meaning, not from its length or mere presence.
“A length-matched control (≈ 10.6%) confirms that the premium comes from the sentence's meaning, not from its length or mere presence (the cue-free price-only baseline is in Appendix E).”
Quote in the paperSubstantial claim - Findingown data
A social-proof series of increasing intensity yields a monotonically rising, sharply nonlinear price-equivalent (0.7 < 1.3 < 12.9 < 21.4%).
“A social-proof series of increasing intensity yields a monotonically rising, sharply nonlinear price-equivalent (0.7 < 1.3 < 12.9 < 21.4%).”
Quote in the paperSubstantial claim - Findingown data
Cue effects are realized mostly in the first slot.
“Cue effects are also realized mostly in the first slot”
Quote in the paperSubstantial claim - Findingown data
Jev's priced profile is its own (Table 4).
“Jev's priced profile, however, is its own (Table 4).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Table 4
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data
The position-driven Llama-3.1-8B (first option in approximately 97% of trials) has no identified PE.
“The position-driven Llama-3.1-8B(first option in ≈97% of trials) has no identified PE.”
Quote in the paperNot a substantial claim - Findingown data
Priced on one scale, the battery is selective.
“Priced on one scale (Table 3), the battery is selective.”
Quote in the paperSubstantial claim - Findingown data
Under four semantically equivalent task phrasings, the social-proof ordering holds throughout.
“Under four semantically equivalent task phrasings, the social-proof ordering holds throughout.”
Quote in the paperNot a substantial claim - Findingown data
Within a condition, the six pair-level estimates for strong social proof range from 10.0% to beyond 26% around a pooled 12.9%.
“Within a condition, the six pair-level estimates for strong social proof range from 10.0% to beyond 26% around a pooled 12.9% (Appendix F).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Appendix F
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data
Jev's prices depend on its input format.
“Jev's prices depend on its input format.”
Quote in the paperSubstantial claim - Findingown data
Jev is as price-sensitive as GPT-4o (0 of 144 cue-free trials keep the pricier product at +10%).
“Jev is as pricesensitive as GPT-4o (0 of 144 cue-free trials keep the pricier product at +10%)”
Quote in the paperSubstantial claim - Findingown data
Scarcity commands at most 2% on any model.
“Scarcity commands at most 2% on any model.”
Quote in the paperNot a substantial claim - Findingown data
Passing the cards as a structured object raised strong social proof from 2.0 to 10.8%.
“Passing the cards as a structured object raised strong social proof from 2.0 to 10.8%.”
Quote in the paperSubstantial claim - Findingown data
The PE-selected cue beats the no-PE baseline by +13.3 pp on average (95% CI [8.7, 17.8], clustered over pairs).
“the PE-selected cue beats the no-PE baseline by +13.3 pp on average (95% CI [8.7, 17.8], clustered over pairs).”
Quote in the paperSubstantial claim - Findingown data
Where no cue separates the cards, Jev picks the first-listed one (first slot in 60.1% of battery trials, against 56.3% for GPT-4o).
“Where no cue separates the cards, Jev picks the first-listed one (first slot in 60.1% of battery trials, against 56.3% for GPT-4o).”
Quote in the paperSubstantial claim - Interpretationown data
The disagreement between choice rate and price-equivalent is not a precision problem that more trials would fix.
“This is not a precision problem that more trials would fix.”
Quote in the paperSubstantial claim - Interpretationreasoning
Price-equivalent (PE) auditing removes the choice-rate ceiling by pricing the cue in money.
“We introduce price-equivalent (PE) auditing, which removes this ceiling by pricing the cue in money.”
Quote in the paperSubstantial claim - Interpretationreasoning
The estimator estimates choice behavior under a balanced (50/50) option-order policy, not a position-free preference.
“It therefore estimates choice behavior under a balanced (50/50) option-order policy, not a position-free preference.”
Quote in the paperSubstantial claim - Study design and conductreasoning
The design does not rule out that a model reads price itself as a quality signal.
“It does not rule out that a model reads price itself as a quality signal.”
Quote in the paperSubstantial claim - Study design and conductreasoning
Because position is counterbalanced within every (pair, price-point) cell, the pooled curve is position-neutral in expectation.
“Because position is counterbalanced within every (pair, price-point) cell (Section 3.2), this pooled curve is position-neutral in expectation.”
Quote in the paperSubstantial claim - Interpretationreasoning
The usual gauge of a cue's influence, how often it wins the choice, has a blind spot: once a cue is strong enough to be picked almost every time, the choice rate can no longer show how much stronger one cue is than another.
“The usual gauge of that influence, how often a cue wins the choice, has a blind spot: once a cue is strong enough to be picked almost every time, the choice rate can no longer show how much stronger one cue is than another.”
Quote in the paperSubstantial claim - Premisecitation
In blinded LLM simulations, varying price across otherwise comparable prompts can systematically alter the model's implicit assumptions about unspecified pre-treatment characteristics and competing-product prices, which violates unconfoundedness.
“In blinded LLM simulations, varying price across otherwise comparable prompts can systematically alter the model's implicit assumptions about unspecified pre-treatment characteristics and competing-product prices, which violates unconfoundedness [13].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationcitation
This avoids the between-prompt channel by which price variation can silently shift unspecified covariates in blinded LLM simulations.
“This avoids the between-prompt channel by which price variation can silently shift unspecified covariates in blinded LLM simulations [13].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Knowing that a cue raises selection says nothing about whether it is worth a few cents or a large fraction of the product's price.
“Knowing that a cue”
Quote in the paperSubstantial claim - Study design and conductreasoning
The sweep is non-negative, so PE is identified only for cues that do not disadvantage the cued product.
“The sweep is non-negative, so PE is identified only for cues that do not disadvantage the cued product.”
Quote in the paperSubstantial claim - Interpretationown data
A choice-rate audit ranks scarcity and gain/loss framing the wrong way round.
“A choice-rate audit therefore ranks the two the wrong way round.”
Quote in the paperSubstantial claim - Interpretationnone given
The agents' priced profile is not a copy of the human one.
“The agents' priced profile is nonetheless not a copy of the human one.”
Quote in the paperSubstantial claim - Study design and conductcitation
With six pairs per condition, the small-cluster regime can make such intervals anti-conservative, that is, too narrow.
“With six pairs per condition, this small-cluster regime can make such intervals anti-conservative, that is, too narrow [4].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [4]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
In a synthetic admissions task, GPT-4 admitted 78.0% of candidates under a reject-framed prompt versus 37.5% under an admit-framed prompt, a difference of 40.5 percentage points.
“in a synthetic admissions task, GPT-4 admitted 78.0% of candidates under a reject-framed prompt versus 37.5% under an admit-framed prompt, a difference of 40.5 percentage points [9].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [9]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationown data
Premia beyond 26% would add no crossing information, because by then even the strongest cue is almost always abandoned.
“Premia beyond 26% would add no crossing information, because by then even the strongest cue is almost always abandoned.”
Quote in the paperSubstantial claim - Interpretationreasoning
With only six pair-clusters, confidence intervals may understate broader product-level uncertainty.
“With only six pair-clusters, our confidence intervals may understate broader product-level uncertainty.”
Quote in the paperSubstantial claim - Interpretationown data
The model differences in scarcity response are the sharpest departure from classic persuasion accounts.
“This is the sharpest departure from classic persuasion accounts.”
Quote in the paperSubstantial claim - Interpretationown data
Combined influence can be approximated from single-cue measurements.
“so combined influence can be approximated from single-cue measurements.”
Quote in the paperSubstantial claim - Interpretationown data
The under-resolution of the equal-price rate is not specific to text-generating agents.
“The under-resolution of the equal-price rate is thus not specific to text-generating agents.”
Quote in the paperSubstantial claim - Interpretationown data
The agent responds to the form of a statement, not to its information.
“It thus responds to the form of a statement, not to its information (Appendix L).”
Quote in the paperSubstantial claim - Interpretationown data
Combined influence is consistent with additivity: an auditor could approximate a combination from single-cue measurements rather than testing every one.
“Combined influence is thus consistent with additivity: an auditor could approximate a combination from single-cue measurements rather than testing every one.”
Quote in the paperSubstantial claim - Interpretationreasoning
An unchanged sweep thus also prices a non-linguistic intervention.
“An unchanged sweep thus also prices a non-linguistic intervention (Contribution 1).”
Quote in the paperSubstantial claim - Interpretationown data
The paper reads scarcity as a small positive price-equivalent below its resolution.
“We read it as a small positive price-equivalent below our resolution.”
Quote in the paperSubstantial claim - Interpretationreasoning
Cross-model magnitudes conflate cue pull with price sensitivity.
“Since cross-model magnitudes conflate cue pull with price sensitivity”
- Also stated in: § 6 Limitations · plain
“A price-equivalent combines a cue's pull with the model's price sensitivity, so crossmodel magnitudes conflate the two.”
Quote in the paperSubstantial claim - Also stated in: § 6 Limitations · plain
- Interpretationown data
A pooled share of one half is not indifference, since an agent that always picks the first-listed product also yields it.
“Likewise, a pooled share of one half is not indifference, since an agent that always picks the first-listed product also yields it (Appendix B).”
Quote in the paperSubstantial claim - Interpretationreasoning
Generalization to new products is limited by six pairs per category.
“Generalization to new products is limited by six pairs per category.”
Quote in the paperSubstantial claim - Interpretationreasoning
Only the price a cue can absorb is what a seller can convert into money.
“Only the price a cue can absorb is what a seller can convert into money.”
Quote in the paperSubstantial claim - Interpretationown data
Primacy bias is a first-order property of agentic choice, not a nuisance to average away.
“Third, primacy bias is a first-order property of agentic choice, not a nuisance to average away.”
Quote in the paperSubstantial claim - Study design and conductreasoning
The trials are not independent product-level observations, because each condition repeats only six product pairs.
“The trials are, however, not independent product-level observations, because each condition repeats only six product pairs.”
Quote in the paperSubstantial claim - Interpretationreasoning
Evidence generalizes to different degrees along different axes.
“Evidence therefore generalizes to different degrees along different axes.”
Quote in the paperSubstantial claim - Interpretationreasoning
Jev's pooled values summarize strongly slot-dependent behavior.
“so its pooled values summarize strongly slot-dependent behavior.”
Quote in the paperNot a substantial claim - Study design and conductcitation
With only six clusters, the intervals still admit moderate interactions.
“With only six clusters, our intervals still admit moderate interactions [4].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [4]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
The low scarcity price-equivalent should be read as low for this formulation, not as immunity to the construct.
“The low scarcity price-equivalent should therefore be read as low for this formulation, not as immunity to the construct.”
Quote in the paperSubstantial claim - Interpretationown data
The social-proof dose-response is evidence that the instrument tracks persuasive strength.
“This is evidence that the instrument tracks persuasive strength.”
Quote in the paperSubstantial claim - Interpretationown data
Where content gives the agent little to go on, it falls back on 'take the first one.'
“Where content gives the agent little to go on, it falls back on”
Quote in the paperSubstantial claim - Interpretationreasoning
Claude Sonnet's small authority PE (1.6%) reflects a steep price response, not an unmoved model.
“Claude Sonnet's small authority PE (1.6%) thus reflects a steep price response, not an unmoved model.”
Quote in the paperSubstantial claim - Interpretationown data
These differences are not price-blindness.
“so these differences are not price-blindness.”
Quote in the paperSubstantial claim - Interpretationreasoning
Jev's pooled values are balanced-order summaries of strongly slot-dependent behavior.
“Jev's pooled values are therefore balanced-order summaries of strongly slot-dependent behavior (Figure 5).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Figure 5
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
The policy-level PE is therefore a balanced-order summary, not a position-free cue strength.
“The policy-level PE is therefore a balanced-order summary, not a position-free cue strength.”
Quote in the paperSubstantial claim - Interpretationown data
The agent responds to the relevance of an authority claim, not to the mere presence of an authoritative-sounding sentence.
“The agent thus responds to the relevance of an authority claim, not to the mere presence of an authoritative-sounding sentence.”
Quote in the paperSubstantial claim - Interpretationreasoning
A model that barely reacts to price therefore records a large PE even for a modest pull.
“A model that barely reacts to price therefore records a large PE even for a modest pull.”
Quote in the paperSubstantial claim
- May combine two claims. 135
- The quote only partly states this claim. 3
- Classified as probably not a substantial claim. 68
May combine two claims.
Findingown dataAt equal price the agent chose the strong social-proof product in 100% of trials (144/144), and kept choosing it well into the positive-premium range.
“At equal price the agent chose the strong social-proof product in 100% of trials (144/144), and kept choosing it well into the positivepremium range.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataJev, a decision-native model, has a profile unlike any text model tested: it resists most cues yet remains susceptible to the strongest social-proof claims.
“strikingly, its profile is unlike any text model we tested, resisting most cues yet remaining susceptible to the strongest social-proof claims.”
- Also stated in: § 1 Introduction · plain
“Jev also shows a susceptibility profile of its own: it resists most cues but is moved by the strongest social-proof claims (Section 4.7).”
Quote in the paperSubstantial claim- Also stated in: § 1 Introduction · plain
May combine two claims.
Findingown dataThe resulting susceptibility profile is selective and model-specific, and it replicates in a second category.
“The resulting susceptibility profile is selective and model-specific, and it replicates in a second category.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataPriced this way, cues that look equally strong at equal price differ by a wide margin, so choice-rate audits substantially under-resolve seller influence.
“Priced this way, cues that look equally strong at equal price differ by a wide margin, so choice-rate audits substantially under-resolve seller influence.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataSix conditions share S_Q(0) ≥ 0.95, yet their price-equivalents differ by an order of magnitude: equal selection share at g=0, very different price.
“In the notation of Section 3.1, these conditions share 𝑆 𝑄 (0) ≥ 0.95, yet their price-equivalents PE 𝑄 differ by an order of magnitude: equal selection share at 𝑔=0, very different price.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataScarcity is chosen more often at equal price (0.95) than a gain/loss framing (0.72), yet its premium is fourteen times smaller (1.6% vs. 22.3%, disjoint intervals).
“Scarcity is chosen more often at equal price (0.95) than a gain/loss framing (0.72), yet its premium is fourteen times smaller (1.6% vs. 22.3%, disjoint intervals).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataA strong social-proof cue and a neutral factual sentence are each chosen in approximately 100% of trials at equal price, so they are indistinguishable at the ceiling.
“A strong social-proof cue and a neutral factual sentence are each chosen in ≈ 100% of trials at equal price, so they are indistinguishable at the ceiling.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe strong social-proof cue's price-equivalent is approximately 13% (approximately $17 on a $130 item); the model-free estimator gives 12.9% (CI [10.9, 17.1]).
“Its price-equivalent is ≈ 13% (≈ $17 on a $130 item): the model-free estimator gives 12.9% (CI [10.9, 17.1]).”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataThe equal-price ceiling and its resolution by price reappear in Jev, so they are not artifacts of text generation.
“The equal-price ceiling and its resolution by price reappear, so they are not artifacts of text generation.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe price sweep separates the neutral sentence from social proof: the neutral sentence is abandoned almost immediately (approximately 2% premium), while social proof holds to approximately 13%.
“The neutral sentence is abandoned almost immediately (≈ 2% premium), while social proof holds to ≈ 13%.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataSix cue conditions are each chosen in at least 95% of trials and are indistinguishable at equal price, yet their price-equivalents range from 1.6% to 21.4%.
“Six cue conditions are each chosen in at least 95% of trials and are thus indistinguishable at equal price, yet their price-equivalents range from 1.6% to 21.4%.”
- Also stated in: § 4.1 A cue's price, and why a choice rate under-resolves it · plain
“Six conditions sit at a base rate of 0.95 or above and are thus indistinguishable on the conventional axis.Priced, they span nearly 20 percentage points, from 1.6% to 21.4%.”
Quote in the paperSubstantial claim- Also stated in: § 4.1 A cue's price, and why a choice rate under-resolves it · plain
May combine two claims.
Findingown dataThe equal-price ranking can invert: gain/loss framing commands one of the largest premiums but is chosen less often than scarcity.
“The equal-price ranking can even invert: gain/loss framing commands one of the largest premiums but is chosen less often than scarcity.”
- Also stated in: § 4.1 A cue's price, and why a choice rate under-resolves it · plain
“Scarcity is chosen more often at equal price (0.95) than a gain/loss framing (0.72), yet its premium is fourteen times smaller (1.6% vs. 22.3%, disjoint intervals).”
Quote in the paperSubstantial claim- Also stated in: § 4.1 A cue's price, and why a choice rate under-resolves it · plain
May combine two claims.
Findingown dataFraming shows a clean dissociation: the agent is indifferent to number-preserving reformatting (a rescaled rating and a percent-vs-fraction restatement, both approximately 0%), yet it is strongly swayed by a gain/loss framing of the same fact (approximately 22%).
“Framing shows a clean dissociation.The agent is indifferent to number-preserving reformatting (a rescaled rating and a percent-vs-fraction restatement, both ≈ 0%), yet it is strongly swayed by a gain/loss framing of the same fact (≈ 22%).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataReframing identical information has a sharply content-dependent effect: the agent is indifferent to number-preserving reformatting (a rescaled rating and a percent-vs-fraction restatement both cross parity at approximately 0%) yet strongly swayed by a gain/loss framing of the same fact.
“Reframing identical information has a sharply content-dependent effect (Table 22).The agent is indifferent to number-preserving reformatting (a rescaled rating and a percent-vs-fraction restatement both cross parity at ≈ 0%) yet strongly swayed by a gain/loss framing of the same fact.Only the gain/loss valence moves the agent.”
Quote in the paperSubstantial claim- Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
- Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
May combine two claims.
Findingown dataAcross six product pairs, no interaction is detectable, neither pairwise nor three-way.
“Across six product pairs, no interaction is detectable, neither pairwise nor three-way.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataPrice sensitivity varies markedly: GPT-4o, Claude Sonnet, and Llama-3.3-70B abandon the pricier of two identical products almost completely by a +10% gap (P ≤ 0.01; and exactly 0.50 at equal price, confirming the design is unbiased), GPT-4o mini and Haiku do so gradually, and Nova Micro and the position-driven Llama-3.1-8B barely respond to price at all.
“Price sensitivity varies markedly: GPT-4o, Claude Sonnet, and Llama-3.3-70Babandon the pricier of two identical products almost completely by a +10% gap (𝑃 ≤ 0.01; and exactly 0.50 at equal price, confirming the design is unbiased), GPT-4o mini and Haiku do so gradually, and Nova Micro and the position-driven Llama-3.1-8Bbarely respond to price at all.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataTwo things are less stable than for GPT-4o: weak social proof outprices moderate social proof under every phrasing (0.4-1.0 vs. 0.0-0.6%), and the strong cues drift more (1.8-7.0% for strong, 14.2 to beyond 26% for very strong social proof, against 10.2-17.7 and 16.4-24.7% for GPT-4o).
“Two things are less stable than for GPT-4o (Table 20): weak social proof outprices moderate social proof under every phrasing (0.4-1.0 vs. 0.0-0.6%),and the strong cues drift more (1.8-7.0%for strong, 14.2 to beyond 26% for very strong social proof, against 10.2-17.7 and 16.4-24.7%for GPT-4o).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Table 20
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataFor scarcity, the slot-specific crossings are 6.1% and 0.9% (mean 3.5%), while the pooled PE is 1.6%.
“For scarcity, the slot-specific crossings are 6.1% and 0.9% (mean 3.5%), while the pooled PE is 1.6% (Table 5).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe ceiling replicates, but the profile does not.
“The ceiling replicates, but the profile does not.”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationThe filler sentence of Jev's length-matched control is itself dispreferred, so that control does not transfer.
“In addition, the filler sentence of its length-matched control is itself dispreferred, so that control does not transfer (Appendix K).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Appendix K
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataNova Micro keeps choosing the cued product at more than double the price (an extended sweep to +110%); its PE is therefore not identified, and its apparent susceptibility is price-insensitivity.
“Nova Micro keeps choosing the cued product at more than double the price (an extended sweep to +110%).Its PE is therefore not identified, and its apparent susceptibility is price-insensitivity.”
Quote in the paperSubstantial claimMay combine two claims.
Findingnone givenIn the price-only control, for the vacuous claim, and for percent/fraction and gain/loss framing Jev chooses the first card in every equal-price trial and the second in none.
“In the price-only control, for the vacuous claim, and for percent/fraction and gain/loss framing Jev chooses the first card in every equal-price trial and the second in none.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataReading the cue-free price-only control per position, at equal price the first slot sits at the choice-rate ceiling on every model, yet its price is gated by price sensitivity exactly as PE is.
“We read the cue-free price-only control per position.At equal price, the first slot sits at the choicerate ceiling on every model, yet its price is gated by price sensitivity exactly as PE is.”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Findingnone givenNumber-preserving reformatting is not neutral: Jev dislikes '4.8 out of 5' against '9.6 out of 10' (base rates 0.21 and 0.42).
“Number-preserving reformatting is not neutral either: Jev dislikes”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataVery strong social proof holds beyond 26% when shown first but crosses at 4.2 and 1.8% when shown second; for strong social proof the slot-specific crossings are 10.3 versus 1.2% (headphones), against 16.2 versus 10.1% for GPT-4o.
“Very strong social proof holds beyond 26% when shown first but crosses at 4.2 and 1.8% when shown second; for strong social proof the slot-specific crossings are 10.3 versus 1.2% (headphones), against 16.2 versus 10.1% for GPT-4o (Table 5).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Table 5
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataAcross the six task-engaged models, the social-proof series keeps its step pattern: the weak and moderate tiers stay at or below 4%, and at least one strong tier lies clearly above them.
“Across these six, the social-proof series keeps its step pattern: the weak and moderate tiers stay at or below 4%, and at least one strong tier lies clearly above them (Table 4).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe same authority sentence naming an irrelevant domain is nearly inert (approximately 1.9%), whereas a domain-matched version commands the full approximately 22%.
“The same authority sentence naming an irrelevant domain (”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataSocial proof switches on only at the very strong claim (15.4%), authority is worth little (1.5% against 19.8% for GPT-4o), and gain/loss framing is worth nothing.
“Social proof switches on only at the very strong claim (15.4%), authority is worth little (1.5% against 19.8% for GPT-4o), and gain/loss framing is worth nothing.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe dose-response, the gain/loss framing, the length and presence controls, the inert scarcity cue, and the null number-preserving framings all track their headphone values.
“The dose-response, the gain/loss framing, the length and presence controls, the inert scarcity cue, and the null number-preserving framings all track their headphone values (Table 3).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataUnder four task phrasings the cue ranking is stable, but the strong cues drift more than for GPT-4o.
“Under four task phrasings the cue ranking is stable, but the strong cues drift more than for GPT-4o (Appendix J).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Appendix J
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataThe cued-first crossing is uniformly higher than the cued-second crossing, adding a real per-trial advantage, while the two orders preserve the cue ordering and bracket the counterbalanced pooled value.
“The cued-first crossing is uniformly higher than the cued-second crossing-position adds a real per-trial advantage-but the two are consistent: they preserve the cue ordering and bracket the counterbalanced pooled value.”
Quote in the paperSubstantial claim- Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
- Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
May combine two claims.
Findingown dataUnder vision, primacy bias becomes near-deterministic: at equal price the agent chooses the first option in 100% of trials, so P(choose cued) is 0.50 for every pair by construction, relaxing only as price diverges; that it responds to price at all confirms it reads the rendered cards.
“Under vision the primacy bias becomes near-deterministic: at equal price the agent chooses the first option in 100% of trials, so 𝑃 (choose cued) is 0.50 for every pair by construction, relaxing only as price diverges (Table 23); that it responds to price at all confirms it reads the rendered cards.”
Quote in the paperSubstantial claim- Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
Classified as probably not a substantial claim.
Findingnone givenFour cues (strong, very strong, and length-matched social proof, and authority) are chosen in every equal-price trial in both categories.
“Four cues (strong, very strong, and length-matched social proof, and authority) are chosen in every equal-price trial in both categories.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataJev's prices depend on its input format: an earlier run that passed the same cards as a structured object with slot-named options gave strong social proof 10.8% on headphones and more than 26% on coffee machines, against 2.0 and 1.6% with the chat prompt.
“Second, Jev's prices depend on its input format: an earlier run that passed the same cards as a structured object with slot-named options gave strong social proof 10.8% on headphones and more than 26% on coffee machines, against 2.0 and 1.6% with the chat prompt.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataJev's social-proof series switches on only at the very strong claim (0.5, 0.0, 2.0, and 15.4% on headphones, against GPT-4o's 0.7, 1.3, 12.9, and 21.4%); authority is worth little (1.5 and 1.2% against 19.8 and 21.6%), and gain/loss framing nothing.
“Jev's social-proof series switches on only at the very strong claim (0.5, 0.0, 2.0, and 15.4% on headphones, against GPT-4o's 0.7, 1.3, 12.9, and 21.4%); authority is worth little (1.5 and 1.2% against 19.8 and 21.6%), and gain/loss framing nothing.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe off-domain sentence 'recommended by audio experts' on a coffee machine is never chosen at equal price (0 of 144 trials), whereas GPT-4o treats it as nearly inert (1.9%).
“The off-domain sentence”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataRaw authority (1.6-19.8%) and gain/loss PEs (0-22.3%, beyond 110% on Nova Micro) look wildly model-specific.
“Raw authority (1.6-19.8%)and gain/loss PEs (0-22.3%,beyond 110% on Nova Micro) look wildly model-specific.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAcross the battery, the agent chooses the first option in 56.3% of trials (n = 14,976), rising to approximately 65% in low-signal conditions (one-sided cues with a PE below 3%).
“Across the battery, it chooses the first option in 56.3% of trials (𝑛 = 14,976), rising to ≈ 65% in low-signal conditions (one-sided cues with a PE below 3%).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataCombining cues is consistent with additivity: no interaction between cues was detectable.
“Combining cues, by contrast, is consistent with additivity (Section 4.3, Appendix H): no interaction between cues was detectable”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Appendix H
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataThe position channel is worth at most 3.2% on the price-sensitive models, 14.0% on GPT-4o mini, and beyond 80% on the price-blind Nova Micro and Llama-3.1-8B.
“It is worth at most 3.2% on the price-sensitive models, 14.0% on GPT-4o mini, and beyond 80% on the price-blind Nova Micro and Llama-3.1-8B(Appendix D).”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataThe length and presence controls do not transfer: the 'neutral' identification-code sentence is itself dispreferred by Jev (presence control, base rates 0.32 and 0.17), so the length-matched social-proof condition (16.6 and 19.6%) exceeds social proof alone (2.0 and 1.6%) instead of isolating its content.
“First, the length and presence controls do not transfer: the”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFor the strong social-proof cue, the six per-pair price-equivalents are 10.2, 14.6, 10.0, 19.1, 11.2, and beyond 26 (no crossing), with a pooled value of 12.9%, showing real product heterogeneity around a stable pooled value.
“For the strong social-proof cue the six per-pair price-equivalents are (GPT-4o, model-free, 𝑁 = 24 per price point): In-ear ANC ($89.99)10.2; On-ear ($79.99)14.6; Over-ear ANC ($129.99)10.0; Over-ear premium ($199.99)19.1; Sport earbuds ($59.99)11.2; Wired studio ($149.99)beyond 26 (no crossing); pooled 12.9%-real product heterogeneity around a stable pooled value”
Quote in the paperNot a substantial claim- Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
- Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
May combine two claims.
Findingown dataFor Nova Micro, censored at 26%, extending the cue sweep to +110% shows Nova Micro keeps choosing the cued product throughout, on a flat plateau near 0.7 that never crosses 0.5 even at more than double the price.
“for Nova Micro, censored at 26%, we extend the cue sweep to +110%, and Nova Micro keeps choosing the cued product throughout, on a flat plateau near 0.7 that never crosses 0.5 even at more than double the price.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningModels that do not respond to price even at large premiums have unidentified price-equivalents and are reported observationally, and several cues are censored at the top of the sweep (their true premia are lower bounds).
“Models that do not respond to price even at large premiums have unidentified price-equivalents and are reported observationally, and several cues are censored at the top of the sweep (their true premia are lower bounds).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWeak and moderate social-proof claims sit near zero, and the premium switches on only at the strong claim.
“Weak and moderate claims sit near zero, and the premium switches on only at the strong claim.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAt +10%, GPT-4o, Claude Sonnet, and Llama-3.3-70B almost never keep the pricier of two identical products, whereas Nova Micro does so about half the time.
“At +10%, GPT-4o, Claude Sonnet, and Llama-3.3-70Balmost never keep the pricier of two identical products, whereas Nova Micro does so about half the time (column 𝑝 ↑ ; Appendix E).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataHolding a product's facts and cues fixed, twelve truthful rewrites of one full description move GPT-4o's PE from 2.3% to 8.0% (disjoint intervals, single pair, N=30 per price point, logistic estimator).
“Holding a product's facts and cues fixed, twelve truthful rewrites of one full description (strong social proof and scarcity woven in, LLMgenerated) move GPT-4o's PE from 2.3% to 8.0% (disjoint intervals, single pair, 𝑁 =30 per price point, logistic estimator).”
Quote in the paperSubstantial claim- The authors state this as an assumption: Stable audit environment: fixed model snapshot, prompt, decoding, and card template.
- The authors state this as an assumption: Explicit comparator: the comparator content c0 is part of the estimand.
- The authors state this as an assumption: Joint design control: the four (T,R) cells carry weight 1/4, exactly balanced in our data.
- The authors state this as an assumption: Single crossing: S_Q is weakly decreasing over the search domain.
- The authors state this as an assumption: Support: the price sweep brackets the crossing; otherwise a bound is reported.
- The authors state this as an assumption: Local smoothness: the curve is approximately linear between the two bracketing grid points.
- The authors state this as an assumption: Stable repeated sampling: no model drift during collection (Appendix O).
- The authors state this as an assumption: Explicit population: the product distribution Q is part of the estimand.
- The authors state this as an assumption: Forced-choice scope: the threshold pertains to the stated two-option protocol.
- The authors state this as an assumption: Relative-price scale: PE is a proportional premium on the reference price.
May combine two claims.
Findingown dataThe ordering of the four social-proof intensities is preserved across all four phrasings; the broader ranking is mostly stable but not exact-strong social proof (12.0% at v0) and gain/loss framing (17.2% at v0) exchange rank at v1 (17.7 vs. 14.0), and the neutral sentence drifts to 4.5% at v1 rather than sitting at the floor-and absolute magnitudes of the strong cues vary by a few points-up to ≈ 8
“The ordering of the four social-proof intensities is preserved across all four phrasings; the broader ranking is mostly stable but not exact-strong social proof (12.0% at v0) and gain/loss framing (17.2% at v0) exchange rank at v1 (17.7 vs. 14.0), and the neutral sentence drifts to 4.5% at v1 rather than sitting at the floor-and absolute magnitudes of the strong cues vary by a few points-up to ≈ 8”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Table 19
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Figure 4
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataUnder vision the bias becomes near-deterministic, which prevents identifying an image cue's PE.
“Under vision the bias becomes near-deterministic, which prevents identifying an image cue's PE (Appendix M).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe no-interaction result holds on the log-odds scale (no term survives Holm correction) and on the price scale (contrasts within a few points, all CIs spanning zero).
“This holds on the log-odds scale , no term survives Holm correction [14]) and on the price scale (contrasts within a few points, all CIs spanning zero).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [14]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataNo term in the length-matched 2^3 factorial is significant after Holm correction on the log-odds scale, and every price-scale contrast is within a few points with a CI spanning zero; combined influence is consistent with additivity at our precision.
“No term is significant after Holm correction on the log-odds scale, and every price-scale contrast is within a few points with a CI spanning zero: combined influence is consistent with additivity at our precision.”
Quote in the paperSubstantial claim- Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
- Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
May combine two claims.
Findingown dataAt equal price, GPT-4o and GPT-4o mini prefer the scarcity-marked product (base rates 0.95 and 0.88), whereas Claude Sonnet finds it aversive (0.19, PE at most 0).
“Yet at equal price, GPT-4o and GPT-4o mini prefer the scarcity-marked product (base rates 0.95 and 0.88), whereas Claude Sonnet finds it aversive (0.19, PE at most 0).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe weak, moderate, and strong social-proof intervals do not overlap on headphones, so the steps are separated in the price metric, not merely ordered by point estimates.
“The steps are separated in the price metric, not merely ordered by point estimates: the weak, moderate, and strong social-proof intervals do not overlap on headphones (Appendix C).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataStrong social proof and gain/loss exchange rank under one phrasing, and strong-cue premia drift by up to ≈ 8 points.
“Strong social proof and gain/loss, however, exchange rank under one phrasing, and strong-cue premia drift by up to ≈ 8 points (Appendix J).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Appendix J
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataPriced, these four cues span 1.5-16.6% (headphones) and 1.2-19.6% (coffee machines).
“Priced, they nevertheless span 1.5-16.6%(headphones) and 1.2-19.6%(coffee machines).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAuthority commands approximately 19.8%, comparable to the strongest social-proof cue, and gain/loss framing approximately 22%, whereas scarcity and number-preserving reformatting sit near the floor.
“Authority commands ≈ 19.8%, comparable to the strongest social-proof cue, and gain/loss framing ≈ 22%, whereas scarcity and number-preserving reformatting sit near the floor.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataScarcity commands a price-equivalent of only 1.6% (CI [1.4, 1.9]), below 3%, the level treated as the instrument's practical resolution.
“Yet it commands a price-equivalent of only 1.6% (CI [1.4,1.9]), below 3%, the level we treat as the instrument's practical resolution.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe same instrument also prices the position channel, which the platform rather than the seller controls.
“The same instrument also prices this channel, which the platform rather than the seller controls.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningIn the perception probe, the optimised image is rated slightly more premium than the standard image, so the manipulation is perceptible; yet its price-equivalent cannot be identified, because primacy saturates the response channel in the small-premium regime that matters for elicitation.
“In the perception probe the optimised image is rated slightly more premium than the standard image, so the manipulation is perceptible; yet its price-equivalent cannot be identified, because primacy saturates the response channel in the small-premium regime that matters for elicitation.”
Quote in the paperSubstantial claim- Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
Classified as probably not a substantial claim.
InterpretationreasoningPE is a formally defined, policy-conditioned parity threshold that makes very different cues comparable.
“a formally defined, policy-conditioned parity threshold that makes very different cues comparable.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationVisual Persuasion shows that image edits steer vision-language model choices.
“Visual Persuasion shows that image edits steer vision-language model choices [6]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [6]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationChu and Hou map an authority cue's breakthrough rate to an equivalent rating gain, percentage price discount, or review-count multiplier.
“In concurrent work, Chu and Hou map an authority cue's breakthrough rate to an equivalent rating gain, percentage price discount, or review-count multiplier [7].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [7]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataCounterbalance position and cue target within every (pair, price-point) cell; a first-option lean otherwise leaks into the estimate, and the pooled value is the crossing of the averaged curves, not the mean of the per-order crossings.
“(1) Counterbalance position and cue target within every (pair, price-point) cell (Section 3.2).A first-option lean of the size we document (Section 4.5) otherwise leaks into the estimate, and the pooled value is the crossing of the averaged curves, not the mean of the per-order crossings.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningPrice-equivalent auditing turns qualitative susceptibility into a single monetary number and places text and framing cues on one comparable scale.
“Price-equivalent auditing turns qualitative susceptibility into a single monetary number and places text and framing cues on one comparable scale.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenNeutral and vacuous sentences test content-free additions.
“Neutral and vacuous sentences test content-free additions.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe resolving power comes from the price intervention, not from PE per se: any audit that adds a common cardinal axis escapes the ceiling, whereas a single equal-price rate cannot.
“The resolving power comes from the price intervention, not from PE per se: any audit that adds a common cardinal axis escapes the ceiling, whereas a single equal-price rate cannot.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductreasoningIn a length control, a cue competes against a neutral sentence of matched length, which separates content from the mere presence of an added sentence.
“In a length control, a cue competes against a neutral sentence of matched length, which separates content from the mere presence of an added sentence.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataThe 26% ceiling is an empirical bracket, not a fixed constant; it sits above the largest price-equivalents observed, so the crossing falls inside the window for all but a few cues.
“The 26% ceiling is an empirical bracket, not a fixed constant.It sits above the largest price-equivalents we observe (the strongest cues cross near 13-22%), so the crossing falls inside the window for all but a few cues.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductreasoningIf the curve never reaches 0.5 within the sweep, PE is right-censored to a lower bound.
“If the curve never reaches 0.5 within the sweep, PE is right-censored to a lower bound ( †).”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationnone givenStrong cues saturate choice near 100% and become indistinguishable, and a counterbalanced first-option bias averages to a 50% rate that looks like indifference.
“Strong cues saturate the choice near 100% and become indistinguishable, and a counterbalanced first-option bias averages to a 50% rate that looks like indifference.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductreasoningWithin every (pair, pricepoint) cell the paper counterbalances both position and cue target, with six calls in each of the four target-position states per cell, ruling out slot-and product-identity confounds.
“Within every (pair, pricepoint) cell we therefore counterbalance both position (the cued product is first in exactly half of trials) and cue target (the cue sits on product A and B equally often), with six calls in each of the four target-position states per cell, ruling out slot-and product-identity confounds.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationA stronger willingness-to-pay reading would require a specified user, a budget constraint, and a utility model with a truth-inducing payoff, as in discrete-choice WTP estimation.
“A stronger willingness-to-pay reading would require a specified user, a budget constraint, and a utility model with a truth-inducing payoff, as in discrete-choice WTP estimation [23].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [23]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
InterpretationreasoningThe paper treats the possibility that a model reads price as a quality signal as a matter of interpretation rather than a design confound.
“We treat this as a matter of interpretation rather than a design confound.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationABxLab manipulates prices, ratings, product order, and textual nudges across multiple LLM agents and finds large and predictable shifts in choice.
“Closest to our setting, ABxLab manipulates prices, ratings, product order, and textual nudges across multiple LLM agents and finds large and predictable shifts in choice [5].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [5]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningIf a cue is already dispreferred at equal price (base rate <0.5), the paper reports PE ≤ 0 and flags it, with the base rate giving the identified sign.
“If a cue is already dispreferred at equal price (equal-price choice rate, hereafter base rate, <0.5), we report PE ≤ 0 and flag it ( ‡), and the base rate gives the identified sign.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationPrior work establishes that LLM shopping agents are susceptible to seller-controlled cues and that presentation can move them.
“Prior work establishes that LLM shopping agents are susceptible to such cues and that presentation can move them [5,6,11].”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [5]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [6]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [11]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningThe position-driven Llama-3.1-8B is excluded from cross-model claims, leaving the six task-engaged models those claims rest on.
“The position-driven Llama-3.1-8B is additionally excluded from cross-model claims, which leaves the six task-engaged models those claims rest on.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenThe primary estimator is model-free and locates the point where the pooled P(choose cued) curve crosses 0.5 by linear interpolation between the two neighbouring price points.
“Our primary estimator is model-free.It locates the point where the pooled 𝑃 (choose cued) curve crosses 0.5 by linear interpolation between the two neighbouring price points (details in Appendix B).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationBias Beware frames cognitive-bias cues as black-box attacks on recommender systems.
“Bias Beware frames cognitive-bias cues as black-box attacks on recommender systems [11]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [11]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim. May combine two claims.
InterpretationreasoningPE is conditional on the cue contrast, audited products, presentation-policy weights, model, prompt, and decoding configuration, and should not generally be interpreted as individual indifference or willingness to pay.
“It is conditional on the cue contrast, audited products, presentation-policy weights, model, prompt, and decoding configuration; it should not generally be interpreted as individual indifference or willingness to pay (Appendix B).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationAcross 126,000 conversations, prompts instantiating seven of Cialdini's principles increased pooled partial-or-full compliance from 35.3% to 51.3% across three frontier models from different developers.
“Across 126,000 conversations, prompts instantiating seven of Cialdini's principles increased pooled partial-or-full compliance from 35.3% to 51.3% across three frontier models from different developers, a susceptibility the authors describe as parahuman [20].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [20]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataA position-controlled logistic fit and a price×position interaction check agree with the model-free values within about 3 points wherever a crossing is identified.
“A position-controlled logistic fit and a price×position interaction check agree with the model-free values within about 3 points wherever a crossing is identified (Appendix D).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningThe paper varies price within a single trial across two fully specified, visible product cards; the reference product's price is displayed and held constant, so the swept gap is the only quantity that moves.
“We vary price within a single trial across two fully specified, visible product cards.The reference product's price is displayed and held constant, so the swept gap is the only quantity that moves.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningFraming pairs hold information constant and vary only its form, so any premium reflects form rather than content.
“Framing pairs hold information constant and vary only its form (percentage vs. fraction, a rescaled rating, and a gain/loss framing), so any premium reflects form rather than content.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningBoth information-bearing cues and information-preserving framing matter for auditing what a seller can change, even though they are interpreted differently.
“Both matter for auditing what a seller can change, even though they are interpreted differently.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationIn Chu and Hou, cue and price are evaluated in separate experiments, and the price equivalent is obtained by linearly interpolating a five-level price grid rather than by letting price and cue compete within the same trial.
“There, however, cue and price are evaluated in separate experiments, and the price equivalent is obtained by linearly interpolating a five-level price grid rather than by letting price and cue compete within the same trial.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [7]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationAuthority, social proof, and scarcity each significantly increased compliance in that study, showing that these cue families act on LLMs and not only on humans.
“authority, social proof, and scarcity each significantly increased compliance, showing that these cue families act on LLMs and not only on the humans they were formulated for.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [20]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningAlways run the cue-free price-only control alongside the sweep; PE combines cue pull with price sensitivity (under the single-index model exactly their ratio), so a raw magnitude is uninterpretable on its own, and a cross-model comparison of raw PE compares two things at once.
“(3) Always run the cue-free price-only control alongside the sweep.PE combines cue pull with price sensitivity (under the single-index model of Appendix B it is exactly their ratio), so a raw magnitude is uninterpretable on its own, and a cross-model comparison of raw PE compares two things at once (Appendix E).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationWTP elicited from GPT-3 can be of realistic magnitude relative to human estimates.
“WTP elicited from GPT-3 can be of realistic magnitude relative to human estimates [3]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [3]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Interpretationown dataAgents over-select the first-presented option, which near the parity crossing can bias PE.
“Agents over-select the first-presented option (Section 4.5), which near the parity crossing can bias PE.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationDemand curves elicited from GPT-3 are broadly downward-sloping but generally not monotone in price.
“Demand curves elicited from GPT-3 are broadly downward-sloping but generally not monotone in price [3].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [3]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningBecause the estimate is read from a prompt, the paper re-measures a cue subset under four semantically equivalent task paraphrases.
“Because the estimate is read from a prompt, we re-measure a cue subset under four semantically equivalent task paraphrases (Appendix J).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningIn a counterbalanced, position-controlled forced choice, raising the cued product's price until it is chosen only half the time yields the cue's price-equivalent: the price premium that just offsets the cue's pull on the agent's recommendation.
“In a counterbalanced, position-controlled forced choice, we raise the cued product's price until it is chosen only half the time.We call that premium the cue's price-equivalent (PE): the price premium that just offsets the cue's pull on the agent's recommendation.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningMake censoring explicit: a cue dispreferred at equal price is floor-censored; a curve that never crosses within the sweep is right-censored; a censored cell is a bound, not a value, and must not enter a ranking as one.
“(4) Make censoring explicit.A cue dispreferred at equal price is floor-censored ( ‡); a curve that never crosses within the sweep is right-censored ( †).A censored cell is a bound, not a value, and must not enter a ranking as one (Section 3.1).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationReusens et al. infer an LLM's WTP for travel attributes and compare it to human estimates.
“Reusens et al. infer an LLM's WTP for travel attributes and compare it to human estimates [23].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [23]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataRead PE as ordinal-to-interval: rankings and coarse magnitude bands survive task rephrasing and re-sampling; exact percentages drift by a few points across phrasings and vary widely across product pairs.
“(5) Read PE as ordinal-to-interval.Rankings and coarse magnitude bands survive task rephrasing and re-sampling; exact percentages drift by a few points across phrasings and vary widely across product pairs (Section 4.6, Appendix F and Appendix J).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningCues are single sentences appended to a product's neutral description; price, rating, and specifications stay untouched, so a cue competes only through its wording.
“Cues are single sentences appended to a product's neutral description.Price, rating, and specifications stay untouched, so a cue competes only through its wording.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningBecause the first-option bias can look like indifference, it is a caution for any choice-based evaluation of agents, including LLM-as-judge.
“Because this bias can look like indifference, it is a caution for any choice-based evaluation of agents, including LLM-as-judge (Section 4).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationFor 95% CIs the paper uses a nonparametric bootstrap resampled by product pair.
“For 95% CIs we use a nonparametric bootstrap resampled by product pair [10].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [10]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim. May combine two claims.
InterpretationreasoningPE audits seller-controlled influence relative to price and does not by itself show that a cue induces an irrational bias.
“PE audits seller-controlled influence relative to price and does not by itself show that a cue induces an irrational bias.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown dataEach neutral description was checked for persuasive content by an LLM judge on nine persuasion dimensions for headphones and by a manual read of all pairs.
“Each neutral description was checked for persuasive content by an LLM judge on nine persuasion dimensions (headphones) and by a manual read of all pairs (Appendix N).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationAltering only an item's title can raise its exposure in LLM-based recommenders while leaving overall recommendation performance largely unchanged.
“altering only an item's title can raise its exposure in LLM-based recommenders while leaving overall recommendation performance largely unchanged [31].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [31]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
Study design and conductown dataNova Pro is dropped for a high non-response rate, leaving the seven models of the main dataset over which aggregate figures are reported.
“Nova Pro is dropped for a high non-response rate, which leaves the seven models of the main dataset over which we report aggregate figures (e.g. the headline trial count).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenPE auditing is framed as a reusable auditing protocol with three components: a counterbalanced, position-controlled price sweep yielding PE; a cue-free price-sensitivity control calibrating cross-model comparison; and a primacy diagnostic guarding choice-based readings.
“We frame PE auditing as a reusable auditing protocol with three components: a counterbalanced, position-controlled price sweep that yields the price-equivalent (Section 3.1); a cue-free price-sensitivity control that calibrates cross-model comparison (Section 4.4, Appendix E); and a primacy diagnostic that guards choice-based readings (Section 3.2, Section 4.5).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe divergence between choice and price echoes a long-documented human dissociation between choice and valuation, in which the two elicitations weight attributes differently and can even reverse.
“This divergence between choice and price echoes a longdocumented human dissociation between choice and valuation, in which the two elicitations weight attributes differently and can even reverse [17,29].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [17]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [29]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationOptimising content for generative engines has been formalised as Generative Engine Optimization.
“Optimising content for generative engines has already been formalised as Generative Engine Optimization [1].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [1]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S4 (based).
Study design and conductnone givenThe protocol applies unchanged to any seller-controlled intervention, model, or category.
“The protocol applies unchanged to any seller-controlled intervention, model, or category; we instantiate it here on marketing cues across two categories and seven models (Table 1).”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductreasoningThe estimator needs no parametric form, which matters because cues routinely saturate the equal-price choice (P=1), distorting a global logistic fit.
“The estimator also needs no parametric form.This matters because cues routinely saturate the equal-price choice (𝑃=1), which distorts a global logistic fit.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningRaw PE must be read alongside price sensitivity and therefore resists a single cross-model ranking.
“It reports each model's cue-price profile rather than a single score, because raw PE must be read alongside price sensitivity and therefore resists a single cross-model ranking (Section 4.4).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Study design and conductreasoningIn a presence control, a neutral sentence competes against a second neutral sentence and should command no premium.
“In a presence control, that neutral sentence competes against a second neutral sentence and should command no premium.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Study design and conductnone givenSocial proof comes in four intensities, which serve as a dose-response calibration.
“Social proof comes in four intensities, which serve as a dose-response calibration.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenJev's interface fixes the output format, so it answers through its choice API rather than a free-text reply, and it has no temperature; its choice rate is largely the share of the counterbalanced layouts a card wins.
“Jev's interface fixes the output format, so it answers through its choice API rather than a free-text reply, and it has no temperature; its choice rate is largely the share of the counterbalanced layouts a card wins.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningA cue can be broad and shallow (scarcity) or narrow and deep (gain/loss framing).
“A cue can be broad and shallow (scarcity) or narrow and deep (gain/loss framing).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe headline trial count gives high precision with respect to each model's stochastic sampling within a condition.
“The headline trial count gives high precision with respect to each model's stochastic sampling within a condition.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductreasoningThis is a best-of-N selection with an out-of-sample confirmation that guards against the winner's curse.
“This is a best-of-𝑁 selection with an out-of-sample confirmation that guards against the winner's curse.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe audit measures susceptibility under clean conditions rather than predicting behaviour in a live shopping environment.
“It therefore measures susceptibility under clean conditions rather than predicting behaviour in a live shopping environment, where cues compete with search, reviews, and multistep navigation.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductown dataThe core cue set is run on the seven main-dataset models, with Nova Pro excluded for a 21% non-response rate.
“We run the core cue set on the seven main-dataset models (Nova Pro is excluded for a 21% non-response rate).”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductreasoningThe social-proof levels co-vary wording, customer count, and superlatives, so the series is an intensity gradient as a seller would write it, not a single-factor dose.
“The levels co-vary wording, customer count, and superlatives, so the series is an intensity gradient as a seller would write it, not a single-factor dose.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningA price-equivalent rises with a cue's pull and falls with the model's sensitivity to price.
“A price-equivalent rises with a cue's pull and falls with the model's sensitivity to price”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Study design and conductnone givenEvery cue here is a single, factually plausible sentence stipulated true of the product.
“Every cue here is a single, factually plausible sentence stipulated true of the product.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationBecause each condition contains only six product pairs, the cluster bootstrap generalizes over six units, and a percentile interval on six clusters can understate uncertainty.
“Because each condition contains only six product pairs, the cluster bootstrap generalizes over six units, and a percentile interval on six clusters can understate uncertainty [4, Sec.VI].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [4]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataCounterbalancing removes the first-option lean from the pooled estimate, and a price×position test finds no distortion.
“Counterbalancing removes this lean from the pooled estimate, and a price×position test finds no distortion (Appendix D).”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningFor weak cues, the order dependence is large relative to the pooled value, so the policy-level PE should be read as a balanced-order summary rather than a position-free cue strength.
“For weak cues this order dependence is large relative to the pooled value, so the policy-level PE should be read as a balanced-order summary rather than a position-free cue strength.”
Quote in the paperSubstantial claim- Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
- Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
Classified as probably not a substantial claim.
PremisereasoningA pooled PE is the crossing of the averaged curve and need not equal the median of the pair-level crossings.
“A pooled PE is the crossing of the averaged curve and need not equal the median of the pair-level crossings (Appendix B).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenWe neither fabricate false claims nor optimize toward deception.
“We neither fabricate false claims nor optimize toward deception”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe agents' susceptibility is selective and does not mirror the profile that classic persuasion accounts would predict.
“Second, the agents' susceptibility is selective and does not mirror the profile that classic persuasion accounts would predict.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe composition test covers one model and one cue per family.
“The composition test covers one model and one cue per family.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe first-option bias matters in itself: any method that reads preferences off agent choices, including LLM-as-judge evaluation, must control option order or risk reporting position as preference.
“The bias nonetheless matters in itself.Any method that reads preferences off agent choices, including LLM-as-judge evaluation, must control option order or risk reporting position as preference.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductreasoningThe paper reports such models observationally rather than ranking a censored number.
“We report such models observationally rather than ranking a censored number.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataA cross-model audit should not be presumed to transfer, and raw PE must be read alongside price sensitivity, not as cue strength.
“The upshot is that a cross-model audit should not be presumed to transfer, and raw PE must be read alongside price sensitivity, not as cue strength.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataCounterbalancing does not mean averaging the two crossings; the pooled PE is the crossing of the averaged position-specific curves, which in general differs from the mean of their crossings.
“Counterbalancing does not mean averaging the two crossings.The pooled PE is the crossing of the averaged position-specific curves, which in general differs from the mean of their crossings.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe audited models are a diverse convenience sample rather than a random draw, so claims hold for these models, not for 'LLMs' in general.
“Finally, the audited models are a diverse convenience sample rather than a random draw, so claims hold for these models, not for”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductown dataReading the equal-price base rate as a validity gate, the paper reports over the six task-engaged models.
“Reading the equal-price base rate as a validity gate, we report over the six task-engaged models.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningBecause raw magnitudes must be read alongside price sensitivity rather than as cue strength, the response resists a single cross-model ranking.
“Because raw magnitudes must be read alongside price sensitivity rather than as cue strength, the response resists a single cross-model ranking.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataA PE combines a cue's pull with the model's price sensitivity, and price sensitivity itself varies sharply.
“A PE, however, combines a cue's pull with the model's price sensitivity, and price sensitivity itself varies sharply.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenIt is further shaped by a strong primacy bias that any choice-based evaluation must control.
“It is further shaped by a strong primacy bias that any choice-based evaluation must control.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenThe scarcity result departs from scarcity's potency on human shoppers, a contrast with the persuasion literature, not a measured human baseline, and tested in a single formulation.
“This departs from scarcity's potency on human shoppers (a contrast with the persuasion literature, not a measured human baseline, and tested in a single formulation).”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe two quantities measure different things: how often a cue wins when price is tied, and how much price it can absorb.
“The two quantities measure different things: how often a cue wins when price is tied, and how much price it can absorb.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningBecause GPT-4o is so price-sensitive, its double-digit PEs reflect a genuinely strong cue pull that overcomes a steep price response-not price-blindness.
“Because GPT-4o is so price-sensitive, its double-digit PEs reflect a genuinely strong cue pull that overcomes a steep price response-not price-blindness.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenEach construct in the main battery is tested in a single formulation, in particular one scarcity sentence.
“Each construct in the main battery is also tested in a single formulation, in particular one scarcity sentence.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataPE is ordinal-to-interval: rankings and coarse bands are trustworthy, exact percentages are not.
“PE is therefore ordinal-to-interval: rankings and coarse bands are trustworthy, exact percentages are not.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe per-pair spread (10 to over 26%) is genuine product heterogeneity, which the pooled estimand averages over by design.
“The per-pair spread (10 to over 26%) is genuine product heterogeneity, which the pooled estimand averages over by design.”
Quote in the paperSubstantial claim- Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
- Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
May combine two claims.
Interpretationown dataWording is a real lever, but several times smaller than the choice of cue (0.7-21.4%).
“Wording is thus a real lever, but several times smaller than the choice of cue (0.7-21.4%).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe study uses no human subjects and no personal data.
“The study uses no human subjects and no personal data.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenOn this scale, the agents' response is selective, not a simple copy of the human profile, and partly shared across models.
“On this scale, the agents' response is selective, not a simple copy of the human profile, and partly shared across models.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown dataJev received the chat models' prompt verbatim, counterbalanced as in Section 3.2 (24 queries per pair and price point, 49,824 queries, none failed).
“Jev received the chat models' prompt verbatim, counterbalanced as in Section 3.2 (24 queries per pair and price point, 49,824 queries, none failed).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningWith only six clusters, the pair-clustered 95% bootstrap intervals are wide and, near zero, lumpy; they are coarse bands rather than precise limits.
“With only six clusters the intervals are wide and, near zero, lumpy.They are coarse bands rather than precise limits (Appendix F).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningWhere pooled and median diverge, pairs with steep curves cross early and pull the pooled crossing down; the pooled value answers the policy-level question over the product mixture, while the pair-level distribution shows how that threshold varies across products.
“Where pooled and median diverge (e.g.Claude Sonnet, strong social proof: pooled 1.8%, pair median 10.0%), pairs with steep curves cross early and pull the pooled crossing down; the pooled value answers the policy-level question over the product mixture, the pair-level distribution how that threshold varies across products.”
Quote in the paperSubstantial claim- Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
- Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
May combine two claims.
Study design and conductreasoningComposition is tested with a length-matched 2^3 factorial; three cross-family cues are each present or absent in a fixed slot that otherwise holds a neutral filler, so sentence count is constant and the length/presence confound cancels in every interaction contrast.
“We test composition with a length-matched 2 3 factorial.Three cross-family cues (social proof, authority, scarcity) are each present or absent in a fixed slot that otherwise holds a neutral filler.Sentence count is therefore constant, and the length/presence confound cancels in every interaction contrast (Appendix H).”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningTwo categories give initial cross-category evidence, but both are consumer-electronics durable goods, so generalization to structurally different domains (e.g., services such as travel or lodging) is untested.
“Two categories give initial cross-category evidence, but both are consumer-electronics durable goods, so generalization to structurally different domains (e.g., services such as travel or lodging) is untested.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThe saturated equal-price rate cannot make this choice.
“The saturated equal-price rate cannot make this choice.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningThe fixed seed pins only stimulus construction and counterbalancing, not model sampling; for closed APIs this does not guarantee identical outputs, so per-trial logs are released and results are reported as distributions over N repeats rather than single deterministic outputs.
“Our fixed seed therefore pins only stimulus construction and counterbalancing, not model sampling; for closed APIs this does not guarantee identical outputs, so we release per-trial logs and report results as distributions over 𝑁 repeats rather than single deterministic outputs.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenNeither the OpenAI nor the Bedrock calls pass a provider-side seed.
“Neither the OpenAI nor the Bedrock calls pass a provider-side seed.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningThe cue-free price-only control was gathered eight days later; its cross-model use as a price-sensitivity reference therefore carries a date offset of eight days.
“The one exception is the cue-free price-only control, gathered eight days later; its cross-model use as a price-sensitivity reference therefore carries a date offset of eight days.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown dataThe first author read all twelve pairs in both categories and checked them for persuasive wording and for balanced wording between the two sides; all twelve pairs passed.
“In addition, the first author read all twelve pairs in both categories and checked them for persuasive wording (social proof, scarcity, authority, evaluative wording, superlatives, embedded price or rating) and for balanced wording between the two sides.All twelve pairs passed.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataOn the reference model (GPT-4o) all cue conditions and their controls were collected within each category in a single same-day session (headphones on 17 July, coffee machines on 19 July), so condition is not confounded with collection date for the within-model cue comparisons.
“on the reference model (GPT-4o) all cue conditions and their controls were collected within each category in a single same-day session (headphones on 17 July, coffee machines on 19 July), so condition is not confounded with collection date for the within-model cue comparisons.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataAfter the audit, the judge rubric was extended by a tenth dimension (normative/eco valence), because the judge had passed a sustainability-coded sentence that nonetheless commanded a premium; this extension was not used to re-score the stimuli.
“After the audit, the judge rubric was extended by a tenth dimension (normative/eco valence), because the judge had passed a sustainability-coded sentence that nonetheless commanded a premium.This extension was not used to re-score the stimuli.”
Quote in the paperNot a substantial claim- Rests on an assumption: The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
Classified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenSampling temperature 0.7; N=24 trials per (pair, price-point) (N=12 for robustness paraphrases); premium levels 0, 2, 4, 6, 8, 12, 18, and 26%, extended to 60% for additivity; bootstrap of 2000 resamples clustered by product pair; fixed random seed; position and cue-target counterbalancing within each (pair, price-point) cell.
“Sampling temperature 0.7; 𝑁 =24 trials per (pair, price-point) (𝑁 =12 for the robustness paraphrases); premium levels 0, 2, 4, 6, 8, 12, 18, and 26%, extended to 60% for the additivity runs; bootstrap of 2000 resamples clustered by product pair; fixed random seed; position and cue-target counterbalancing within each (pair, price-point) cell.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningWe accessed the OpenAI models via the rolling aliases gpt-4o and gpt-4o-mini rather than pinned dated snapshots-a reproducibility caveat, since the served snapshot can change over time.
“We accessed the OpenAI models via the rolling aliases gpt-4o and gpt-4o-mini rather than pinned dated snapshots-a reproducibility caveat, since the served snapshot can change over time”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe main audit is 113,472 trials over 107 conditions.
“The main audit is 113,472 trials over 107 conditions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningConditions were collected in blocks-one run per condition-rather than temporally interleaved, so a change in the served model during collection could in principle confound with condition.
“Conditions were collected in blocks-one run per condition-rather than temporally interleaved, so a change in the served model during collection could in principle confound with condition.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenStructural checks additionally enforce identical specifications, identical price and rating, and matched description length.
“Structural checks additionally enforce identical specifications, identical price and rating, and matched description length.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataNova Pro's 21% non-response rate is why it is excluded; all other models parse at ≥99.9%.
“Nova Pro's 21% non-response rate is why it is excluded; all other models parse at ≥ 99.9%.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningWhen option-order choice is near-deterministic, the policy average is pinned at 0.50 and PE is not identified; this is a boundary case of the counterbalanced policy estimand, not evidence of a null.
“This is a boundary case of our counterbalanced (50/50) policy estimand (Section 3.1)-when option-order choice is near-deterministic, the policy average is pinned at 0.50 and PE is not identified-not evidence of a null; a position-free paradigm (single-product valuation, or an image-only 2AFC) is required to estimate an image premium.”
Quote in the paperSubstantial claim- Rests on an assumption: The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
May combine two claims.
Study design and conductown dataWithin a pair, price, rating, rating count, and specifications are identical, and the two neutral descriptions are length-matched (word count within ±15%).
“Within a pair, price, rating, rating count, and specifications are identical, and the two neutral descriptions are length-matched (word count within ±15%).”
Quote in the paperSubstantial claim
The paper relies on this without support.
Large language models are increasingly asked to shop on a user's behalf.
“Large language models are increasingly asked to shop on a user's behalf, which lets seller-controlled content such as badges, endorsements, and framing steer what they recommend.”
The authors state this as an assumption.
The agent trades price against the cue when it forms its recommendation.
“Our measure requires only that the agent trades price against the cue when it forms its recommendation.”
The authors state this as an assumption.
The cue enters as an additive utility term in a single-index model.
“a single-index model in which the cue enters as an additive utility term.”
The authors state this as an assumption.
Stable audit environment: fixed model snapshot, prompt, decoding, and card template.
“A1 Stable audit environment: fixed model snapshot, prompt, decoding, and card template.”
The authors state this as an assumption.
Explicit comparator: the comparator content c0 is part of the estimand.
“A2 Explicit comparator: the comparator content 𝑐 0 is part of the estimand.”
The authors state this as an assumption.
Joint design control: the four (T,R) cells carry weight 1/4, exactly balanced in our data.
“A3 Joint design control: the four (𝑇 , 𝑅) cells carry weight 1 4 , exactly balanced in our data.”
The authors state this as an assumption.
Single crossing: S_Q is weakly decreasing over the search domain.
“A4 Single crossing: 𝑆 𝑄 is weakly decreasing over the search domain.”
The authors state this as an assumption.
Support: the price sweep brackets the crossing; otherwise a bound is reported.
“A5 Support: the price sweep brackets the crossing; otherwise a bound is reported.”
The authors state this as an assumption.
Local smoothness: the curve is approximately linear between the two bracketing grid points.
“A6 Local smoothness: the curve is approximately linear between the two bracketing grid points.”
The authors state this as an assumption.
Stable repeated sampling: no model drift during collection (Appendix O).
“A7 Stable repeated sampling: no model drift during collection (Appendix O).”
The authors state this as an assumption.
Explicit population: the product distribution Q is part of the estimand.
“A8 Explicit population: the product distribution 𝑄 is part of the estimand.”
The authors state this as an assumption.
Forced-choice scope: the threshold pertains to the stated two-option protocol.
“A9 Forced-choice scope: the threshold pertains to the stated two-option protocol.”
The authors state this as an assumption.
Relative-price scale: PE is a proportional premium on the reference price.
“A10 Relative-price scale: PE is a proportional premium on the reference price.”
The paper relies on this without support.
This is the first price-equivalent audit of a decision-native model.
“To our knowledge, this is the first price-equivalent audit of a decisionnative model.”
The paper relies on this without support.
The LLM judge (Claude Opus) reliably scores persuasion dimensions, so its scores validly identify cue presence.
“For the headphone pairs, each description was rated 1-5 on nine persuasion dimensions (social proof, scarcity, authority, exclusivity, urgency, discount framing, storytelling, emotional language, comparative language) by an LLM judge (Claude Opus) instructed to score strictly, so that any hint of a cue scores ≥ 3.”
The paper relies on this without support.
The API models' choices in the forced-choice task are a valid proxy for AI shopper behavior in real shopping contexts.
“The agent is indifferent to number-preserving reformatting (a rescaled rating and a percent-vs-fraction restatement both cross parity at ≈ 0%) yet strongly swayed by a gain/loss framing of the same fact.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Position-specific crossings do not preserve cue ordering
MinorThe text says the first- and second-slot crossings preserve cue ordering. Table 5 ranks authority above very strong social proof when cued first (25.7% versus 22.8%), but below it when cued second (13.1% versus 20.4%).
“The cued-first crossing is uniformly higher than the cued-second crossing-position adds a real per-trial advantage-but the two are consistent: they preserve the cue ordering and bracket the counterbalanced pooled value.”
“| Social proof -very strong | 22.8 | 20.4 | 21.4 | | Authority | 25.7 | 13.1 | 19.8 |”
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 1
- D. McFadden. 1974. Conditional Logit Analysis of Qualitative Choice Behavior. In Frontiers in Econometrics, P. Zarembka (Ed.). Academic Press, 105-142.
- Authors
- Buecheler, F., Berbeglia, G., & Guo, M.
- Affiliations
- Adelaide University (AU)
- The University of Melbourne (AU)
- ORCID
- Berbeglia, Gerardo
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2026
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2610.25843
- OpenAlex
- W7223059013
- Cited by
- 0
- References
- 0
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Digital Marketing and Social Media
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- generative engine optimization, large language models, social validation, recommendation bias, Jev
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-29.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-29.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review