E-GEO: A Testbed for Generative Engine Optimization in E-Commerce

May combine two claims.

Aggarwal et al. (2024) centers on heuristics rather than a systematic optimization framework, and its impression score does not translate directly to commercial value in e-commerce.

“While foundational, this work centers on heuristics rather than a systematic optimization framework, and its impression score does not translate directly to commercial value in e-commerce.”

• cites Aggarwal et al., 2024 sourceDisputed

  The Introduction (page unavailable) explicitly calls GEO a general, flexible black-box optimization framework and describes a systematic evaluation of its methods, contrary to the claim that it centers on heuristics rather than a framework. Section 2.2.1 defines impression as a visibility metric; the copy does not assess whether that metric translates to commercial value in e-commerce. (LLM, conf=0.88)

  Checked by a reasoning model — may be wrong.

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing).

The retrieval-plus-rerank decomposition adopted descends from RAG.

“The retrieval-plus-rerank decomposition we adopt descends from RAG (Lewis et al., 2020).”

• cites Lewis et al., 2020 sourceDisputed

  The Methods (p. 2) define RAG as a retriever paired with a generator, not a reranker. The Open-domain Question Answering section (p. 5) contrasts RAG with a system that reranks documents and explicitly says a reranker is unnecessary. Thus the cited paper does not describe the claimed retrieval-plus-rerank decomposition as RAG's approach. (LLM, conf=0.88)

  Checked by a reasoning model — may be wrong.

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

A parallel line of work examines prompt injection and adversarial manipulation of LLM rankers, showing that model outputs can be systematically perturbed; these studies target exploitative rather than legitimate visibility.

“A parallel line of work examines prompt injection and adversarial manipulation of LLM rankers (Kumar and Lakkaraju, 2024; Pfrommer et al., 2024), showing that model outputs can be systematically perturbed; these studies, however, target exploitative rather than legitimate visibility.”

• cites Kumar and Lakkaraju, 2024 sourceSupported
• cites Pfrommer et al., 2024 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The notion of GEO was introduced by Aggarwal et al. (2024), who evaluated several hand-crafted rewriting heuristics for increasing a web source's visibility within generative-engine outputs, using an impression score that combines word count, citation position, and GPT-3.5-based quality assessments.

“The notion of GEO was introduced by Aggarwal et al. (2024), who evaluated several hand-crafted rewriting heuristics for increasing a web source's visibility within generative-engine outputs, using an impression score that combines word count, citation position, and GPT-3.5-based quality assessments.”

• cites Aggarwal et al., 2024 sourcePartly supported

  Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

  Experimental — accuracy not yet measured

May combine two claims.

It remains unclear whether these interventions produce meaningful value, in part because existing metrics like the impression score do not translate directly to economic impact.

“Yet it remains unclear whether these interventions produce meaningful value, in part because existing metrics like the impression score (Aggarwal et al., 2024) do not translate directly to economic impact.”

• cites Aggarwal et al., 2024 sourceSupported

May combine two claims.

With generative engines, candidate content is read directly into a model's context window and ordered by the model's learned notion of relevance and quality, so optimization now acts on the content itself.

“With generative engines, candidate content is read directly into a model's context window and ordered by the model's learned notion of relevance and quality, so optimization now acts on the content itself (Aggarwal et al., 2024; Allouah et al., 2025).”

• cites Aggarwal et al., 2024 sourcePartly supported

  Section 3.1 says the evaluated engine provides retrieved source text to an LLM, and Section 2.2.2 describes optimizing the website content itself. But Section 2.1 assigns the ranking of retrieved sources to the search engine, not to the model’s learned assessment of relevance and quality; it also describes a workflow that summarizes sources before response generation. The claimed ordering mechanism is therefore not supported by this paper. (LLM, conf=0.86)

  Experimental — accuracy not yet measured
• cites Allouah et al., 2025Partly supported

  Section 6.3 (p. 24) reports that changing product descriptions to prioritize relevant terms improved their selection by AI buying agents, supporting the point that optimization acts on content. But Section 2 (p. 10) says the main experiments showed agents screenshots of product listings, not content read directly into a model’s context window; Section 7.2 (pp. 25–26) describes a separate JSON-list variant. The paper studies product choice rather than establishing that candidate content is ordered by a learned notion of relevance and quality. (LLM, conf=0.86)

  Experimental — accuracy not yet measured

May combine two claims.

WANDS and ESCI average ∼3-3.5 words in a single sentence and Papenmeier et al. (2021)'s queries average ∼33 words, while E-GEO queries average ∼59 words.

“Quantitatively, WANDS (Chen et al., 2022) and ESCI (Reddy et al., 2022) average ∼ 3-3.5 words in a single sentence and Papenmeier et al. (2021)'s queries average ∼ 33 words , while E-GEO queries average ∼ 59 words (Table 2, which also lists representative example queries).”

• cites Chen et al., 2022 sourceNot checked — no full text of the source
• cites Reddy et al., 2022 sourceNot checked yet

  Not checked in the free run.

• cites Papenmeier et al., 2021 sourcePartly supported

  Table 2 (Dataset Statistics; page not available) reports a mean of 35 words per query for the laptop corpus, close to but not the cited ∼33. Our copy does not give a 33-word mean for Papenmeier et al.’s queries as a whole. The WANDS, ESCI, and E-GEO figures are not attributed to this source. (LLM, conf=0.84)

  Experimental — accuracy not yet measured

May combine two claims.

Sun et al. (2023) show that LLMs can match or exceed strong supervised re-rankers on standard IR benchmarks, validating the 'generative engine as LLM re-ranker' abstraction.

“A representative empirical anchor is Sun et al. (2023), who show that LLMs can match or exceed strong supervised re-rankers on standard IR benchmarks, validating the 'generative engine as LLM re-ranker' abstraction we build on.”

• cites Sun et al., 2023 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

Pryzant et al. (2023) use LLM-generated natural-language critiques as 'textual gradients' in a beam search (ProTeGi).

“Later work reframes prompt design as iterative search: Pryzant et al. (2023) use LLM-generated natural-language critiques as 'textual gradients' in a beam search (ProTeGi), and Yang et al. (2024) use LLMs themselves as black-box optimizers over prompts and their observed scores.”

• cites Pryzant et al., 2023 sourceSupported

May combine two claims.

Both Chen et al. (2025) and Wu et al. (2026) focus on the original web-page setting.

“Both papers focus on the original web-page setting.”

• cites Chen et al., 2025 sourceSupported
• cites Wu et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Chen et al. (2025) empirically document substantial differences in sourcing behavior across AI search engines, including a pronounced bias toward earned media.

“Two concurrent efforts extend the GEO landscape on the web-search side: Chen et al. (2025) empirically document substantial differences in sourcing behavior across AI search engines (including a pronounced bias toward earned media), while Wu et al. (2026) move from manual heuristics to automatically discovered engine preferences and cooperative content optimization.”

• cites Chen et al., 2025 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The reflection-driven meta-optimizer is directly inspired by the reflection module in GEPA and inherits the textual-gradient and LLM-as-optimizer flavors from ProTeGi and OPRO.

“Our reflection-driven meta-optimizer is directly inspired by the reflection module in GEPA (Agrawal et al., 2025) and inherits the textual-gradient and LLM-as-optimizer flavors from ProTeGi and OPRO.”

• cites Agrawal et al., 2025 sourceSupported

May combine two claims.

For products, the paper uses the Amazon Reviews 2023 dataset, which ships ∼23M products across 33 categories and includes titles, feature bullets, free-text descriptions, and structured details.

“For products, we use the Amazon Reviews 2023 dataset (Hou et al., 2024), which ships ∼ 23M products across 33 categories and includes titles, feature bullets, free-text descriptions, and structured details-rich textual content that GEO rewriters can operate on.”

• cites Hou et al., 2024 sourcePartly supported

  Table 1 reports 33 categories but lists 48,185,153 items and 35,393,189 item-metadata records for Amazon Reviews 2023, not approximately 23 million products. Section 3 describes structured JSON metadata with item descriptions and features, and Section C.2 confirms product titles; the copy does not establish the exact field list as worded. Section C.2 also says the paper generally used titles alone as item metadata for its benchmark. (LLM, conf=0.89)

  Experimental — accuracy not yet measured

May combine two claims.

Hou et al. (2024) introduce Amazon Reviews 2023 together with a complex product search setting that emphasizes long, natural-language shopping contexts-the same regime E-GEO targets.

“Domain-specific evidence reinforces this shift: Peng et al. (2024) show that instruction-tuning LLMs on large-scale e-commerce data meaningfully improves generalization to unseen products and tasks, and Hou et al. (2024) introduce Amazon Reviews 2023 together with a complex product search setting that emphasizes long, natural-language shopping contexts-the same regime E-GEO targets.”

• cites Hou et al., 2024 sourceSupported

Classified as probably not a substantial claim.

Inspired by prior GEO heuristics, the paper curates fifteen heuristic rewriting prompts spanning diverse styles.

“Inspired by prior GEO heuristics (Aggarwal et al., 2024; Berry, 2025; Madhavan, 2025), we curate fifteen heuristic rewriting prompts spanning diverse styles.”

• cites Aggarwal et al., 2024 sourceSupported
• cites Berry, 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Madhavan, 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Existing e-commerce datasets target retrieval relevance and use short, keyword-style queries, which do not resemble realistic interactions with shopping agents.

“Existing e-commerce datasets target retrieval relevance and use short, keyword-style queries (Papenmeier et al., 2021; Chen et al., 2022; Reddy et al., 2022), which do not resemble realistic interactions with shopping agents.”

• cites Papenmeier et al., 2021 sourcePartly supported

  Section 2.2 says publicly available query datasets contain keyword queries rather than users’ natural information needs, and the Introduction explains why keyword searches may not reflect how users would express those needs to a conversational system. But the paper describes most existing e-commerce datasets as focusing on catalogues, taxonomies, reviews, and recommendations; it does not establish that they generally target retrieval relevance or that their queries are short. Page numbers are unavailable in our copy. (LLM, conf=0.85)

  Experimental — accuracy not yet measured
• cites Chen et al., 2022 sourceNot checked — no full text of the source
• cites Reddy et al., 2022 sourceNot checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

E-commerce generative engines can be viewed as instances of retrieval-augmented generation (RAG).

“At a high level, e-commerce generative engines can be viewed as instances of retrieval-augmented generation (RAG) (Lewis et al., 2020).”

• cites Lewis et al., 2020 sourcePartly supported

  The Methods (p. 2) define RAG as retrieving text documents and using them as context to generate output. The paper does not discuss e-commerce generative engines or establish that they use this architecture, so it supports the RAG concept but not the specific classification. (LLM, conf=0.78)

  Experimental — accuracy not yet measured

May combine two claims.

Under a simple in-prompt clause flagging questionable content, overt manipulation becomes costly and optimization trajectories tend toward non-manipulative prose.

“Under a simple in-prompt clause flagging questionable content, overt manipulation becomes costly and optimization trajectories tend toward non-manipulative prose, suggesting that rank gains require genuine content improvement.”

May combine two claims.

Across all 4 × 5 = 20 cells in the red-team experiment, the mean flag rate decreases by 60 percentage points and the mean rank improved by 2.2.

“Across all 4 × 5 = 20 cells, the mean flag rate decreases by 60 percentage points and the mean rank improved by 2 . 2.”

May combine two claims.

GPT-5 and Claude cluster toward the bottom-left of Figure 5, where attacks earn little rank gain whether or not the prose is flagged, while DeepSeek, Llama, and Gemini extend further top-right.

“The five engines differ in defense strength: GPT-5 and Claude cluster toward the bottom-left of Figure 5, where attacks earn little rank gain whether or not the prose is flagged, while DeepSeek, Llama, and (to a lesser extent) Gemini extend further top-right.”

May combine two claims.

Both mean cosine distance to the centroid and mean pairwise cosine distance decrease sharply within the first few batches and plateau by step ∼4.

“Both quantities decrease sharply within the first few batches and plateau by step ∼ 4 (Figure 4)”

• AssumptionRests on an assumption: Cosine distance in text-embedding-3-large space is a valid measure of semantic convergence of prompts.

May combine two claims.

GPT-5 and Claude deliver substantial gains across the board (row-mean test improvements of +0.56 and +0.57 respectively), with GPT-5 uniformly positive on every re-ranker.

“GPT-5 and Claude deliver substantial gains across the board (row-mean test improvements of +0 . 56 and +0 . 57 respectively), with GPT-5 uniformly positive on every re-ranker.”

May combine two claims.

The same two starting prompts (superlatives and emotional) improve from significant deficits to small positives across all five re-rankers (e.g., superlatives on GPT-5 moves from -4.14 to +0.52; emotional on GPT-5 moves from -3.79 to +0.83).

“Crucially, the same two starting prompts improve from significant deficits to small positives across all five re-rankers (e.g., superlatives on GPT-5 moves from -4 . 14 to +0 . 52; emotional on GPT-5 moves from -3 . 79 to +0 . 83).”

May combine two claims.

Q3 averages 8.81/10 (median 10/10, with 81% of instances scoring ≥8 and 69% scoring 10/10).

“Q3 averages 8.81/10 (median 10/10, with 81% of instances scoring ≥ 8 and 69% scoring 10/10)”

May combine two claims.

After meta-optimization, the unique prompt (row mean +0.29, all five cells positive) and competitive prompt (row mean +0.26, all five cells positive) lift GPT-4.1 to row-mean parity with Gemini (+0.26) and clearly above DeepSeek (+0.16).

“After meta-optimization, the strongest promptsunique (row mean +0 . 29, all five cells positive) and competitive (row mean +0 . 26, all five cells positive)-lift this same rewriter to row-mean parity with Gemini (+0 . 26) and clearly above DeepSeek (+0 . 16).”

May combine two claims.

Lengthening a description is essentially unrelated to rank gain: the Spearman correlation between rank improvement and length change is ρ ≈ 0.00 overall, and the regression coefficient on length change is statistically indistinguishable from zero (p = 0.10).

“The results suggest that lengthening a description is essentially unrelated to rank gain: the Spearman correlation between rank improvement and length change is ρ ≈ 0 . 00 overall, and the regression coefficient on length change is statistically indistinguishable from zero ( p = 0 . 10).”

May combine two claims.

Meta-optimization improves 63 of the 75 (prompt × re-ranker) cells, 55 of them by at least +0.10; only 7 cells regress by at least -0.10.

“Table 6 summarizes the impact of meta-optimization: 63 of the 75 (prompt × re-ranker) cells improve, 55 of them by at least +0 . 10; only 7 cells regress by at least -0 . 10.”

May combine two claims.

On GPT-5, the worst optimized cell is -0.50 and the others land within ±0.2 of zero, despite initial cells ranging from -0.10 to -4.38.

“On GPT-5 (within-family transfer from the GPT-4.1 training surrogate), the worst optimized cell is -0 . 50 and the others land within ± 0 . 2 of zero, despite the initial cell ranging from -0 . 10 to -4 . 38 (Table 5).”

• AssumptionRests on an assumption: The five re-rankers used (GPT-5, Claude, Gemini, DeepSeek, Llama) are representative of generative shopping systems / LLM re-rankers in e-commerce.

May combine two claims.

On Claude, thirteen of fifteen optimized prompts strictly improve over their heuristic starting points, with initial cells ranging from -4.42 to +0.02 and optimized cells ranging from -0.64 to +0.40.

“On Claude (cross-family, never seen during training), thirteen of fifteen optimized prompts strictly improve over their heuristic starting points (initial cells range from -4 . 42 to +0 . 02, optimized cells range from -0 . 64 to +0 . 40).”

• AssumptionRests on an assumption: The five re-rankers used (GPT-5, Claude, Gemini, DeepSeek, Llama) are representative of generative shopping systems / LLM re-rankers in e-commerce.

May combine two claims.

Superlatives starts at 100% flag rate on every leaderboard re-ranker and ends below 8% across the board; emotional starts at 99-100% and ends at 1-6%.

“superlatives starts at 100% flag rate on every leaderboard re-ranker and ends below 8% across the board, and emotional starts at 99-100% and ends at 1-6%.”

May combine two claims.

Q4 averages 4.30/5 (49% of instances score 5/5).

“Q4 averages 4.30/5 (49% of instances score 5/5).”

May combine two claims.

The initial prompts share almost nothing beyond the factual-preservation clause, while the optimized prompts consistently incorporate a shared playbook including an explicit ranking goal, alignment with user intent, and integration of keywords and synonyms.

“The initial prompts share almost nothing beyond the factual-preservation clause as each pursues a distinct stylistic goal. The optimized prompts, in contrast, consistently incorporate a shared playbook: an explicit ranking goal, alignment with user intent, integration of keywords and synonyms, etc.”

• AssumptionRests on an assumption: The manual three-level feature scoring of prompts is reliable and valid.

May combine two claims.

The same pattern holds for the fifteen heuristic prompts: length and bullets explain R2 = 0.01 of the variance, versus R2 = 0.14 for prompt and re-ranker identity.

“The same pattern holds for the fifteen heuristic prompts of Section 5.3 (rewriter fixed to GPT-4.1): length and bullets explain R 2 = 0 . 01 of the variance, versus R 2 = 0 . 14 for prompt and re-ranker identity.”

May combine two claims.

The three adversarial starts all drift to careful, fact-grounded prose, with phrases such as 'neutral and trustworthy tone' and 'avoids exaggeration or manipulation' recurring across them.

“Inspecting the red-team-final prompts (Appendix B.8) reveals that the three adversarial starts all drift to careful, fact-grounded prose-phrases such as 'neutral and trustworthy tone' and 'avoids exaggeration or manipulation' recur across them.”

May combine two claims.

Q1 and Q2 are 100% 'Yes'.

“Q1 and Q2 are 100% 'Yes'”

The quote only partly states this claim.

Overall, heuristic prompts do not reliably outperform the simple prompt on the 2,000-query test set across the five rerankers.

“Overall, heuristic prompts do not reliably outperform the simple prompt.”

May combine two claims.

GPT-4o-mini yields uniformly negative results (row mean -0.36), with GPT-4.1 as the second-worst rewriter (row mean -0.03).

“At the other end, GPT-4o-mini yields uniformly negative results (row mean -0 . 36), with GPT-4.1 as the second-worst rewriter (row mean -0 . 03).”

May combine two claims.

Using a bulleted list carries a small but significant positive effect (coefficient +0.23, p < 0.001), yet it explains little: length and bullets jointly account for only R2 = 0.005 of the variance in rank improvement, versus R2 = 0.019 for rewriter and re-ranker identity.

“Using a bulleted list does carry a small but significant positive effect (coefficient +0 . 23, p &lt; 0 . 001), yet it explains little: length and bullets jointly account for only R 2 = 0 . 005 of the variance in rank improvement, versus R 2 = 0 . 019 for rewriter and re-ranker identity.”

May combine two claims.

E-GEO is the first e-commerce dataset designed for GEO evaluation: 13,747 long-form, conversational product queries, each paired with 10 retrieved Amazon listings drawn from a corpus of 17,046,457 unique products.

“We introduce E-GEO , the first e-commerce dataset designed for GEO evaluation: 13,747 longform, conversational product queries, each paired with 10 retrieved Amazon listings drawn from a corpus of 17,046,457 unique products.”

May combine two claims.

With GPT-4.1 as the rewriter, only four of the fifteen heuristic prompts-trick (+0.14), FAQ (+0.05), competitive (+0.03), and format (+0.02)-modestly beat or match the simple prompt baseline of -0.03; the other eleven are worse.

“only four heuristic promptstrick (row mean +0 . 14), FAQ (+0 . 05), competitive (+0 . 03), and format (+0 . 02)-modestly beat or match that baseline. The other eleven are worse”

May combine two claims.

The strongest rewriters do not inflate length-GPT-5 shortens listings by ∼14 words on average, whereas GPT-4.1 lengthens by ∼170 words but ranks near the bottom.

“Consistent with this, the strongest rewriters do not inflate length-GPT-5 shortens listings by ∼ 14 words on average, whereas GPT-4.1 lengthens by ∼ 170 words but ranks near the bottom.”

May combine two claims.

Fifteen of the twenty red-team cells move sharply up-and-left from initial to final, and the five exceptions are all sycophancy cells.

“Fifteen cells move sharply up-and-left from initial to final, and the five exceptions are all sycophancy cells, which already start in the low-flag region.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Q4 distribution: values 2/3/4/5 occur in 1/17/33/49 triples respectively.

“Q4 distribution: values 2/3/4/5 occur in 1/17/33/49 triples respectively.”

May combine two claims.

The E-GEO release has 13,747 queries and 86,060 unique products (137,470 pairs).

“The release has 13,747 queries and 86,060 unique products (137,470 pairs).”

Classified as probably not a substantial claim.

Several upstream sources (Pushshift, Amazon Reviews) are snapshots rather than a versioned corpus.

“several upstream sources (Pushshift, Amazon Reviews) are themselves snapshots rather than a versioned corpus”

Probably not a substantial claim: may not pass S3 (load-bearing).

The universal-strategy prompts tend to faithfully preserve the underlying product facts.

“The examples illustrate the same two recurring tendencies of the universal-strategy prompts (Section 5.5): conversion of marketing prose into structured, attribute-labelled bullets, and faithful preservation of the underlying product facts.”

Classified as probably not a substantial claim.

Each instance in E-GEO is a (query, 10 products) pair: a long natural-language product-seeking query and 10 Amazon listings (title, features, description, details, main category, store/brand, average rating, rating count, price).

“Each instance is a (query, 10 products) pair: a long natural-language productseeking query and 10 Amazon listings (title, features, description, details, main category, store/brand, average rating, rating count, price).”

May combine two claims.

Q3 = 3 cases included a whole-house water filter request (retrieval pulled mostly shower-head filters) and a Herman-Miller-Mirra-specific arm-pad replacement (retrieval pulled pads for other Herman Miller chairs).

“Q3 = 3 cases included a whole-house water filter request (retrieval pulled mostly shower-head filters) and a Herman-Miller-Mirra-specific arm-pad replacement (retrieval pulled pads for other Herman Miller chairs).”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Q1 and Q2 are 'Yes' on 100/100 triples.

“Q1 and Q2 are 'Yes' on 100/100 triples.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Q3 distribution: values 2/3/4/5/6/7/8/9/10 occur in 1/5/2/5/2/4/7/5/69 triples respectively.

“Q3 distribution: values 2/3/4/5/6/7/8/9/10 occur in 1/5/2/5/2/4/7/5/69 triples respectively.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

A credible study of e-commerce GEO must ask whether the strategies it uncovers are genuine content improvements or manipulative attempts to game the generative engine.

“They also raise a parallel concern: any optimizer powerful enough to systematically improve a product's ranking could, in principle, also be a tool for manipulation, and a credible study of e-commerce GEO must ask whether the strategies it uncovers are genuine content improvements or manipulative attempts to game the generative engine.”

Classified as probably not a substantial claim.

This tractability allows the paper to cast GEO as a concrete optimization problem.

“This tractability allows us to cast GEO as a concrete optimization problem (Section 5.4).”

May combine two claims.

The paper benchmarks seven LLM rewriters with a simple prompt and fifteen hand-crafted GEO heuristics with GPT-4.1 as the rewriter across five representative generative engines, producing the first cross-engine empirical comparison of e-commerce GEO.

“Across five representative generative engines, we benchmark seven LLM rewriters with a simple prompt and fifteen hand-crafted GEO heuristics with GPT-4.1 as the rewriter, producing the first cross-engine empirical comparison of e-commerce GEO.”

Probably not a substantial claim: may not pass S3 (load-bearing).

GEO has become an emerging concern for creators and businesses.

“Consequently, generative engine optimization (GEO), the practice of improving the visibility and relevance of content for generative engines, has become an emerging concern for creators and businesses (Berry, 2025; Madhavan, 2025).”

• cites Berry, 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Madhavan, 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Any optimizer powerful enough to systematically improve a product's ranking could, in principle, also be a tool for manipulation.

“They also raise a parallel concern: any optimizer powerful enough to systematically improve a product's ranking could, in principle, also be a tool for manipulation, and a credible study of e-commerce GEO must ask whether the strategies it uncovers are genuine content improvements or manipulative attempts to game the generative engine.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

GEO is more subtle, since gains depend on how a particular model interprets text.

“This makes GEO more subtle, since gains depend on how a particular model interprets text.”

May combine two claims.

Recent studies have observed reduced user engagement with traditional search platforms, especially when generative engines can deliver comparable content.

“Recent studies have observed reduced user engagement with traditional search platforms (Sommerfeld et al., 2025; Toscano, 2025), especially when generative engines can deliver comparable content (Lyu et al., 2025).”

• cites Sommerfeld et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Toscano, 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Lyu et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Conversational shopping tools backed by generative engines are gaining traction: Amazon has launched its AI-powered shopping assistant, and other e-commerce platforms are following suit.

“Moreover, conversational shopping tools backed by generative engines are gaining traction: Amazon has launched its AI-powered shopping assistant (Mehta and Chilimbi, 2024), and other e-commerce platforms are following suit (Bellan, 2025).”

• cites Mehta and Chilimbi, 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Bellan, 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

E-commerce GEO is both practically important and understudied.

“These developments position e-commerce GEO as both practically important and understudied.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The ranking functions behind classical search engines such as Google or Bing are proprietary and effectively opaque, and can be approached only through indirect, costly reverse-engineering.

“In contrast, the ranking functions behind classical search engines such as Google or Bing are proprietary and effectively opaque, and can be approached only through indirect, costly reverse-engineering.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The survey of Gao et al. (2024) formalizes modular RAG into retrieval, augmentation, and generation stages, which aligns naturally with the separation of candidate retrieval from LLM-based reranking.

“The survey of Gao et al. (2024) formalizes modular RAG into retrieval, augmentation, and generation stages, which aligns naturally with our separation of candidate retrieval from LLM-based reranking.”

• cites Gao et al., 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The paper manually audits a random sample of 100 (query, 10 products) instances on four items.

“We manually audit a random sample of 100 (query, 10 products) instances on four items:”

May combine two claims.

Optimized prompts can lift a rewriter significantly, while heuristic engineering tends to hurt a rewriter.

“This suggests that, while heuristic engineering tends to hurt a rewriter, optimized prompts can lift it significantly.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The choice of meta-optimizer is modular in this setting, and the paper deliberately adopts a simple reflection-based variant to demonstrate this paradigm's potential on E-GEO.

“The choice of meta-optimizer is modular in our setting, and we deliberately adopt a simple reflectionbased variant to demonstrate this paradigm's potential on E-GEO.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The questionable-products field plays no role in the results of this section; it is used to compute the flag rate that anchors the adversarial-robustness analysis of Section 6.

“The questionable-products field plays no role in the results of this section; it is used to compute the flag rate that anchors the adversarial-robustness analysis of Section 6.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The lowest-effort GEO strategy sellers might employ is to simply ask an off-the-shelf chatbot to rewrite their product description with the goal of improving its ranking.

“Given the popularity and accessibility of LLM-backed chatbots today, the lowest-effort GEO strategy sellers might employ is to simply ask an off-the-shelf chatbot to rewrite their product description with the goal of improving its ranking.”

May combine two claims.

In our setting, rank gains require genuine content improvement, and GEO is not a manipulation game but a well-defined optimization problem.

“Therefore, in our setting, rank gains require genuine content improvement, and GEO is not a manipulation game but a well-defined optimization problem.”

May combine two claims.

The full dataset is released, with a fixed split of 2,000 test queries reserved for evaluation.

“We release the full dataset, with a fixed split of 2,000 test queries reserved for evaluation.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Industry estimates indicate that a single-rank increase can translate to tens of thousands of dollars in annual revenue for one product.

“Industry estimates also indicate that a single-rank increase can translate to tens of thousands of dollars in annual revenue for one product.”

• cites https://titannetwork.com/amazon-seoNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

r/BuyItForLife is chosen as the query source because its durable-goods framing elicits exactly the signal GEO needs: posts routinely state explicit constraints, prior ownership experience, budgets, and use cases, and the focus on long-lived products sidesteps much of the trend- and season-driven churn that dominates fast-moving categories.

“We choose r/BuyItForLife as the query source because its durable-goods framing elicits exactly the signal GEO needs: posts routinely state explicit constraints, prior ownership experience, budgets, and use cases, and the focus on long-lived products sidesteps much of the trend- and season-driven churn that dominates fast-moving categories.”

May combine two claims.

The questionable-content clause makes adversarial optimization a dominated strategy: minimizing the flag rate is necessary for higher ranks.

“The questionable-content clause makes adversarial optimization a dominated strategy: minimizing the flag rate is necessary for higher ranks”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

E-GEO's long-form, intent-rich queries and realistic listings support a broader range of uses: a testbed for product-description optimization under commerce-style queries, and a source of conversational product-seeking queries for retrieval-augmented generation and shopping-agent research.

“While we use E-GEO to study generative engine optimization, its long-form, intent-rich queries and realistic listings support a broader range of uses: a testbed for productdescription optimization under commerce-style queries, and a source of conversational productseeking queries for retrieval-augmented generation and shopping-agent research.”

Classified as probably not a substantial claim. May combine two claims.

The user prompt is the main knob through which the rewriting strategy is controlled and is thus the crux of the investigations.

“Aside from the choice of the underlying rewriting LLM, this user prompt is the main knob through which we control the rewriting strategy and is thus the crux of our investigations below.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

GEO is constrained to preserve the semantic content of product descriptions, so standard retrieval mechanisms (embedding- or keyword-based) should be largely invariant to rewriting.

“Second, GEO is constrained to preserve the semantic content of product descriptions, so standard retrieval mechanisms (embedding- or keyword-based) should be largely invariant to rewriting.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Large-scale retrieval is typically handled by highly optimized, specialized systems, while re-ranking benefits from the richer contextual reasoning afforded by LLMs.

“First, large-scale retrieval is typically handled by highly optimized, specialized systems, while re-ranking benefits from the richer contextual reasoning afforded by LLMs.”

Classified as probably not a substantial claim.

The cross-engine evaluation spans five representative LLM re-rankers from both proprietary and open-weight groups.

“This motivates the cross-engine evaluation we develop in Section 5, which spans five representative LLM re-rankers from both groups.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

A practitioner moving beyond a one-line simple prompt may try to encode their priors about what makes a good product description.

“A practitioner moving beyond a one-line simple prompt may try to encode their priors about what makes a good product description.”

May combine two claims.

The e-commerce generative-engine ecosystem is heterogeneous, spanning both proprietary models (e.g., GPT, Claude, Gemini) and open-weight ones (e.g., DeepSeek, Llama), each with its own ranking behavior.

“In practice, the e-commerce generative-engine ecosystem is heterogeneous, spanning both proprietary models (e.g., GPT, Claude, Gemini) and openweight ones (e.g., DeepSeek, Llama), each with its own ranking behavior.”

Classified as probably not a substantial claim.

Every re-ranker uses its respective CL4R1T4S-extracted, realistic system prompt to approximate the behavior users see on each chatbot's web interface.

“To approximate the behavior users see on each chatbot's web interface, every re-ranker uses its respective CL4R1T4S -extracted, realistic system prompt.”

• cites https://github.com/elder-plinius/CL4R1T4SNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based).

The generative engine then synthesizes a natural-language response that often includes an accompanying ranked list of recommended products.

“The generative engine then synthesizes a natural-language response that often includes an accompanying ranked list of recommended products.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Sellers cannot know which engine a given user will use, so an effective rewriting strategy must work across popular engines to preserve visibility.

“Sellers cannot know which engine a given user will use, so an effective rewriting strategy must work across popular engines to preserve visibility.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The prompt meta-optimization approach sits within the broader literature on automatic prompt engineering.

“Our prompt meta-optimization approach sits within the broader literature on automatic prompt engineering.”

Classified as probably not a substantial claim. May combine two claims.

GEO is conceptualized as a strategy that rewrites a product description to improve its ranking across user queries without access to the queries themselves because the seller cannot know which queries will be issued by future users.

“Given this objective, we conceptualize GEO as a strategy that rewrites a product description to improve its ranking across user queries (Figure 2) without access to the queries themselves because the seller cannot know which queries will be issued by future users.”

May combine two claims.

The ranking signal is directly observable and has a clear economic interpretation since higher ranks translate strongly into more clicks, conversions, and revenue.

“This ranking signal is directly observable and has a clear economic interpretation since higher ranks translate strongly into more clicks, conversions, and revenue (Baye et al., 2009).”

• cites Baye et al., 2009 sourceNot checked — no full text of the source

Classified as probably not a substantial claim.

The distinguishing feature of this setting is the objective: rather than optimizing a generic task-accuracy metric, the paper optimizes for a product's rank in a generative-engine's recommendation list, grounding the optimization loop in a well-defined commercial outcome.

“What distinguishes our setting is the objective : rather than optimizing a generic task-accuracy metric, we optimize for a product's rank in a generative-engine's recommendation list, grounding the optimization loop in a well-defined commercial outcome.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The per-engine statistics were shown to the meta-optimizer under anonymized labels (Model A/B/C/D) to blunt self-preference.

“To blunt self-preference, the per-engine statistics are shown to M under anonymized labels (Model A/B/C/D).”

Classified as probably not a substantial claim.

A controlled causal experiment is beyond the paper's scope.

“A controlled causal experiment is beyond our scope, but since every rewriter receives the same one-line prompt and only the rewritten text varies, we can examine this question observationally.”

May combine two claims.

Within the GEO setting, rank improvements are generally genuine and adversarial rewriting is not tolerated.

“suggesting that, within our GEO setting, rank improvements are generally genuine and adversarial rewriting is not tolerated.”

Probably not a substantial claim: may not pass S4 (based).

Deployed generative engines and shopping agents are complex systems whose internals are hidden from sellers.

“Like classical search engines, deployed generative engines and shopping agents are complex systems whose internals are hidden from sellers.”

Classified as probably not a substantial claim. May combine two claims.

The E-GEO benchmark fills the complementary e-commerce gap, where visibility is operationalized as a product's rank in the generative engine's recommendation list and is directly tied to measurable outcomes such as clicks and conversions.

“Our E-GEO benchmark fills the complementary e-commerce gap, where visibility is operationalized as a product's rank in the generative engine's recommendation list and is directly tied to measurable outcomes such as clicks and conversions (Section 3).”

Classified as probably not a substantial claim. May combine two claims.

GPT-5 and Claude were held out for evaluation only, yielding a within-family (GPT-4.1 → GPT-5) and cross-family (Claude) transferability test.

“GPT-5 and Claude are held out for evaluation only, yielding a within-family (GPT-4.1 → GPT-5) and cross-family (Claude) transferability test.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Only the rewritten, de-identified form of each query is shipped with the release; usernames, URLs, and other Reddit metadata are stripped.

“Only the rewritten, de-identified form of each query is shipped with the release; usernames, URLs, and other Reddit metadata are stripped.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Peng et al. (2024) show that instruction-tuning LLMs on large-scale e-commerce data meaningfully improves generalization to unseen products and tasks.

“Domain-specific evidence reinforces this shift: Peng et al. (2024) show that instruction-tuning LLMs on large-scale e-commerce data meaningfully improves generalization to unseen products and tasks, and Hou et al. (2024) introduce Amazon Reviews 2023 together with a complex product search setting that emphasizes long, natural-language shopping contexts-the same regime E-GEO targets.”

• cites Peng et al., 2024 sourceNot checked — no full text of the source

Classified as probably not a substantial claim. May combine two claims.

The same target per query is used by all rewriters and re-rankers, so all entries in the tables are computed on the same 2,000 test (query, product) pairs.

“The same target per query is used by all rewriters and re-rankers, so all entries in our tables are computed on the same 2,000 test (query, product) pairs.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Zhou et al. (2023) introduce automatic prompt engineering (APE) for instruction induction.

“Zhou et al. (2023) introduce automatic prompt engineering (APE) for instruction induction.”

• cites Zhou et al., 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The meta-optimizer reliably identifies factuality as a beneficial property, and the gains from meta-optimization reflect genuine, non-adversarial enhancements.

“suggesting that the meta-optimizer reliably identifies factuality as a beneficial property and that the gains from metaoptimization (Section 5.4) reflect genuine, non-adversarial enhancements.”

• AssumptionRests on an assumption: The manual three-level feature scoring of prompts is reliable and valid.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Wu et al. (2026) move from manual heuristics to automatically discovered engine preferences and cooperative content optimization.

“Two concurrent efforts extend the GEO landscape on the web-search side: Chen et al. (2025) empirically document substantial differences in sourcing behavior across AI search engines (including a pronounced bias toward earned media), while Wu et al. (2026) move from manual heuristics to automatically discovered engine preferences and cooperative content optimization.”

• cites Wu et al., 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Queries are sourced from the r/BuyItForLife subreddit, an active forum that discusses durable, high-quality products to purchase and therefore produces detailed product-seeking posts.

“We source queries from the r/BuyItForLife subreddit, 2 an active forum that discusses durable, high-quality products to purchase and therefore produces detailed product-seeking posts.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Yang et al. (2024) use LLMs themselves as black-box optimizers over prompts and their observed scores.

“Later work reframes prompt design as iterative search: Pryzant et al. (2023) use LLM-generated natural-language critiques as 'textual gradients' in a beam search (ProTeGi), and Yang et al. (2024) use LLMs themselves as black-box optimizers over prompts and their observed scores.”

• cites Yang et al., 2024Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Section 3 models the shopping engine as retrieval followed by LLM-based re-ranking, placing E-GEO inside the LLM-for-IR literature surveyed by Zhu et al. (2025), which organizes this area around LLMs as query rewriters, retrievers, re-rankers, readers, and search agents.

“Section 3 models the shopping engine as retrieval followed by LLM-based re-ranking, placing E-GEO inside the fast-growing LLM-for-IR literature surveyed by Zhu et al. (2025), which organizes this area around LLMs as query rewriters, retrievers, re-rankers, readers, and search agents-the same components GEO manipulates.”

• cites Zhu et al., 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Unlike search engines, their core ranking behavior is driven by an LLM, which can be queried directly to obtain a simplified but faithful stand-in.

“Unlike search engines, however, their core ranking behavior is driven by an LLM, which can be queried directly to obtain a simplified but faithful stand-in-the very property that makes GEO more operationally accessible (Section 2).”

Classified as probably not a substantial claim.

When a user submits a product-related query, the system first performs a retrieval step that gathers a short catalog of candidate listings from the platform's product pool.

“As illustrated in Figure 1, when a user submits a productrelated query, the system first performs a retrieval step that gathers a short catalog of candidate listings from the platform's product pool.”

May combine two claims.

A disciplined optimization process points toward better product communication-preserving facts, surfacing concrete attributes, organizing information for comparison, and matching language to likely buyer intent-as a strong and transferable strategy for sellers.

“A disciplined optimization process instead points toward better product communication-preserving facts, surfacing concrete attributes, organizing information for comparison, and matching language to likely buyer intent-as a strong and transferable strategy for sellers.”

• AssumptionRests on an assumption: The five re-rankers used (GPT-5, Claude, Gemini, DeepSeek, Llama) are representative of generative shopping systems / LLM re-rankers in e-commerce.
• AssumptionRests on an assumption: The manual three-level feature scoring of prompts is reliable and valid.
• AssumptionRests on an assumption: Cosine distance in text-embedding-3-large space is a valid measure of semantic convergence of prompts.

May combine two claims.

The gap in lexical and syntactic richness matters because LLM re-ranking decisions hinge on the model's ability to align a product's rewritten description with a user's stated preferences, constraints, and shopping context; short keyword queries collapse most of that signal.

“This gap in lexical and syntactic richness matters because LLM re-ranking decisions hinge on the model's ability to align a product's rewritten description with a user's stated preferences, constraints, and shopping context; short keyword queries collapse most of that signal.”

Classified as probably not a substantial claim.

Results on E-GEO are reported on the fixed 2,000-query test split drawn uniformly at random with seed 0.

“Results on E-GEO are reported on the fixed 2,000-query test split drawn uniformly at random with seed 0”

Probably not a substantial claim: may not pass S3 (load-bearing).

Inside the cross-engine and red-team meta-optimizers the four training re-rankers appear under anonymized labels to mitigate self-bias.

“Inside the cross-engine and red-team meta-optimizers (Sections 5.4, 6.2) the four training re-rankers appear under anonymized labels to mitigate self-bias”

Probably not a substantial claim: may not pass S4 (based).

Together with the released code, splits, and cached initial rankings, these settings reproduce every numerical result in the main text.

“Together with the released code, splits, and cached initial rankings, these settings reproduce every numerical result in the main text.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Presenting the training engines under anonymized labels Model A/B/C/D in the per-engine statistics block mitigates self-bias because the meta-optimizer is itself a GPT-4.1 instance.

“The training engines are presented under anonymized labels Model A/B/C/D in the per-engine statistics block, a deliberate measure to mitigate self-bias because the meta-optimizer is itself a GPT-4.1 instance (Section 5.4).”

• Also stated in: § B.7 Red-Team Meta-Optimizer (Used for the Runs in Section 6.2) · p. 48 · plain

  “As in the cross-engine variant, the training engines are presented under anonymized labels Model A through D inside the per-engine statistics block.”

Classified as probably not a substantial claim.

For each (query, re-ranker) pair the initial ranking is precomputed once and cached, making the 'initial' position used to compute rank improvement a deterministic function of (query, re-ranker), independent of the rewriter pipeline.

“For each (query, re-ranker) pair the initial ranking is precomputed once and cached, making the 'initial' position used to compute rank improvement a deterministic function of (query, re-ranker) , independent of the rewriter pipeline.”

Classified as probably not a substantial claim.

We explicitly red-team both heuristic and optimization-based attack pathways against this defense.

“we explicitly red-team both heuristic and optimization-based attack pathways against this defense (Sections 6.1-6.2).”

Classified as probably not a substantial claim.

Test-set product indices are drawn once and cached so all rewriter × re-ranker combinations are evaluated on the same 2,000 (query, product) pairs.

“test-set product indices are drawn once and cached so all rewriter × re-ranker combinations are evaluated on the same 2,000 (query, product) pairs.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Conclusions from E-GEO should not be assumed to transfer to other languages, regions, or product mixes without further evidence.

“conclusions should not be assumed to transfer to other languages, regions, or product mixes without further evidence.”