WANDR: A Benchmark for Wide and Deep Research

Classified as probably not a substantial claim.

Snippet reliance occurs in production agent runs, characterized by using a search-result snippet without validating that its source supports the submitted claim.

“snippet reliance (using a search-result snippet without validating that its source supports the submitted claim) [Wong et al., 2025]”

• cites Wong et al., 2025 sourcePartly supported

  Section 5.1 (p. 14) identifies failure to validate a retrieved source’s context and relevance as an agent error. Appendix E (p. 25) gives an example in which an agent used a search-result snippet about the University of Houston to answer a question about Harvard. The example comes from benchmark agent trajectories, however, not production runs. (LLM, conf=0.86)

  Experimental — accuracy not yet measured

May combine two claims.

Volume collapse occurs in production agent runs, characterized by incomplete query decomposition and insufficient retrieval at scale, sometimes followed by hallucinated values.

“volume collapse (incomplete query decomposition and insufficient retrieval at scale, sometimes followed by hallucinated values) [Lan et al., 2025, Wong et al., 2025]”

• cites Lan et al., 2025 sourcePartly supported

  The Error Analysis (p. 10) reports insufficient retrieval and agents filling tables from internal knowledge instead of web queries, producing outdated or inaccurate information. It does not identify a failure mode called “volume collapse” or establish incomplete query decomposition, and its evidence comes from benchmark tasks rather than production agent runs. (LLM, conf=0.85)

  Experimental — accuracy not yet measured
• cites Wong et al., 2025 sourcePartly supported

  Section 5.1 (pp. 13–14) identifies incomplete query decomposition and inadequate recall in large-scale searches, and reports that failed retrieval can be followed by fabricated or incorrect facts. The paper establishes these patterns in benchmarked agent runs, not production runs; it does not establish the claim's production setting. (LLM, conf=0.86)

  Experimental — accuracy not yet measured

May combine two claims.

This is roughly one sixth of WideSearch's reported 2.33-hour average for one human completion; that study additionally used two independent annotators per task [Wong et al., 2025].

“This is roughly one sixth of WideSearch's reported 2.33-hour average for one human completion; that study additionally used two independent annotators per task [Wong et al., 2025].”

• cites Wong et al., 2025 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

WANDR is the breadth-oriented counterpart to DRACO.

“WANDR is the breadth-oriented counterpart to DRACO.”

• cites Zhong et al., 2026 sourceCould not verify

  The Abstract (p. 1) describes DRACO, and Related Work (p. 2) compares it with other deep-research benchmarks, but neither identifies WANDR as its breadth-oriented counterpart. A search of our copy for “WANDR” found no passage addressing that relationship. (LLM, conf=0.72)

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

DeepSearchQA includes both single-and set-valued answers, graded against gold answer sets.

“DeepSearchQA [Gupta et al., 2026] includes both single-and set-valued answers, graded against gold answer sets.”

• cites Gupta et al., 2026 sourceSupported

May combine two claims.

Closed-ended browsing and question-answering benchmarks stress depth or end-to-end task completion, but their compact, gold-answer-based outputs do not test repeated depth across a large collection of discovered entities.

“These benchmarks stress depth or end-to-end task completion, but their compact, gold-answer-based outputs do not test repeated depth across a large collection of discovered entities.”

• cites Wei et al., 2025 sourcePartly supported

  Section 2.4 says BrowseComp requires persistence and depth of browsing but sidesteps generating long answers. The Abstract and Section 2 describe short answers checked against reference answers. The paper does not specifically assess repeated depth across a large collection of discovered entities or characterize other benchmarks as testing end-to-end task completion. (LLM, conf=0.84)

  Experimental — accuracy not yet measured
• cites Yoran et al., 2024 sourceSupported
• cites Liu et al., 2025 sourcePartly supported

  The Introduction (p. 1) says many existing benchmarks seek a single fact and check only whether the final answer matches ground truth; §2.1 (p. 3) also describes multi-hop benchmarks and outcome-only verification. Those passages support the contrast with compact, gold-answer-based outputs, but they do not specifically say that prior benchmarks fail to test repeated depth across a large collection of discovered entities. (LLM, conf=0.85)

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing).

WideSeekBench uses a multi-stage generation and quality-control pipeline to produce table-completion tasks with varied target volumes and logical constraints.

“WideSeekBench [Huang et al., 2026] uses a multi-stage generation and quality-control pipeline to produce table-completion tasks with varied target volumes and logical constraints.”

• cites Huang et al., 2026 sourceSupported

May combine two claims.

WideSearch also sources tasks from real user queries and grades populated tables cell by cell, but primarily tests broad collection with comparatively shallow per-item fields.

“WideSearch [Wong et al., 2025] also sources tasks from real user queries and grades populated tables cell by cell, but primarily tests broad collection with comparatively shallow per-item fields.”

• cites Wong et al., 2025 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

GISA spans item-, set-, list-, and table-valued answers and maintains a live subset through periodically updated answers.

“GISA [Zhu et al., 2026] spans item-, set-, list-, and table-valued answers and maintains a live subset through periodically updated answers.”

• cites Zhu et al., 2026 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

DeepWideSearch explicitly combines depth and width, converting 220 tasks from existing deep-and wide-search datasets and grading against human-verified ground-truth tables.

“Most similar to WANDR, DeepWideSearch [Lan et al., 2025] explicitly combines depth and width, converting 220 tasks from existing deep-and wide-search datasets and grading against human-verified ground-truth tables.”

• cites Lan et al., 2025 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

Seed mining follows the de-identification methodology of the DRACO benchmark: requests are sampled from a de-identified pool and reworded to remove identifying details.

“First, seed mining follows the de-identification methodology of the DRACO benchmark[Zhong et al., 2026]: requests are sampled from a de-identified pool and reworded to remove identifying details.”

• cites Zhong et al., 2026 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

WANDR tasks are produced by a semi-automated pipeline.

“produced by a semi-automated pipeline.”

Classified as probably not a substantial claim. May combine two claims.

Each WANDR task asks a system to discover a large collection of members satisfying specified criteria (the wide axis) and establish specific facts about each member through orchestrated web searches (the deep axis).

“Each task asks a system to discover a large collection of members satisfying specified criteria (the wide axis) and establish specific facts about each member through orchestrated web searches (the deep axis).”

Classified as probably not a substantial claim.

Research agents are increasingly asked to produce structured collections of facts, each requiring in-depth search to establish.

“Research agents are increasingly asked to produce not only a single answer or free-form report, but also a structured collection of facts, each requiring in-depth search to establish.”

Classified as probably not a substantial claim.

WANDR tasks require dozens to thousands of records.

“WANDR tasks require dozens to thousands of such records.”

Probably not a substantial claim: may not pass S3 (load-bearing).

WANDR originated as an internal benchmark designed to distinguish systems by how well they avoid the recurring failure modes.

“WANDR originated as an internal benchmark designed to distinguish systems by how well they avoid these failure modes.”

Classified as probably not a substantial claim.

On the deep axis, the agent must enrich each entity through multiple orchestrated web searches.

“On the deep axis, it must enrich each entity through multiple orchestrated web searches.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

A flat list and a fixed-schema table are both special cases of the qualification key hierarchy.

“A flat list and a fixed-schema table are both special cases of the qualification key hierarchy.”

Classified as probably not a substantial claim. May combine two claims.

On the wide axis, the agent usually must discover a large set of entities not supplied in advance; some tasks instead specify a closed roster and require complete coverage.

“On the wide axis, the agent usually must discover a large set of entities not supplied in advance; some tasks instead specify a closed roster and require complete coverage.”

Probably not a substantial claim: may not pass S4 (based).

Seeding identifies requests with a wide-research shape in de-identified product-usage logs.

“Seeding identifies requests with a wide-research shape in de-identified product-usage logs.”

• AssumptionRests on an assumption: The de-identified product-usage logs are a representative and valid source for deriving benchmark tasks that reflect professional knowledge work.

Probably not a substantial claim: may not pass S3 (load-bearing).

The WANDR pipeline can also create sibling variants by holding most of the hierarchy fixed while changing one controlled choice: a volume, time window, eligibility rule, or evidence bar.

“The pipeline can also create sibling variants by holding most of the hierarchy fixed while changing one controlled choice: a volume, time window, eligibility rule, or evidence bar.”

Classified as probably not a substantial claim. May combine two claims.

WANDR makes width-depth composition the scored object: every member must be discovered, enriched, and independently evidenced.

“WANDR instead makes that width-depth composition the scored object: every member must be discovered, enriched, and independently evidenced.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Because the pipeline deliberately overproduces, passing every check does not guarantee inclusion.

“Because the pipeline deliberately overproduces, passing every check does not guarantee inclusion.”

Probably not a substantial claim: may not pass S3 (load-bearing).

WANDR tasks are produced by a semi-automated pipeline with four stages: seeding, iterative authoring, admission into a candidate pool, and curation into the released set.

“Tasks are produced by a semi-automated pipeline with four stages: seeding, iterative authoring, admission into a candidate pool, and curation into the released set (Figure 3).”

Probably not a substantial claim: may not pass S3 (load-bearing).

Each released WANDR task ships as a self-contained package with its solver-facing task, verifier, fixtures, and labels.

“Each released task ships as a self-contained package with its solver-facing task, verifier, fixtures, and labels.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The mean is 1.50 labels per task.

“The mean is 1.50 labels per task.”

Classified as probably not a substantial claim.

WANDR represents the repeated wide-and-deep structure flexibly as a tree.

“WANDR represents this repeated structure flexibly as a tree.”

Classified as probably not a substantial claim. May combine two claims.

A single WANDR hierarchy can combine nesting, fan-out, fixed dispatch labels, and multiple-source requirements, while subtasks add further branches at any shared key.

“A single hierarchy can combine nesting, fan-out, fixed dispatch labels, and multiple-source requirements, while subtasks add further branches at any shared key.”

May combine two claims.

Each task has one to four labels: 294 tasks (58.8%) have one label, and 206 (41.2%) span multiple verticals.

“Each task has one to four labels: 294 tasks (58.8%) have one label, and 206 (41.2%) span multiple verticals.”

May combine two claims.

Relative to existing collection benchmarks, WANDR adds evidence-backed records, reference-free verification, and a compositional task structure: qualification key hierarchies in which discovery and per-entity enrichment form flexible trees rather than a single flat table.

“Relative to existing collection benchmarks, WANDR adds evidence-backed records, reference-free verification, and a compositional task structure: qualification key hierarchies in which discovery and per-entity enrichment form flexible trees rather than a single flat table.”

Probably not a substantial claim: may not pass S3 (load-bearing).

A fourth pattern is multi-condition research, in which every candidate must satisfy several conditions, often supported by different pages or source types.

“A fourth pattern is multi-condition research, in which every candidate must satisfy several conditions, often supported by different pages or source types.”

May combine two claims.

WANDR differs from DeepWideSearch in task shape and grading: its requests require wide-then-deep search to be repeated within one hierarchy, rather than combining separately sourced deep and wide task patterns; its grading verifies claims against submitted sources rather than relying on a gold solution.

“WANDR differs in task shape and grading: its requests require wide-then-deep search to be repeated within one hierarchy, rather than combining separately sourced deep and wide task patterns; its grading verifies claims against submitted sources rather than relying on a gold solution.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The release spans 13 vertical labels (Table 2).

“The release spans 13 vertical labels (Table 2).”

May combine two claims.

The medians are 100 members, 3.00 records per member, and 245 records per task, respectively.

“The medians are 100 members, 3.00 records per member, and 245 records per task, respectively.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The output of the WANDR pipeline is 500 public task packages; system grading is a separate process.

“The output is 500 public task packages; system grading is a separate process (Section 5).”

May combine two claims.

The number of hierarchy levels counts distinct non-member, non-URL keys across the root and all subtasks: 12.8% of tasks have none, 45.0% have one, 31.6% have two, and 10.6% have three or more.

“The number of hierarchy levels counts distinct non-member, non-URL keys across the root and all subtasks: 12.8% of tasks have none, 45.0% have one, 31.6% have two, and 10.6% have three or more.”

May combine two claims.

Required volume is below 100 records for 10.8% of tasks, 100-299 for 44.4%, 300-999 for 40.4%, and at least 1,000 for 4.4%; across all tasks, the total is 170,495 records.

“Required volume is below 100 records for 10.8% of tasks, 100-299 for 44.4%, 300-999 for 40.4%, and at least 1,000 for 4.4%; across all tasks, the total is 170,495 records.”

May combine two claims.

The number of hierarchy levels is not interchangeable with records per member: tasks with one, two, or at least three hierarchy levels all have a median of 3.00 records per member, while flat tasks have a median of 1.00.

“The number of hierarchy levels is not interchangeable with records per member: tasks with one, two, or at least three hierarchy levels all have a median of 3.00 records per member, while flat tasks have a median of 1.00.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Across admission and curation, optional human work is budgeted at about 20 minutes per released task-approximately 15 minutes for rubric sign-off and 5 minutes for labeling-plus a roughly five-minute feasibility review for tasks that cannot be settled from merged rollouts.

“Across admission and curation, optional human work is budgeted at about 20 minutes per released task-approximately 15 minutes for rubric sign-off and 5 minutes for labeling-plus a roughly five-minute feasibility review for tasks that cannot be settled from merged rollouts.”

Classified as probably not a substantial claim.

The structural variations in WANDR are building blocks, not mutually exclusive task classes.

“These variations are building blocks, not mutually exclusive task classes.”

May combine two claims.

Perplexity has duplicate identities on only 4.8% of tasks, below Gemini, Exa, OpenAI, and Parallel, but it has both the largest collapsed-value share (0.426%) and the largest conditional soft-recall loss (4.52 points).

“Perplexity has duplicate identities on only 4.8% of tasks, below Gemini, Exa, OpenAI, and Parallel, but it has both the largest collapsed-value share (0.426%) and the largest conditional soft-recall loss (4.52 points).”

May combine two claims.

Gemini is usually faithful but has the weakest complete support once faithful.

“Gemini is usually faithful but has the weakest complete support once faithful”

May combine two claims.

Once an excerpt is faithful, it supports at least one requirement on 96.9%-99.4% of records, but supports every requirement on only 55.6%-80.4%.

“Once an excerpt is faithful, it supports something on 96.9%-99.4% of records, but supports every requirement on only 55.6%-80.4%.”

• Also stated in: § 7.1 Summary · plain

  “Within evidence rendering, the dominant signature is partial proof: faithful excerpts usually support at least one requirement but often not all of them.”

• Also stated in: § 7.1 Summary · plain

  “even for Perplexity only 80.4% of faithful excerpts completely support the claim after conditioning on a page that does.”

May combine two claims.

Identity disambiguation has little aggregate effect but can cost several full soft-recall points on affected submissions.

“Identity disambiguation has little aggregate effect but can cost several full soft-recall points on affected submissions.”

May combine two claims.

Gemini has high faithfulness (79.1%) but the weakest complete support (55.6%).

“Gemini has high faithfulness (79.1%) but the weakest complete support (55.6%; Table 9).”

May combine two claims.

The mean full soft-recall effect is therefore small, 0.017-0.127 percentage points, but rises to 0.77-4.52 points when collapse changes a task's score.

“The mean full soft-recall effect is therefore small, 0.017-0.127percentage points, but rises to 0.77-4.52 points when collapse changes a task's score.”

May combine two claims.

Perplexity, Gemini, and Exa improve monotonically in soft and hard F1 across their available settings; Perplexity xhigh reaches 0.447 soft F1 and 0.224 hard F1.

“Perplexity, Gemini, and Exa improve monotonically in soft and hard F1 across their available settings; Perplexity xhigh reaches 0.447 soft F1 and 0.224 hard F1.”

May combine two claims.

Parallel has the highest identity-affected task share, although its diagnostic coverage is limited to 350 tasks.

“Parallel has the highest identity-affected task share, although its diagnostic coverage is limited to 350 tasks.”

May combine two claims.

OpenAI illustrates the converse: it retains 83.9% through discovery, then loses 68.2% of the remainder during enrichment, making enrichment 64.7% of its total loss (Figure 9).

“OpenAI illustrates the converse: it retains 83.9% through discovery, then loses 68.2% of the remainder during enrichment, making enrichment 64.7% of its total loss (Figure 9).”

May combine two claims.

SaC leads every hard metric, but coordinated identity, qualification, and rendering failures still prevent full-member completion (Table 4).

“SaC leads every hard metric, but coordinated identity, qualification, and rendering failures still prevent full-member completion (Table 4).”

May combine two claims.

Unlike target volume, additional levels reduce both precision and recall conversion for every system, by 33.7 and 35.3 percentage points on average from the shallowest to deepest bin.

“Unlike target volume, additional levels reduce both precision and recall conversion for every system, by 33.7 and 35.3 percentage points on average from the shallowest to deepest bin.”

May combine two claims.

Manual inspection matches the pattern: failures omit a date from a ranking page, air-burden language from a permit, or an individual review from a long review surface even when the selected text is faithful and partly relevant.

“Manual inspection matches the pattern: failures omit a date from a ranking page, air-burden language from a permit, or an individual review from a long review surface even when the selected text is faithful and partly relevant.”

May combine two claims.

The stage decomposition localizes the largest share of soft-recall loss to enrichment for Perplexity, Anthropic, and OpenAI, but to discovery for Gemini, Parallel, and Exa.

“The stage decomposition localizes the largest share of soft-recall loss to enrichment for Perplexity, Anthropic, and OpenAI, but to discovery for Gemini, Parallel, and Exa.”

May combine two claims.

OpenAI and Exa cost about $0.50 per task, and Exa is fastest at a 5.3-minute median, but the remaining systems reach at most 0.121 soft F1 and 0.035 hard F1.

“OpenAI and Exa cost about $0.50 per task, and Exa is fastest at a 5.3-minute median, but the remaining systems reach at most 0.121 soft F1 and 0.035 hard F1.”

May combine two claims.

OpenAI has low faithfulness (57.1%) but relatively strong completion once faithful (75.7%).

“OpenAI has low faithfulness (57.1%) but relatively strong completion once faithful (75.7%)”

May combine two claims.

Perplexity combines the strongest breadth retention with the highest conditional evidence completion.

“Perplexity combines the strongest breadth retention with the highest conditional evidence completion”

May combine two claims.

The benchmark remains unsaturated: the highest mean task-level hard precision and recall are only 0.150 and 0.134, corresponding to complete credit for roughly one in seven submitted members and one in seven required members, respectively, under the benchmark's task-level averaging.

“The benchmark remains unsaturated: the highest mean task-level hard precision and recall are only 0.150 and 0.134, corresponding to complete credit for roughly one in seven submitted members and one in seven required members, respectively, under the benchmark's task-level averaging.”

May combine two claims.

Across systems, only 2.4%-8.0% of tasks contain a duplicate entity identity, and only 0.018%-0.426% of submitted entity values collapse.

“Across systems, only 2.4%-8.0% of tasks contain a duplicate entity identity, and only 0.018%-0.426% of submitted entity values collapse.”

May combine two claims.

Perplexity falls from 0.363 soft F1 to 0.133 hard F1, Anthropic from 0.249 to 0.072, and the remaining systems from 0.055-0.121 to 0.009-0.035.

“Perplexity falls from 0.363 soft F1 to 0.133 hard F1, Anthropic from 0.249 to 0.072, and the remaining systems from 0.055-0.121to 0.009-0.035.”

May combine two claims.

The loss also appears in precision-0.389 to 0.150 for Perplexity and 0.354 to 0.137 for Anthropic-so many submitted members are only partially complete.

“The loss also appears in precision-0.389to 0.150 for Perplexity and 0.354 to 0.137 for Anthropic-so many submitted members are only partially complete.”

May combine two claims.

Resource use does not explain a common scaling response: Anthropic's latency, cost, and token use rise sharply, but Perplexity's token use falls from 4.87M to 2.95M and OpenAI's remains near 0.17M (Figure 10, top block).

“Resource use does not explain a common scaling response: Anthropic's latency, cost, and token use rise sharply, but Perplexity's token use falls from 4.87M to 2.95M and OpenAI's remains near 0.17M (Figure 10, top block).”

May combine two claims.

Perplexity leads at 0.363 soft F1 and 0.133 hard F1 with midrange cost ($5.20 per task, 14.9-minute median latency, and 3.82M total reported tokens per task).

“Perplexity leads at 0.363 soft F1 and 0.133 hard F1 with midrange cost ($5.20 per task, 14.9-minute median latency, and 3.82M total reported tokens per task).”

May combine two claims.

Full-to-retrieval conversion weakens less consistently: the first-to-last decline averages 10.4 percentage points for precision and 13.7 for recall across systems, while Gemini's precision conversion rises.

“Full-to-retrieval conversion weakens less consistently: the first-to-last decline averages 10.4 percentage points for precision and 13.7 for recall across systems, while Gemini's precision conversion rises.”

May combine two claims.

Perplexity retains 0.357 recall from 0.389 precision, the smallest gap; Anthropic falls from 0.354 to 0.222, the largest.

“Perplexity retains 0.357 recall from 0.389 precision, the smallest gap; Anthropic falls from 0.354 to 0.222, the largest.”

May combine two claims.

Late extraction cliffs do not dominate total loss Extraction removes 30.9%-72.9% of the score that reaches it, yet contributes only 7.0%-25.3% of total loss and is the smallest component for five systems.

“Late extraction cliffs do not dominate total loss Extraction removes 30.9%-72.9% of the score that reaches it, yet contributes only 7.0%-25.3% of total loss and is the smallest component for five systems.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Exa and Parallel do not expose token counts.

“Exa and Parallel do not expose token counts.”

May combine two claims.

From zero to three or more hierarchy levels, Perplexity's retrieval-only hard precision falls from 0.578 to 0.105 and hard recall from 0.523 to 0.072; Anthropic falls from 0.551 to 0.141 and from 0.407 to 0.074; and OpenAI falls from 0.263 to 0.059 and from 0.215 to 0.051.

“From zero to three or more hierarchy levels, Perplexity's retrieval-only hard precision falls from 0.578 to 0.105 and hard recall from 0.523 to 0.072; Anthropic falls from 0.551 to 0.141 and from 0.407 to 0.074; and OpenAI falls from 0.263 to 0.059 and from 0.215 to 0.051.”

May combine two claims.

Anthropic ranks second (0.249, 0.072) but has the highest cost, latency, and token use.

“Anthropic ranks second (0.249, 0.072) but has the highest cost, latency, and token use.”

May combine two claims.

From the smallest to largest required-volume bin, retrieval-only hard recall falls from 0.376 to 0.172 for Perplexity, 0.267 to 0.117 for Anthropic, and 0.191 to 0.056 for OpenAI.

“From the smallest to largest required-volume bin, retrieval-only hard recall falls from 0.376 to 0.172 for Perplexity, 0.267 to 0.117 for Anthropic, and 0.191 to 0.056 for OpenAI.”

Classified as probably not a substantial claim.

We evaluate six production systems with different search and orchestration interfaces (Table 3).

“We evaluate six production systems with different search and orchestration interfaces (Table 3).”

May combine two claims.

OpenAI peaks at high, while Parallel's soft F1 rises through ultra8x but its hard F1 dips slightly between ultra2x and ultra4x.

“OpenAI peaks at high, while Parallel's soft F1 rises through ultra8x but its hard F1 dips slightly between ultra2x and ultra4x.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The released task packages include the production implementation.

“The released task packages include the production implementation.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Complete package files, prompts, fixtures, and verifier code live in the public repository.

“Complete package files, prompts, fixtures, and verifier code live in the public repository.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The page-length analysis covers 7,193 of 7,339 page-satisfied records with joined content.

“The page-length analysis covers 7,193 of 7,339 page-satisfied records with joined content.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Detached marginal strips retain the exact-zero cases: 24 tasks for discovery, one for enrichment, and none for both.

“Detached marginal strips retain the exact-zero cases: 24 tasks for discovery, one for enrichment, and none for both.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The task-ontology view measures where structured completion becomes difficult; the individual-citation view measures source reuse and diversity; and the trajectory view measures exploration and effort.

“The task-ontology view measures where structured completion becomes difficult; the individual-citation view measures source reuse and diversity; and the trajectory view measures exploration and effort.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The submission covers the three countries at deliberately varied levels of completeness and obtains soft F1 0.57 and hard F1 0.33.

“The submission covers the three countries at deliberately varied levels of completeness and obtains soft F1 0.57 and hard F1 0.33”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The Turkey subtree isolates the two identity effects summarized in Table 8: duplicate collapse reduces the distinct count, and take-worst can lower the retained cluster score before canonical identities match main-task and subtask evidence branches.

“The Turkey subtree isolates the two identity effects summarized in Table 8: duplicate collapse reduces the distinct count, and take-worst can lower the retained cluster score before canonical identities match main-task and subtask evidence branches.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Historical rollouts accreted as tasks were authored, validated, and hardened: authors used them to test feasibility, critics inspected them for shortcuts and ambiguous obligations, and reviewers used them to decide whether a task needed another revision.

“Historical rollouts accreted as tasks were authored, validated, and hardened: authors used them to test feasibility, critics inspected them for shortcuts and ambiguous obligations, and reviewers used them to decide whether a task needed another revision.”

May combine two claims.

Domain dispersion varies largely independently of scale: its median is 53.4%, while the 5th and 95th percentiles are 5.0% and 86.9%.

“Domain dispersion varies largely independently of scale: its median is 53.4%, while the 5th and 95th percentiles are 5.0% and 86.9%.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The worldwide-sporting-event subtask fails because its evidence concerns a continental final, so multiplicative composition sets the country score to zero.

“The worldwide-sporting-event subtask also fails because its evidence concerns a continental final, so multiplicative composition sets the country score to zero.”

May combine two claims.

The median is 1.97 effective records per member, with the central 90% of tasks spanning 0.73-5.92.

“The median is 1.97 effective records per member, with the central 90% of tasks spanning 0.73-5.92.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The initial condition is observed on 494, 499, 489, 476, 341, and 473 tasks in displayed order; the conditional columns have 488, 497, 464, 470, 336, and 457 tasks with at least one faithful record.

“The initial condition is observed on 494, 499, 489, 476, 341, and 473 tasks in displayed order; the conditional columns have 488, 497, 464, 470, 336, and 457 tasks with at least one faithful record.”

May combine two claims.

An earlier, separately configured evaluation reported the same qualitative ordering, but it also used one run per system and therefore does not estimate run-to-run variance.

“An earlier, separately configured evaluation reported the same qualitative ordering [Perplexity, 2026], but it also used one run per system and therefore does not estimate run-to-run variance.”

• cites [Perplexity, 2026]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

France is complete, India receives partial credit, and Turkey fails a required subtask in the toy composite task.

“France is complete, India receives partial credit, and Turkey fails a required subtask, yielding soft F1 0.57 and hard F1 0.33.”

May combine two claims.

In internal grading ablations that disable the agentic fetch backend and use only the browser, scores decrease for every system while the ranking remains mostly stable.

“In internal grading ablations that disable the agentic fetch backend and use only the browser, scores decrease for every system while the ranking remains mostly stable.”

Probably not a substantial claim: may not pass S3 (load-bearing).

We aggregate the historical rollout archive to characterize WANDR empirically at three resolutions: task-ontology, individual-citation, and trajectory views.

“We aggregate that archive to characterize WANDR empirically at three resolutions.The task-ontology view measures where structured completion becomes difficult; the individual-citation view measures source reuse and diversity; and the trajectory view measures exploration and effort.”

May combine two claims.

A small endpoint-level correction (0.01%-0.31%) reconciles the reconstructed product with reported full soft recall; restoring the identity effect in Table 8 then reproduces the reported score exactly.

“A small endpoint-level correction (0.01%-0.31%) reconciles the reconstructed product with reported full soft recall; restoring the identity effect in Table8then reproduces the reported score exactly.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The toy composite task yields soft F1 0.57 and hard F1 0.33.

“France is complete, India receives partial credit, and Turkey fails a required subtask, yielding soft F1 0.57 and hard F1 0.33.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Each released WANDR task is a self-contained package.

“Each released WANDR task is a self-contained package.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Delhi supplies one of two required heritage sites, so zero-padding leaves soft recall at 0.5 while soft precision remains 1.

“Delhi supplies one of two required heritage sites, so zero-padding leaves soft recall at 0.5 while soft precision remains 1.”

May combine two claims.

The median retained trajectory surfaces 496 unique URLs, while the median task mean cost is $4.00.

“The median retained trajectory surfaces 496 unique URLs, while the median task mean cost is $4.00.”

May combine two claims.

The pipeline can produce new tasks and controlled siblings across domains, hierarchy shapes, evidence requirements, traps, and breadth/depth settings, while curation steers the resulting distribution.

“It can produce new tasks and controlled siblings across domains, hierarchy shapes, evidence requirements, traps, and breadth/depth settings, while curation steers the resulting distribution (Section 4).”

Classified as probably not a substantial claim.

WANDR is released primarily as an evaluation benchmark.

“WANDR is released primarily as an evaluation benchmark.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Three cities are supplied for a required count of two; Bangalore's empty heritage subtask gives it a zero composed score, so it is excluded when recall retains the two highest-scoring cities.

“Three cities are supplied for a required count of two; Bangalore's empty heritage subtask gives it a zero composed score, so it is excluded when recall retains the two highest-scoring cities.”

May combine two claims.

Output-token runs have lower soft F1 than file-delivery runs for Perplexity (0.397 versus 0.238), Anthropic (0.262 versus 0.202), and OpenAI (0.153 versus 0.122).

“Output-token runs have lower soft F1 than file-delivery runs for Perplexity (0.397 versus 0.238), Anthropic (0.262 versus 0.202), and OpenAI (0.153 versus 0.122); hard F1 shows the same ordering (0.156 versus 0.121, 0.099 versus 0.080, and 0.073 versus 0.068).”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Fetches are batched, and queue nodes use both in-memory request coalescing and persistent caches keyed to the smallest reusable unit.

“Fetches are batched, and queue nodes use both in-memory request coalescing and persistent caches keyed to the smallest reusable unit.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The output ablation compares solutions delivered through sandbox files, a file-sharing tool, or output tokens.

“The output ablation compares solutions delivered through sandbox files, a file-sharing tool, or output tokens.”

Probably not a substantial claim: may not pass S3 (load-bearing).

At runtime, expensive grading remains record-local until canonicalization, deduplication, and score rollup.

“At runtime, expensive grading remains record-local until canonicalization, deduplication, and score rollup.”

Classified as probably not a substantial claim. May combine two claims.

Records citing the same URL can share one fetch result; identical triage, canonicalization, and judgment work can also be reused when task semantics and inputs match.

“Records citing the same URL can share one fetch result; identical triage, canonicalization, and judgment work can also be reused when task semantics and inputs match.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Reference-free verification avoids constructing and maintaining exhaustive gold collections.

“Reference-free verification avoids constructing and maintaining exhaustive gold collections.”

Classified as probably not a substantial claim. May combine two claims.

Each submitted record receives verdict_retrieval and verdict_full, and the score tree aggregates those verdicts by entity and hierarchy level into soft and hard precision, recall, and F1.

“Each submitted record receives verdict_retrieval and verdict_full, and the score tree aggregates those verdicts by entity and hierarchy level into soft and hard precision, recall, and F1.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

France is fully complete: both qualifying cities have two heritage sites, and both country-level subtasks pass. All displayed precision and recall values equal one.

“France is fully complete: both qualifying cities have two heritage sites, and both country-level subtasks pass.All displayed precision and recall values equal one.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The released grader accepts multiple task roots, flattens their records into one streaming queue graph, and executes fetch, triage, canonicalization, deduplication, and judgment with stage-specific concurrency.

“The released grader accepts multiple task roots, flattens their records into one streaming queue graph, and executes fetch, triage, canonicalization, deduplication, and judgment with stage-specific concurrency.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

For RL-scale task supply, authoring and admission can run fully automatically, including feasibility and judge-quality gates; periodic human audits can monitor distribution drift without sitting on the generation path.

“For RL-scale task supply, authoring and admission can run fully automatically, including feasibility and judge-quality gates; periodic human audits can monitor distribution drift without sitting on the generation path.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Workload is explicit in each task's key hierarchy: every level declares a required count.

“Workload is explicit in each task's key hierarchy: every level declares a required count.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Hard F1 shows the same ordering for Perplexity (0.156 versus 0.121), Anthropic (0.099 versus 0.080), and OpenAI (0.073 versus 0.068).

“Output-token runs have lower soft F1 than file-delivery runs for Perplexity (0.397 versus 0.238), Anthropic (0.262 versus 0.202), and OpenAI (0.153 versus 0.122); hard F1 shows the same ordering (0.156 versus 0.121, 0.099 versus 0.080, and 0.073 versus 0.068).”

Classified as probably not a substantial claim.

Holding the task's semantic criteria fixed while lowering one or more counts produces a smaller instance.

“Holding the task's semantic criteria fixed while lowering one or more counts produces a smaller instance-for example, requiring 5 qualifying entities rather than 20, or one corroborating source rather than three-and the counts can be increased across epochs toward the full task.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Operational differences vary by system: output-token runs are slightly more expensive for Perplexity and OpenAI and less expensive per scheduled task for Anthropic, whose output-token run also produces fewer metric-bearing trials (42/45 versus 45/45).

“Operational differences vary by system: output-token runs are slightly more expensive for Perplexity and OpenAI and less expensive per scheduled task for Anthropic, whose output-token run also produces fewer metric-bearing trials (42/45 versus 45/45).”

Classified as probably not a substantial claim. May combine two claims.

Automated checks and empirical audits screen WANDR tasks, with human review where needed.

“Automated checks and empirical audits screen them, with human review where needed”

Classified as probably not a substantial claim.

A task-specific judge re-fetches the cited pages and verifies each record's claims against the cited evidence.

“a task-specific judge re-fetches the cited pages and verifies each record's claims against the cited evidence”

Classified as probably not a substantial claim.

The central challenge of WANDR is to achieve the requested volume through broad search while keeping every record factually correct.

“shifting the central challenge from finding a single correct answer or writing a polished report to open-ended discovery at high volume without sacrificing per-record factual correctness”

• Also stated in: § 1 Introduction · plain

  “The central challenge is to achieve the requested volume through broad search while keeping every record factually correct.”

Classified as probably not a substantial claim.

Automated authoring checks, an empirical feasibility audit, and a judge audit establish the conditions needed for a functional WANDR task.

“Automated authoring checks, an empirical feasibility audit, and a judge audit establish the conditions needed for a functional task.”

Classified as probably not a substantial claim.

Every WANDR record is a citation-backed claim (URL plus verbatim excerpts).

“Every record is a citation-backed claim (URL plus verbatim excerpts).”

Classified as probably not a substantial claim.

The final WANDR set is curated to stress-test recurring failure modes of frontier agentic search systems.

“the final set is curated to stress-test recurring failure modes of frontier agentic search systems.”

May combine two claims.

Failures can be localized across the WANDR tree: a system may fail to discover core task entities or members, enrich intermediate entities or keys, identify relevant pages, extract adequate evidence from those pages, or disambiguate identities when keys collide.

“Failures can be localized across the tree: a system may fail to discover core task entities or members, enrich intermediate entities or keys, identify relevant pages, extract adequate evidence from those pages, or disambiguate identities when keys collide (Section 3).”

Classified as probably not a substantial claim. May combine two claims.

Every admitted WANDR task must meet three top-level criteria: substantial volume (usually hundreds of records and sometimes thousands); feasibility (the requested volume is attainable); and difficulty and discrimination (simple internal baselines score low while stronger systems score meaningfully higher).

“Every admitted task must meet three top-level criteria: substantial volume (usually hundreds of records and sometimes thousands); feasibility (the requested volume is attainable); and difficulty and discrimination (simple internal baselines score low while stronger systems score meaningfully higher).”

Classified as probably not a substantial claim.

A task-specific judge re-fetches the cited page.

“A task-specific judge re-fetches the cited page.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Optional human review improves WANDR task quality but is not required for the task package to run and grade submissions.

“Optional human review improves task quality but is not required for the task package to run and grade submissions.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Authoring uses an interleaved author-critic loop for design, task, and fixture drafts, plus a mechanical linter.

“Authoring uses an interleaved author-critic loop for design, task, and fixture drafts, plus a mechanical linter.”

Classified as probably not a substantial claim.

Grading evaluates every submission against its own cited pages rather than against the witness.

“It establishes that the requested volume is attainable, while grading still evaluates every submission against its own cited pages rather than against the witness.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The authoring stage claims seeds in batches under two controls: deduplication against previously used seeds and tasks, and coverage steering toward the target distributions, which favors diverse, economically useful domains and caps overrepresented or low-value ones.

“The authoring stage claims seeds in batches under two controls: deduplication against previously used seeds and tasks, and coverage steering toward the target distributions, which favors diverse, economically useful domains and caps overrepresented or low-value ones.”

May combine two claims.

WANDR brings source verification to collection scale: every record must carry its own citation (URL plus verbatim excerpts), and a task-specific judge re-fetches the cited page and verifies the claim against it.

“WANDR brings source verification to collection scale: every record must carry its own citation (URL plus verbatim excerpts), and a task-specific judge re-fetches the cited page and verifies the claim against it.”

Classified as probably not a substantial claim. May combine two claims.

Admission applies a feasibility audit based on merged rollouts and a judge audit, followed by optional human sign-off against the four-axis rubric; automated runnability, cleanliness, difficulty, and discrimination gates are enforced during authoring.

“Admission applies a feasibility audit based on merged rollouts and a judge audit, followed by optional human sign-off against the four-axis rubric; automated runnability, cleanliness, difficulty, and discrimination gates are enforced during authoring.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

During WANDR construction, outputs from the authoring rollouts are merged into a best-known solution that serves as an internal feasibility witness, not an answer key; grading never compares a submission against it.

“During construction, outputs from the authoring rollouts are merged into a best-known solution that serves as an internal feasibility witness, not an answer key; grading never compares a submission against it.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Admission checks that the requested volume is attainable, audits the judge, and optionally adds human sign-off.

“Admission checks that the requested volume is attainable, audits the judge, and optionally adds human sign-off.”

Classified as probably not a substantial claim.

WANDR verdicts are aggregated into precision, recall, and F1, each in soft (partial credit) and hard (binary pass/fail) forms.

“These verdicts are then aggregated into precision (accuracy among submitted members), recall (quality-adjusted completion relative to the required member count), and F1, each in soft (partial credit) and hard (binary pass/fail) forms (Section 5, Appendix A).”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

A classifier then ranks candidates by whether their entities and sources are stable enough to build on, their answers can be checked, and discovery is genuinely difficult.

“A classifier then ranks candidates by whether their entities and sources are stable enough to build on, their answers can be checked, and discovery is genuinely difficult.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

WANDR task shapes originate in real professional usage, and tasks are admitted only if they are high-volume, feasible, and discriminative against internal baselines.

“Its task shapes originate in real professional usage, and tasks are admitted only if they are high-volume, feasible, and discriminative against internal baselines.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Sibling variants expose practical tradeoffs, such as admitting a larger target pool while increasing the required volume.

“Sibling variants expose practical tradeoffs, such as admitting a larger target pool while increasing the required volume.”

Classified as probably not a substantial claim. May combine two claims.

Throughout the authoring loop, four automated bars require that the package runs, its solver-facing description, judge specification, and schema remain aligned, primitive internal baselines do not already solve it, and stronger internal rollouts meaningfully outperform weaker ones.

“Throughout the loop, four automated bars require that the package runs, its solver-facing description, judge specification, and schema remain aligned, primitive internal baselines do not already solve it, and stronger internal rollouts meaningfully outperform weaker ones.”

Probably not a substantial claim: may not pass S4 (based).

The resulting challenge for WANDR is to sustain both breadth and per-record accuracy across a large, structured collection-precisely the regime in which current agents struggle.

“The resulting challenge is to sustain both breadth and per-record accuracy across a large, structured collection-precisely the regime in which current agents struggle.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The canonical WANDR hierarchy is intentionally small, but changing what a level represents, how many children it requires, or where a new branch attaches covers a broad range of research workflows.

“The canonical hierarchy is intentionally small, but changing what a level represents, how many children it requires, or where a new branch attaches covers a broad range of research workflows.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The author-critic loop automates much of the review; the human rubric provides a final checklist when sign-off is used.

“The author-critic loop automates much of the review; the human rubric provides a final checklist when sign-off is used.”

May combine two claims.

The reference-free verification approach makes tasks about current and changing facts admissible and allows task production to scale through a semi-automated pipeline rather than exhaustive expert annotation.

“This makes tasks about current and changing facts admissible and allows task production to scale through a semi-automated pipeline rather than exhaustive expert annotation.”

Classified as probably not a substantial claim.

Per-record verdicts and hierarchical metrics in WANDR provide dense partial-progress rewards.

“per-record verdicts and hierarchical metrics provide dense partial-progress rewards”

Classified as probably not a substantial claim. May combine two claims.

The pipeline merges everything found across 10-12 authoring rollouts into a single best-known solution, which must recover a near-full requested volume.

“The pipeline merges everything found across 10-12 authoring rollouts into a single best-known solution, which must recover a near-full requested volume.”

Classified as probably not a substantial claim. May combine two claims.

Every branch in a WANDR hierarchy ends in one or more URLs, so each claim remains tied to the page that supports it.

“Every branch ends in one or more URLs, so each claim remains tied to the page that supports it.”

Classified as probably not a substantial claim. May combine two claims.

A reviewer samples graded records and regrades each one blindly, forming an independent verdict before seeing the automated judgment.

“A reviewer samples graded records and regrades each one blindly, forming an independent verdict before seeing the automated judgment.”

Classified as probably not a substantial claim. May combine two claims.

The full verdict evaluates both the page and submitted excerpts, while the retrieval-only verdict asks only whether the page satisfies every substantive task requirement.

“The full verdict evaluates both the page and submitted excerpts, while the retrieval-only verdict asks only whether the page satisfies every substantive task requirement.”

May combine two claims.

These collection benchmarks expand the width axis, but generally do not require the same multi-stage enrichment and corroboration process to be repeated for every discovered member.

“These benchmarks expand the width axis, but generally do not require the same multi-stage enrichment and corroboration process to be repeated for every discovered member.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Each admitted task receives distribution labels, and selection matches the target distributions; a strong task may remain unused when its bucket is already full.

“Each admitted task receives distribution labels, and selection matches the target distributions; a strong task may remain unused when its bucket is already full.”

Probably not a substantial claim: may not pass S4 (based).

Per-level required counts in WANDR provide an explicit difficulty gradient for curriculum learning.

“per-level required counts provide an explicit difficulty gradient for curriculum learning”

Classified as probably not a substantial claim. May combine two claims.

A first filter retains requests shaped like wide research-asking to compile a list, table, or directory-and favors sessions with heavy tool use.

“A first filter retains requests shaped like wide research-asking to compile a list, table, or directory-and favors sessions with heavy tool use.”

Classified as probably not a substantial claim. May combine two claims.

Closed or predictable axes are canonicalized, while open-ended axes are semantically deduplicated; this prevents cosmetic variants from satisfying a volume floor more than once and makes coverage well-defined across parent tasks and subtasks.

“Closed or predictable axes are canonicalized, while open-ended axes are semantically deduplicated; this prevents cosmetic variants from satisfying a volume floor more than once and makes coverage well-defined across parent tasks and subtasks.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The benchmark reports the simple unweighted mean of each per-task metric. Every task therefore contributes equally to the headline score, regardless of its required record count.

“The benchmark reports the simple unweighted mean of each per-task metric.Every task therefore contributes equally to the headline score, regardless of its required record count.”

Probably not a substantial claim: may not pass S3 (load-bearing).

WANDR's structure makes it a plausible RL substrate.

“the same structure makes it a plausible RL substrate”

Probably not a substantial claim: may not pass S3 (load-bearing).

The association between requirement count and complete support is descriptive because requirement count also varies with task content and structure.

“This association is descriptive because requirement count also varies with task content and structure”

May combine two claims.

It lets a model compose retrieval, ranking, filtering, fan-out, and rendering primitives through generated Python, while the sandbox executes batching, retries, joins, aggregation, and deduplication without a separate model turn for every web operation.

“It lets a model compose retrieval, ranking, filtering, fan-out, and rendering primitives through generated Python, while the sandbox executes batching, retries, joins, aggregation, and deduplication without a separate model turn for every web operation.”

• cites Perplexity, 2026Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The judge also reports confidence. A leaf signal is used only at confidence 2 or 3; lower-confidence leaves are treated as missing, so they do not enter precision but can reduce recall when their omission leaves fewer than the required number of members.

“The judge also reports confidence.A leaf signal is used only at confidence 2 or 3; lower-confidence leaves are treated as missing, so they do not enter precision but can reduce recall when their omission leaves fewer than the required number of members.”

Classified as probably not a substantial claim. May combine two claims.

The drop from precision to recall is primarily a breadth signal: recall zero-pads unmet quotas and collapses duplicate identities, whereas precision averages the submitted children.

“The drop from precision to recall is primarily a breadth signal: recall zero-pads unmet quotas and collapses duplicate identities, whereas precision averages the submitted children.”

Classified as probably not a substantial claim.

The gap between scores under verdict_retrieval and verdict_full measures how much additional credit is lost when grading the complete submitted record rather than page-level task satisfaction alone.

“The gap between scores under verdict_retrieval and verdict_full measures how much additional credit is lost when grading the complete submitted record rather than page-level task satisfaction alone.”

Classified as probably not a substantial claim. May combine two claims.

Trials ending in terminal errors after repeated retries have no metric-bearing verifier result and are zero-filled in the aggregate.

“Trials ending in terminal errors after repeated retries have no metric-bearing verifier result and are zero-filled in the aggregate.”

Classified as probably not a substantial claim.

The four-layer framework measures failures at aggregate or task-local resolution.

“The four-layer framework measures failures at aggregate or task-local resolution.”

May combine two claims.

Resource use again has no shared monotonic response, so these observational curves localize the loss but do not isolate hierarchy as its cause (Figure 10, bottom block).

“Resource use again has no shared monotonic response, so these observational curves localize the loss but do not isolate hierarchy as its cause (Figure 10, bottom block).”

Probably not a substantial claim: may not pass S3 (load-bearing).

The layered verifier makes these components inspectable at structural, task, and record resolution.

“The layered verifier makes these components inspectable at structural, task, and record resolution.”

May combine two claims.

Identity is not a major aggregate explanation of endpoint differences, but it can materially damage an affected task (Table 8; Appendix H).

“Identity is not a major aggregate explanation of endpoint differences, but it can materially damage an affected task (Table 8; Appendix H).”

Classified as probably not a substantial claim.

All systems use the same pinned GPT-5.4 evaluation configuration: low effort for triage and canonicalization, medium for judging, and high for deduplication.

“All systems use the same pinned GPT-5.4 evaluation configuration: low effort for triage and canonicalization, medium for judging, and high for deduplication.”

Classified as probably not a substantial claim.

Reference-free grading accommodates changing facts without maintaining an exhaustive gold answer table.

“Reference-free grading accommodates changing facts without maintaining an exhaustive gold answer table”

Classified as probably not a substantial claim. May combine two claims.

Every leaf record receives an independent binary verdict, and the verdicts are then aggregated to the task level.

“Every leaf record receives an independent binary verdict, and the verdicts are then aggregated to the task level.”

May combine two claims.

SaC's advantage is broad but not uniform.

“SaC's advantage is broad but not uniform”

Probably not a substantial claim: may not pass S3 (load-bearing).

Precision measures the quality of submitted members, so low precision is consistent with a depth failure such as incorrect facts, unfaithful excerpts, or missing corroboration.

“Precision measures the quality of submitted members, so low precision is consistent with a depth failure such as incorrect facts, unfaithful excerpts, or missing corroboration.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The page-length analysis is exploratory because page length co-varies with source type and record complexity.

“This analysis is exploratory because page length co-varies with source type and record complexity”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Search as Code (SaC) is well matched to this repeated horizontal structure.

“Search as Code (SaC) is well matched to this repeated horizontal structure.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Poor identity management can inflate raw submitted-member counts, but canonicalization and deduplication collapse aliases before recall is computed.

“Poor identity management can inflate raw submitted-member counts, but canonicalization and deduplication collapse aliases before recall is computed.”

May combine two claims.

SaC's distinctive signature is stronger breadth retention and evidence construction, not uniformly better performance at every layer.

“SaC's distinctive signature is therefore stronger breadth retention and evidence construction, not uniformly better performance at every layer”

Probably not a substantial claim: may not pass S3 (load-bearing).

Triage routes these cases through a heavier JavaScript-rendering browser before judgment, reducing crawler-induced failures.

“Triage routes these cases through a heavier JavaScript-rendering browser before judgment, reducing crawler-induced failures.”

Classified as probably not a substantial claim. May combine two claims.

These external systems are evaluated only after the task set is frozen and are not used for admission or rejection.

“These external systems are evaluated only after the task set is frozen and are not used for admission or rejection.”

Classified as probably not a substantial claim.

Each submitted record carries the page and excerpt needed for verification.

“each submitted record instead carries the page and excerpt needed for verification”

Classified as probably not a substantial claim.

Solving a WANDR task amounts to executing a retrieval program over a required entity space: discover enough members, enrich every required branch, qualify the resulting pages, and render source-backed records.

“Solving a WANDR task amounts to executing a retrieval program over a required entity space: discover enough members, enrich every required branch, qualify the resulting pages, and render source-backed records.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Because grading re-fetches cited pages, solving and grading should occur close together: a URL that changes after submission can cause an otherwise correct record to fail.

“Because grading re-fetches cited pages, solving and grading should occur close together: a URL that changes after submission can cause an otherwise correct record to fail.”

Classified as probably not a substantial claim.

Solve converts every system's output into a common record format, ensuring identical downstream grading.

“Solve converts every system's output into a common record format, ensuring identical downstream grading.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The soft-hard gap is a completeness signal: hard scores remove partial credit from submitted members whose required subtrees are incomplete.

“The soft-hard gap is a completeness signal: hard scores remove partial credit from submitted members whose required subtrees are incomplete.”

Probably not a substantial claim: may not pass S4 (based).

Structure alone does not capture source accessibility, semantic ambiguity, or the practical effort required to complete each branch.

“Structure alone does not capture source accessibility, semantic ambiguity, or the practical effort required to complete each branch.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Weak internal baselines score low while stronger internal rollouts score meaningfully higher on discriminative tasks.

“Weak internal baselines score low while stronger internal rollouts score meaningfully higher.”

Probably not a substantial claim: may not pass S4 (based).

Once identity is resolved on each axis, required volumes, coverage, and score rollups are well defined.

“Once identity is resolved on each axis, required volumes, coverage, and score rollups are well defined.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

If a record is so invalid that substantive judgment would be meaningless, the judge short-circuits the remaining fields to false; otherwise, it still reports the requirement-level signals for diagnosis.

“If a record is so invalid that substantive judgment would be meaningless, the judge short-circuits the remaining fields to false; otherwise, it still reports the requirement-level signals for diagnosis.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Per-level required counts support curriculum learning.

“per-level required counts support curriculum learning”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Record-level verdicts and hierarchy-level scores provide denser outcome rewards than a single exact match.

“record-level verdicts and hierarchy-level scores provide denser outcome rewards than a single exact match”

Probably not a substantial claim: may not pass S3 (load-bearing).

An excerpt may quote the page exactly but omit the sentence that establishes the date, role, or source authority; it then passes excerpts_faithful but fails the relevant _supported field.

“An excerpt may quote the page exactly but omit the sentence that establishes the date, role, or source authority; it then passes excerpts_faithful but fails the relevant _supported field.”

Probably not a substantial claim: may not pass S3 (load-bearing).

A single-field key is sufficient when its values are already unambiguous within the task.

“A single-field key is sufficient when its values are already unambiguous within the task.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Scattered extraction: the required evidence appears in different parts of a page, such as a title, date, and substantive comment.

“Scattered extraction -the required evidence appears in different parts of a page, such as a title, date, and substantive comment.”

Classified as probably not a substantial claim.

Each key must contain enough information to identify its values without relying on an implicit parent.

“Each key must contain enough information to identify its values without relying on an implicit parent.”

Classified as probably not a substantial claim. May combine two claims.

WANDR provides a basis for improving comprehensive search systems and testing whether those gains hold at scale.

“It provides a basis for improving comprehensive search systems and testing whether those gains hold at scale.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

Open-ended entities such as people and companies usually require semantic comparison.

“Open-ended entities such as people and companies usually require semantic comparison.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

Heavy source: the evidence may live in a long report, registry, filing, or PDF.

“Heavy source -the evidence may live in a long report, registry, filing, or PDF.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The page may drift after solving.

“the page may drift after solving”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The authoring pipeline supplies a broader set of vetted guidance tasks to the author, critic, and linter.

“The authoring pipeline supplies a broader set of vetted guidance tasks to the author, critic, and linter.”

Probably not a substantial claim: may not pass S2 (checkable).

The separation between faithfulness and completeness is especially important when a solver relies on search snippets, which can omit qualifiers or join nearby text out of context.

“This separation is especially important when a solver relies on search snippets, which can omit qualifiers or join nearby text out of context.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Curation follows admission and selects from the admitted pool to match release-level distributions.

“Curation follows admission and selects from the admitted pool to match release-level distributions.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The complete-record verdict, verdict_full, additionally requires validity, a usable page, a clear answer, faithful excerpts, and complete excerpt support.

“The complete-record verdict, verdict_full, additionally requires validity, a usable page, a clear answer, faithful excerpts, and complete excerpt support.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Long-tail source: the qualifying evidence may sit outside the highest-ranked results.

“Long-tail source -the qualifying evidence may sit outside the highest-ranked results.”

Classified as probably not a substantial claim. May combine two claims.

WANDR is useful as a stress test, but the resulting score distribution should not be interpreted as the difficulty of research requests in deployment.

“This makes WANDR useful as a stress test, but the resulting score distribution should not be interpreted as the difficulty of research requests in deployment.”

Classified as probably not a substantial claim. May combine two claims.

Figure 10 identifies descriptive scale sensitivity in the current fixed-configuration runs, but target volume, intermediate-level count, content, and difficulty co-vary.

“Figure 10 identifies descriptive scale sensitivity in the current fixed-configuration runs, but target volume, intermediate-level count, content, and difficulty co-vary.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

A merged solution over 10-12 authoring rollouts recovers a near-full requested volume floor.

“A merged solution over 10-12 authoring rollouts recovers a near-full requested volume floor.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Fixtures are unit tests for the task's judge; they ship with the task but never grade the systems under test.

“Fixtures are unit tests for the task's judge; they ship with the task but never grade the systems under test.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Canonicalization and deduplication introduce additional boundary decisions when identities are ambiguous.

“Canonicalization and deduplication introduce additional boundary decisions when identities are ambiguous.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

When a fixture the author trusts disagrees with the judge, the disagreement is triaged-usually the fixture is wrong and gets fixed, but a genuine judge defect sends the task back for repair.

“When a fixture the author trusts disagrees with the judge, the disagreement is triaged-usually the fixture is wrong and gets fixed, but a genuine judge defect sends the task back for repair.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

The solver-facing description, judge specification, and schema state the same requirements in the same order; mechanical lints pass.

“The solver-facing description, judge specification, and schema state the same requirements in the same order; mechanical lints pass.”

Classified as probably not a substantial claim. May combine two claims.

Every substantive requirement is evaluated twice: a _satisfied field asks whether the full page supports the requirement regardless of excerpts, and a paired _supported field asks whether the submitted excerpts alone are sufficient for a careful reader to verify the same requirement.

“Every substantive requirement is evaluated twice.A field ending in _satisfied asks whether the full page supports the requirement, regardless of which excerpts the solver selected.Its paired _supported field asks whether the submitted excerpts alone are sufficient for a careful reader to verify the same requirement.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Exact matching is sufficient after deterministic normalization for fields such as URLs or fixed labels.

“Exact matching is sufficient after deterministic normalization for fields such as URLs or fixed labels.”

Probably not a substantial claim: may not pass S3 (load-bearing).

A released task reflects a recurring form of professional work, not the content of any individual query or private record.

“A released task therefore reflects a recurring form of professional work, not the content of any individual query or private record.”

Probably not a substantial claim: may not pass S4 (based).

A task must be runnable, convention-clean, sufficiently difficult, discriminative, empirically feasible, and judgeable before it can enter the released set.

“A task must be runnable, convention-clean, sufficiently difficult, discriminative, empirically feasible, and judgeable before it can enter the released set.”

May combine two claims.