When Agents Coordinate: Measuring Coordination in Multi-Agent AI Coding

May combine two claims.

On the sixteen-step chain the slope between eight and sixteen agents is 0.00 (95% CI [-0.34, 0.34]), and the break is significant (∆ = 1.08, 95% CI [0.61, 1.55]), confirming hypothesis H8.

“the slope between eight and sixteen is 0.00 (95% CI [-0.34, 0.34]), and the break is significant (∆ = 1.08, 95% CI [0.61, 1.55]), confirming hypothesis H8.”

May combine two claims.

An eight-step calculation split one step per agent failed in all ten runs, every time on the same question: round at each step, or once at the end.

“An eight-step calculation split one step per agent failed in all ten runs, every time on the same question: round at each step, or once at the end.”

May combine two claims.

On the chained task the growth exponent is 1.92, quadratic within error, and the two collection sessions agree to two decimal places (1.92 and 1.93).

“the chained task the exponent is 1.92, quadratic within error, and the two collection sessions agree to two decimal places (1.92 and 1.93).”

May combine two claims.

Messages rise steeply and file writes barely move.

“Messages rise steeply and file writes barely move.”

May combine two claims.

On the chained task, mean degree is 0.90, 1.57, and 2.99 at two, four, and eight agents, so the gap to the clique line widens as the team grows, and clustering stays low (0.36 at four agents, 0.38 at eight).

“Mean degree is 0.90, 1.57, and 2.99 at the same sizes, so the gap to the clique line widens as the team grows, and clustering stays low (0.36 at four agents, 0.38 at eight).”

May combine two claims.

The dense graph is dense everywhere and the sparse graph is sparse everywhere; neither concentrates on a hub.

“The dense graph is dense everywhere and the sparse graph is sparse everywhere; neither concentrates on a hub.”

May combine two claims.

On the chained task the directed out-degree stays around two; on the distributed task it is about three in one collection and five in the other, and in the second it comes close to the undirected degree of 5.5.

“On the chained task it stays around two; on the distributed task it is about three in one collection and five in the other, and in the second it comes close to the undirected degree of 5.5.”

May combine two claims.

Past eight agents, messages aimed at one named peer fall from 34.6 to 12.2 per run while broadcasts rise from 12.3 to 34.0.

“past eight agents, messages aimed at one named peer fall from 34.6 to 12.2 per run while broadcasts, messages sent to the whole team at once, rise from 12.3 to 34.0”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The remaining 82 runs are pilots and methodological checks, giving 1,902 runs in the main collection; a further 244 runs form the sealed replication.

“The remaining 82 runs are pilots (small trial batches run before the full schedules) and methodological checks, giving 1,902 runs in the main collection; a further 244 runs form the sealed replication of Section 9.”

May combine two claims.

On the distributed task the growth is also steep but not stable across sessions.

“On the distributed task the growth is also steep but not stable across sessions”

May combine two claims.

On the distributed task the mandatory policy cuts output tokens by about 25% at four agents and about 42% at eight below the allowed default, with all team structures and splits pooled at each size.

“On the distributed task the mandatory policy cuts output tokens by about 25% at four agents and about 42% at eight below the allowed default, with all team structures and splits pooled at each size”

May combine two claims.

On the distributed task, mean degree is 0.90, 2.92, and 5.47 at two, four, and eight agents, against clique lines of 1, 3, and 7, and clustering is high once the team is larger than a pair (0.96 at four agents, 0.81 at eight).

“Mean degree is 0.90, 2.92, and 5.47 at two, four, and eight agents, against clique lines of 1, 3, and 7, and clustering is high once the team is larger than a pair (0.96 at four agents, 0.81 at eight).”

May combine two claims.

In the sealed replication, the two findings these cells test reproduce, and the teams still reach for the hidden test suite in four fifths of runs even though it returns nothing.

“the two findings these cells test reproduce, and the teams still reach for the hidden test suite in four fifths of runs even though it returns nothing”

May combine two claims.

The chained task completes its handshake early at four and eight agents in both sessions; at two agents, in one session, ninety per cent of pairs appear only around the middle of the run (τ ≈ 0.46).

“The chained task completes its handshake early at four and eight agents in both sessions; at two agents, in one session, ninety per cent of pairs appear only around the middle of the run (τ ≈ 0.46).”

May combine two claims.

The introductions come early in the run; the sustained traffic comes later.

“the introductions come early in the run; the sustained traffic comes later.”

May combine two claims.

The distributed mesh is dense but flat: no agent holds a disproportionate share of the sustained edges.

“The distributed mesh is dense but flat: no agent holds a disproportionate share of the sustained edges.”

May combine two claims.

On the distributed task, in one collection session, ninety per cent of the distinct sender-to-recipient pairs a run will ever use have appeared by τ ≈ 0.2 at every team size; in the other session the eight-agent handshake stretches to τ ≈ 0.6.

“On the distributed task, in one collection session, ninety per cent of the distinct sender-to-recipient pairs a run will ever use have appeared by τ ≈ 0.2 at every team size (Figure 5); in the other session the eight-agent handshake stretches to τ ≈ 0.6”

May combine two claims.

The pre-registered H1 test gives 1.92 with an interval of [1.67, 2.17], and the per-run regression gives 1.92 with interval [1.80, 2.05]; both confirm quadratic scaling.

“The pre-registered H1 test, a regression over the three cell means, gives 1.92 with an interval of [1.67, 2.17] (±1.96SE, the pre-registered test's normal approximation); the per-run regression we use for scaling elsewhere in the paper gives the same 1.92 with a tighter interval, [1.80, 2.05].Both confirm quadratic scaling.”

May combine two claims.

A run can pass every test while leaving no trace of how much coordination it required, and two runs that pass the same tests can differ severalfold in messages, file activity, and tokens.

“A run can pass every test while leaving no trace of how much coordination it required, and two runs that pass the same tests can differ severalfold in messages, file activity, and tokens.”

May combine two claims.

On the sixteen-step chain mean messages are 21.4, 47.0, and 46.8 at four, eight, and sixteen agents.

“mean messages are 21.4,47.0, and 46.8 at four, eight, and sixteen agents”

May combine two claims.

At eight agents on the distributed task, the tokens attributed to direct messages fall from about 10,500 per run under the allowed default to 1,700 under mandatory, while file-write and file-read tokens roughly double.

“At eight agents on the distributed task, the tokens attributed to direct messages fall from about 10,500 per run under the allowed default to 1,700 under mandatory, while file-write and file-read tokens roughly double”

May combine two claims.

The shape is set by the task, and the two tasks settle on opposite shapes.

“The shape is set by the task, and the two tasks settle on opposite shapes (Figure 6).”

May combine two claims.

Work built around a shared specification produces dense, highly connected teams, while pipeline tasks produce sparse networks organised around local interfaces.

“Work built around a shared specification produces dense, highly connected teams, while pipeline tasks produce sparse networks organised around local interfaces.”

May combine two claims.

The sixteen-step chain has the widest gap: the average agent sustains just 0.28 partners against a clique line of 15, and clustering falls to 0.03.

“The sixteen-step chain, the only configuration that reaches sixteen agents, has the widest gap: the average agent sustains just 0.28 partners against a clique line of 15, and clustering falls to 0.03.”

May combine two claims.

On the eight-step chain the slope falls from 1.82 between two and four agents to 0.72 between four and eight; at ten runs per cell the fall is in the predicted direction but not significant.

“On the eight-step chain the slope falls from 1.82 between two and four agents to 0.72 between four and eight; at ten runs per cell the fall is in the predicted direction but not significant (hypothesis H7, Appendix A).”

Probably not a substantial claim: may not pass S3 (load-bearing).

The two experiments' grids together contain 1,720 runs.

“The two experiments' grids together contain 1,720 runs.”

May combine two claims.

Most file reads at eight agents are outside the workspace, the agents opening the reference solution, the hidden tests, and other runs' files.

“most of these reads are outside the workspace, the agents opening the reference solution, the hidden tests, and other runs' files (Section 9)”

May combine two claims.

Under a pinned model, the chained task reproduces across collection sessions almost exactly, while the distributed task does not: the same configuration, collected twice under the same pinned model, gave two incompatible growth rates.

“Under a pinned model, the chained task reproduces across collection sessions almost exactly, while the distributed task does not: the same configuration, collected twice under the same pinned model, gave two incompatible growth rates.”

May combine two claims.

The convention sat on the boundary between two agents, and no agent owned it.

“The convention sat on the boundary between two agents, and no agent owned it.”

May combine two claims.

Naming one agent as coordinator creates no communication hub and provides no reliable improvement in success.

“Naming one agent as coordinator creates no communication hub and provides no reliable improvement in success.”

May combine two claims.

Messages get shorter as teams grow (mean size falls at every step in team size), so per-channel coordination thins on two axes at once.

“Messages also get shorter as teams grow (mean size falls at every step in team size), so per-channel coordination thins on two axes at once.”

May combine two claims.

What holds everywhere is the ordering, introductions first, then repeat traffic on a small established core, with the sustained channels running through the middle and second half of the run.

“What holds everywhere is the ordering, introductions first, then repeat traffic on a small established core, with the sustained channels running through the middle and second half of the run.”

May combine two claims.

Neither the distributed nor the chained coordination network has a leader or hub.

“Neither shape has a leader.”

• Also stated in: § Summary. · plain

  “and neither has a hub.”

May combine two claims.

The teams discussed rounding in every one of those runs and still never agreed.

“The teams discussed rounding in every one of those runs and still never agreed.”

May combine two claims.

With files already carrying the coordination, the mandatory rule roughly doubles per-run tokens (578k against 333k) and more than triples file reads, for identical success (10 of 10 against 20 of 20) in the sixteen-agent arm.

“with files already carrying the coordination, the mandatory rule roughly doubles per-run tokens (578k against 333k) and more than triples file reads, for identical success (10 of 10 against 20 of 20).”

May combine two claims.

Where a task pins the coordination down the two sessions agree closely, showing that the instrument itself can reproduce consistently.

“Where a task pins the coordination down the two sessions agree closely, showing that the instrument itself can reproduce consistently”

May combine two claims.

The run transcripts show rounding discussed in all ten of the eight-agent runs, and those teams messaged more than the four-agent ones.

“the run transcripts show rounding discussed in all ten of the eight-agent runs, and those teams messaged more than the four-agent ones.”

May combine two claims.

The single reversal reported in Section 7, the flat team beating the coordinator under the forbidden policy, does not reappear, so it is best read as an artefact of the uncontained cells.

“The single reversal reported in Section 7, the flat team beating the coordinator under the forbidden policy, does not reappear, so it is best read as an artefact of the uncontained cells.”

May combine two claims.

On the chained task the same rule raises output tokens, by about 17% at four agents and 10% at eight.

“On the chained task the same rule raises output tokens, by about 17% at four agents and 10% at eight.”

May combine two claims.

The agents went looking on their own initiative and reported what they found openly.

“The agents went looking on their own initiative and reported what they found openly.”

May combine two claims.

Naming a coordinator again makes no difference to success: flat and coordinator teams are level under every file policy (forbidden 20/30 against 21/32, p = 1.00; allowed 26/31 against 23/31, p = 0.53; mandatory 23/30 against 25/30, p = 0.75).

“Naming a coordinator again makes no difference to success: flat and coordinator teams are level under every file policy (forbidden 20/30 against 21/32, p = 1.00; allowed 26/31 against 23/31, p = 0.53; mandatory 23/30 against 25/30, p = 0.75).”

May combine two claims.

Through the file tools, agents opened another agent's private prompt in 129 runs, read a different run's files in 18 (a finished solution in 16 of them), and read the shared message log in 52.

“through the file tools, agents opened another agent's private prompt in 129 runs, read a different run's files in 18 (a finished solution in 16 of them), and read the shared message log in 52”

May combine two claims.

Exploratory run-level regressions point one way: more messaging and writing go with failure and longer runs, more reading with success and shorter ones.

“Exploratory run-level regressions point one way, more messaging and writing go with failure and longer runs, more reading with success and shorter ones”

May combine two claims.

A validity check made after the main collection found that the agents used this access: they opened the hidden test suite in 234 runs and read the reference solution in 77, the reach most common in the eight-agent conflicting cells.

“A validity check made after the main collection found that the agents used this access: they opened the hidden test suite in 234 runs and read the reference solution in 77, the reach most common in the eight-agent conflicting cells.”

May combine two claims.

On the chained task the sessions agree almost everywhere: no matched cell differs once the twenty-seven comparisons are Benjamini-Hochberg corrected (one differs at the raw level), and typical cell means move by about seven per cent.

“On the chained task the sessions agree almost everywhere: no matched cell differs once the twenty-seven comparisons are Benjamini-Hochberg corrected (one differs at the raw level), and typical cell means move by about seven per cent.”

May combine two claims.

A quarter of the mandatory runs (about a third at four and eight agents) send no message at all and drop out of this measure, so the 17% describes the minority that still message.

“a quarter of the mandatory runs (about a third at four and eight agents) send no message at all and drop out of this measure, so the 17% describes the minority that still message.”

May combine two claims.

At four agents the coordinator looks better (8/10 against collection B's 5/10), but pooling the two flat collections dissolves the advantage (8/10 against 12/20, p = 0.42).

“At four agents the coordinator looks better (8/10 against the collection B's 5/10), but pooling the two flat collections dissolves the advantage (8/10 against 12/20, p = 0.42)”

May combine two claims.

Where a task leaves the coordination open the spread between sessions is considerably larger and itself task-dependent, which uniform measurement noise would not produce.

“where a task leaves the coordination open the spread between sessions is considerably larger and itself task-dependent, which uniform measurement noise would not produce.”

May combine two claims.

With the real material replaced by a placeholder and nothing to gain, the teams still went looking for it: in 80% of the sealed runs an agent opened the decoy standing in for the hidden test file, in 66% it opened another agent's prompt, and in 61% it opened the run manifest.

“With the real material replaced by a placeholder and nothing to gain, the teams still went looking for it: in 80% of the sealed runs an agent opened the decoy standing in for the hidden test file, in 66% it opened another agent's prompt, and in 61% it opened the run manifest.”

May combine two claims.

The chained task writes files first under every policy (messaging leads in only 12% to 14% of runs), even though its prompt asks agents to coordinate through messages.

“The chained task writes files first under every policy (messaging leads in only 12% to 14% of runs), even though its prompt asks agents to coordinate through messages.”

May combine two claims.

At two and four agents one agent owns both steps and reconciles the halves internally; at eight agents the seam falls between two different owners and no agent holds responsibility for it.

“At two and four agents one agent owns both steps and reconciles the halves internally; at eight agents the seam falls between two different owners and no agent holds responsibility for it.”

May combine two claims.

Messaging leads file writing in 86% of allowed distributed-task runs, 62% under forbidden, and 17% under mandatory.

“Messaging leads file writing (comparing each run's mean message time with its mean file-write time) in 86% of allowed distributed-task runs, 62% under forbidden, and 17% under mandatory”

May combine two claims.

On the distributed task thirteen of twenty-seven cells differ after the same correction, one of them by a factor of fifteen in messaging (31.4 against 2.0 messages per run at the same configuration).

“On the distributed task thirteen of twenty-seven cells differ after the same correction, one of them by a factor of fifteen in messaging (31.4 against 2.0 messages per run at the same configuration).”

May combine two claims.

The channel substitution of Section 6 holds as well: mandating files collapses one-to-one messaging, from 108 messages per run under forbidden and 134 under allowed to 26 under mandatory on the conflicting split, and from 119 to 21 on the clean split.

“The channel substitution of Section 6 holds as well: mandating files collapses one-to-one messaging, from 108 messages per run under forbidden and 134 under allowed to 26 under mandatory on the conflicting split, and from 119 to 21 on the clean split”

May combine two claims.

The specification settles it: compute_tax is told to pass its tax on unrounded and format_invoices to round every figure once at the end, so the two agents each hold one half of the convention.

“The specification settles it, compute_tax is told to pass its tax on unrounded and format_invoices to round every figure once at the end, so the two agents each hold one half of the convention.”

May combine two claims.

The distributed task's scaling exponent is a range, 1.76 (95% CI [1.57, 1.96]) in one session and 2.44 ([2.32, 2.57]) in another, with non-overlapping intervals.

“This is why the distributed task's scaling exponent is a range, 1.76 (95% CI [1.57, 1.96]) in one session and 2.44 ([2.32, 2.57]) in another, with non-overlapping intervals”

May combine two claims.

The eight-step chain (compute_invoices) succeeds in nine of ten runs at two and four agents, then fails all ten at eight agents, where each agent owns exactly one step.

“The eight-step chain (compute_invoices) succeeds in nine of ten runs at two and four agents, then fails all ten at eight agents, where each agent owns exactly one step.”

May combine two claims.

On the distributed task the file-read channel alone still grows super-linearly (about 1.7), so the linearisation comes from removing the message channel, and the fully linear file regime is a property of chain-shaped work.

“on the distributed task the file-read channel alone still grows super-linearly (about 1.7), so the linearisation comes from removing the message channel, and the fully linear file regime is a property of chain-shaped work.”

May combine two claims.

The teams resolved the shared dependency by writing the constant into a file, which is Finding 2 appearing where a messaging effect was predicted.

“The teams resolved the shared dependency by writing the constant into a file, which is Finding 2 appearing where a messaging effect was predicted.”

May combine two claims.

The chained task hugs the diagonal, with no cell differing after correction.

“the chained task (green) hugs the diagonal, with no cell differing after correction”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Only the chained task's file channel is linear by construction.

“Only the chained task's file channel is linear by construction.”

May combine two claims.

The teams opened the hidden grading suite in 234 runs and the reference solution in 77.

“they opened the hidden grading suite in 234 runs and the reference solution in 77.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Under forbidden the file bars are the deliverable itself, which the team must write: every write in those runs goes to the deliverable (270 of 270 multi-agent runs in Experiment 1).

“Under forbidden the file bars are the deliverable itself, which the team must write: every write in those runs goes to the deliverable (270 of 270 multi-agent runs in Experiment 1)”

May combine two claims.

Here, adding agents still carries coordination cost, but formal authority is minimal, and the pyramid does not return.

“here, adding agents still carries coordination cost, but formal authority is minimal, and the pyramid does not return.”

May combine two claims.

Neither the distributed nor the chained task has a hub.

“Neither has a hub.”

May combine two claims.

The measurements see what grading cannot: an eight-step calculation split one step per agent failed every run on a rounding convention that sat between two agents and belonged to neither, discussed every time and never settled.

“And the measurements see what grading cannot: an eight-step calculation split one step per agent failed every run on a rounding convention that sat between two agents and belonged to neither, discussed every time and never settled.”

Classified as probably not a substantial claim. May combine two claims.

H5: addressing differs sharply between the experiments; at the matched four-agent cell (collection B, allowed policy, clean split), the per-run mean share of messages that name a specific peer is 97.1% in Experiment 1 against 60.7% in Experiment 2, a 36-point gap in the pre-committed direction.

“H5: addressing differs sharply between the experiments.At the matched four-agent cell (collection B, allowed policy, clean split), the per-run mean share of messages that name a specific peer is 97.1% in Experiment 1 against 60.7% in Experiment 2, a 36-point gap in the pre-committed direction.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The output saving of Section 6 holds on the cached tokens too.

“the output saving of Section 6 holds on the cached tokens too”

Classified as probably not a substantial claim. May combine two claims.

A pre-registered rule flags a cell for topping up to twenty when its precision is low, and applied to the released data it flags 93 cells across the two experiments (48 of the 85 in Experiment 1, 45 of the 87 in Experiment 2), 25 of them on the outcome-precision condition and the rest on graph-statistic variance.

“A pre-registered rule flags a cell for topping up to twenty when its precision is low, and applied to the released data it flags 93 cells across the two experiments (48 of the 85 in Experiment 1, 45 of the 87 in Experiment 2), 25 of them on the outcome-precision condition and the rest on graph-statistic variance.”

May combine two claims.

The distributed task scatters off the diagonal, with thirteen of twenty-seven differing.

“the distributed task (blue) scatters off it, with thirteen of twenty-seven differing”

Classified as probably not a substantial claim.

H1: chained-task messaging scales as n^2.

“H1 chained-task messaging scales as n 2”

• Also stated in: § A.2 Tests and corrections · plain

  “Experiment 2 tracks the quadratic reference (slope 1.92)”

Probably not a substantial claim: may not pass S3 (load-bearing).

The earlier of these two choices matters most on the sparse sixteen-agent cell, where most runs build no network at all.

“the earlier of these two choices matters most on the sparse sixteen-agent cell, where most runs build no network at all.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The flags divide roughly evenly by team size, 35 at two agents, 36 at four, and 22 at eight.

“The flags divide roughly evenly by team size, 35 at two agents, 36 at four, and 22 at eight.”

Classified as probably not a substantial claim. May combine two claims.

Every edge in the temporal network corresponds to a logged event, so the network records the coordination that occurred during the run.

“Every edge corresponds to a logged event, so the temporal network records the coordination that occurred during the run.”

Classified as probably not a substantial claim.

The dataset is one controlled grid, so any two cells differ only in the factors named.

“the dataset is one controlled grid, so any two cells differ only in the factors named here.”

May combine two claims.

The two collections overlap in calendar time, so the divergence reported in Section 8 cannot be attributed to drift between distant sessions.

“The two collections overlap in calendar time, so the divergence reported in Section 8 cannot be attributed to drift between distant sessions.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The token cost on file edges is coarse because the runtime reports tokens per turn and a turn can make several tool calls, so the paper divides a turn's output tokens evenly across its calls.

“The one coarse quantity is the token cost on file edges: the runtime reports tokens per turn, and a turn can make several tool calls, so we divide a turn's output tokens evenly across its calls.”

Classified as probably not a substantial claim. May combine two claims.

At the top of each scaling arm every agent owns exactly one step, so nobody is idle and any slowing of coordination growth cannot be the team running out of work.

“At the top of each arm every agent owns exactly one step, so nobody is idle and any slowing of coordination growth cannot be the team running out of work.”

Classified as probably not a substantial claim. May combine two claims.

In Experiment 1, no agent is given the whole specification and none is told who holds what, so the team can only recover it by coordinating.

“No agent in a team is given the whole specification, and none is told who holds what, so the team can only recover it by coordinating.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In Experiment 2, the interfaces between owners must be agreed during the run, and the team must decide who writes the pipeline file.

“The interfaces between owners must therefore be agreed during the run, and the team must also decide who writes the pipeline file that assembles the chain.”

May combine two claims.

The duplication of the flat structure gives every flat cell an exact same-configuration twin, which lets Section 8 measure how well the whole instrument reproduces.

“The duplication is deliberate: it gives every flat cell an exact same-configuration twin, which is what lets Section 8 measure how well the whole instrument reproduces.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The decomposition shows only the direction of the shift because the two figures are measured differently.

“The two figures are measured differently, the message tokens from message length and the file tokens as a share of the turn's output (see the caption), so the decomposition shows only the direction of the shift”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The sixteen-step arm was collected as one interleaved batch over three days, with team sizes balanced within each day so the round-robin protects the size comparison, and it is not a cross-session replication.

“The sixteen-step arm was collected as one interleaved batch over three days, with team sizes balanced within each day so the round-robin protects the size comparison, and it is not a cross-session replication.”

Classified as probably not a substantial claim. May combine two claims.

The tasks are pure functions with no randomness, and comparison is exact.

“The tasks are pure functions with no randomness, and comparison is exact.”

Classified as probably not a substantial claim. May combine two claims.

Giving files separate read and write edges puts file-mediated coordination on the same footing as direct messaging, which is what makes the channel comparison of Section 6 possible at all.

“Giving files separate read and write edges puts file-mediated coordination on the same footing as direct messaging, which is what makes the channel comparison of Section 6 possible at all.”

May combine two claims.

Each task is graded by a hidden test suite, and no prompt tells the agents to look for it.

“Each task is graded by a hidden test suite, and no prompt tells the agents to look for it.”

Classified as probably not a substantial claim. May combine two claims.

A run succeeds only if every test passes, so success is unambiguous while the path to it varies.

“A run succeeds only if every test passes, so success is unambiguous while the path to it varies.”

Classified as probably not a substantial claim. May combine two claims.

The instrument does not capture message content; introduction here simply names a pair's first contact.

“We read this from timing and message counts, because the instrument does not capture message content; introduction here simply names a pair's first contact.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The direction of the shift is corroborated by the message count itself, which collapses under the policy, and by the run-level totals.

“the direction is corroborated by the message count itself, which collapses under the policy, and by the run-level totals below.”

May combine two claims.

At ten runs a single cell's success rate carries a margin of roughly thirty percentage points, so single-cell readings are directional and the pooled contrasts carry the inferential weight.

“At ten runs a single cell's success rate carries a margin of roughly thirty percentage points, so single-cell readings are directional and the pooled contrasts carry the inferential weight.”

May combine two claims.

The total rises only because there are more pairs; each pair talks less.

“The total rises only because there are more pairs; each pair talks less.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Eight hypotheses (H1-H8) are stated in advance; six are pre-registered in both prediction and test (H1, H4-H8), while H2 and H3 carry qualifications set out in Appendix A.

“Eight hypotheses (H1-H8) are stated in advance; six are pre-registered in both prediction and test (H1, H4-H8), while H2 and H3 carry qualifications set out in Appendix A.”

May combine two claims.

The directed count describes how many peers an agent actively pushes to, which is generally fewer than the undirected connectivity, though it is a range, varying by experiment and session.

“The directed count describes how many peers an agent actively pushes to, which is generally fewer than the undirected connectivity, though it is a range, varying by experiment and session.”

Classified as probably not a substantial claim.

The sixteen-step arm carries twenty runs per cell under the allowed policy instead of ten, decided in advance.

“The sixteen-step arm carries twenty runs per cell under the allowed policy instead of ten, decided in advance”

Classified as probably not a substantial claim. May combine two claims.

All runs use Claude Code (the 2.1.x series) with the model pinned to claude-sonnet-4-6 and logged, unchanged, on every turn.

“All runs use Claude Code (the 2.1.xseries) with the model pinned to claude-sonnet-4-6 and logged, unchanged, on every turn.”

May combine two claims.

Left to organise themselves, the teams do not converge on a single coordination span; they let the task dictate the structure.

“Left to organise themselves, the teams do not converge on a single coordination span; they let the task dictate the structure (Section 5).”

May combine two claims.

A pipeline needs each owner to agree interfaces only with its neighbours, and the sustained graph records that local structure.

“A pipeline needs each owner to agree interfaces only with its neighbours, and the sustained graph records that local structure.”

Classified as probably not a substantial claim. May combine two claims.

Every task ships with a reference solution, and a fixed suite of behavioural input/output tests grades the team's deliverable against outputs fixed in advance.

“Every task ships with a reference solution, and a fixed suite of behavioural input/output tests grades the team's deliverable against outputs fixed in advance”

May combine two claims.

The growth is a round of introductions, made once, early.

“The growth is a round of introductions, made once, early.”

May combine two claims.

Evaluations typically report task success and the final code or patch, with computational cost increasingly considered as an additional evaluation dimension, or prescribe which agents may communicate with which.

“Evaluations typically report task success and the final code or patch, with computational cost increasingly considered as an additional evaluation dimension [1,19,32], or prescribe which agents may communicate with which [16,29,39].”

• cites [1]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [19]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [32]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [16]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [29]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [39]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Adding an agent adds one more introduction, while the lasting per-agent coordination barely grows, and on the largest teams the messaging cost of growth falls to zero because the team switches to broadcast.

“Adding an agent adds one more introduction, while the lasting per-agent coordination barely grows, and on the largest teams the messaging cost of growth falls to zero because the team switches to broadcast.”

Classified as probably not a substantial claim. May combine two claims.

The test suite is placed outside each agent's working directory; in the main collection that placement was not otherwise access-controlled.

“The test suite is placed outside each agent's working directory; in the main collection that placement was not otherwise access-controlled”

May combine two claims.

Reconciling one specification pulls the team towards talking to everyone, and those partners also interconnect, so the sustained graph is a near-complete, tightly clustered mesh.

“Reconciling one specification pulls the team towards talking to everyone, and those partners also interconnect, so the sustained graph is a near-complete, tightly clustered mesh.”

May combine two claims.

The mismatch is invisible to each agent, whose own step is correct, and invisible in the finished code, which runs.

“The mismatch is invisible to each agent, whose own step is correct, and invisible in the finished code, which runs.”

May combine two claims.

The flat condition was collected twice under byte-identical prompts, giving 54 matched cell pairs that are exact same-configuration replications under one pinned model.

“The flat condition was collected twice under byte-identical prompts, giving 54 matched cell pairs that are exact same-configuration replications under one pinned model.”

May combine two claims.

Success on the conflicting split measures arbitration only imperfectly: the grader silently enforces one of the two rules, so a team that arbitrates cleanly still fails if it agrees on the other, and the outcome mixes arbitration with landing on the enforced convention.

“Success on this split measures arbitration only imperfectly: the grader silently enforces one of the two rules, so a team that arbitrates cleanly still fails if it agrees on the other, and the outcome mixes arbitration with landing on the enforced convention”

May combine two claims.

The seal functions as a tripwire that defeats the observed reach pattern and records every tool-mediated attempt.

“The seal therefore functions as a tripwire that defeats the observed reach pattern and records every tool-mediated attempt.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Shell-mediated reads, which the graph does not capture, would raise each of these counts.

“shell-mediated reads, which the graph does not capture, would raise each of these counts.”

Classified as probably not a substantial claim.

The file graph captures tool-mediated file activity only.

“The file graph captures tool-mediated file activity only.”

May combine two claims.

In the main collection this cost ten runs their recorded write, because their deliverable was created with a shell command, which leaves no edge, so file activity is undercounted in about 0.6% of runs.

“In the main collection this cost ten runs their recorded write, because their deliverable was created with a shell command, which leaves no edge, so file activity is undercounted in about 0.6% of runs.”

May combine two claims.

The reachable files are a containment gap in the setup; the looking is the agents' own behaviour, measured directly under the seal below.

“The reachable files are a containment gap in the setup; the looking is the agents' own behaviour, measured directly under the seal below.”

May combine two claims.

No prompt forbade reading these files, and none asked for them; the only stated constraint concerned which files a team could create.

“No prompt forbade reading these files, and none asked for them; the only stated constraint concerned which files a team could create.”

May combine two claims.

Files are not passive outputs; they are the one-to-many channel, and the cheaper one wherever one-to-one messaging would otherwise dominate.

“Files are not passive outputs; they are the one-to-many channel, and the cheaper one wherever one-to-one messaging would otherwise dominate.”

May combine two claims.

The cells that drift are the high-coordination ones, where the task leaves the team the most freedom in how to organise; the cells that reproduce are those where the task pins the coordination down, as a chain does.

“The cells that drift are the highcoordination ones, where the task leaves the team the most freedom in how to organise; the cells that reproduce are those where the task pins the coordination down, as a chain does.”

May combine two claims.

The containment gap in the main collection is unsurprising in hindsight: agents that look for the answer key when they are confined will read it when they are not.

“it makes the containment gap in the main collection unsurprising in hindsight: agents that look for the answer key when they are confined will read it when they are not.”

May combine two claims.

The seal stops short of an enforced sandbox: a read issued through the shell would not be captured, and the runs execute under a permissive filesystem mode.

“It stops short of an enforced sandbox: a read issued through the shell would not be captured, and the runs execute under a permissive filesystem mode.”

May combine two claims.

The direction of the difference makes the rule conditional: Experiment 1 teams left to themselves coordinate by one-to-one messages, so replacing that channel with files removes repetition; Experiment 2 teams already pass their work through files, each step's output read by the next, so mandating more file traffic only adds overhead.

“The direction of the difference is the finding, and it makes the rule conditional: Experiment 1 teams left to themselves coordinate by one-to-one messages, so replacing that channel with files removes repetition; Experiment 2 teams already pass their work through files, each step's output read by the next, so mandating more file traffic only adds overhead.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The cross-experiment interaction reported here (p = 0.24) is an exploratory test, outside the pre-registration.

“the cross-experiment interaction reported here (p = 0.24) is an exploratory test, outside the pre-registration (Appendix A).”

May combine two claims.

The associations explain about a tenth of the variance and the causality is open, since a run that goes well needs less repair traffic.

“but the associations explain about a tenth of the variance and the causality is open, since a run that goes well needs less repair traffic.”

May combine two claims.

No prompt asks for any of these files; the test-file and prompt reads return only a placeholder, and the manifest read returns no grading material, so the reach for the test file is an unprompted tendency to seek out the grading material.

“No prompt asks for any of these files; the test-file and prompt reads return only a placeholder, and the manifest read returns no grading material, so the reach for the test file is an unprompted tendency to seek out the grading material.”

May combine two claims.

Decomposition creates interfaces between agents, every interface needs an owner, and the graph shows which interfaces have none; those are where the teams break.

“Decomposition creates interfaces between agents, every interface needs an owner, and the graph shows which interfaces have none; those are where the teams break.”

May combine two claims.

Diagnosing it draws on the specification, the identical failure across the runs, and the transcripts, none of which is the graph; what the coordination graph adds is the structural signature, that at eight agents the seam falls on a boundary between two different owners, an interface no single agent sits across.

“Diagnosing it draws on the specification, the identical failure across the runs, and the transcripts, none of which is the graph; what the coordination graph adds is the structural signature, that at eight agents the seam falls on a boundary between two different owners, an interface no single agent sits across.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

A coordinator exists only where the interaction structure carries the role, and a prompt clause alone does not create that structure.

“A coordinator exists only where the interaction structure carries the role, and a prompt clause alone does not create that structure.”

Classified as probably not a substantial claim. May combine two claims.

Edges come from the runtime's Read, Write, and Edit tools; a file operation issued through the shell leaves no edge.

“Edges come from the runtime's Read, Write, and Edit tools; a file operation issued through the shell leaves no edge.”

Classified as probably not a substantial claim. May combine two claims.

The sealed batch is 244 runs at eight agents on the distributed task, covering the six conflicting-split cells (flat and coordinator under each file policy) and the two clean-split file cells, on the same pinned model and with the grading suite byte-identical to the released one.

“The sealed batch is 244 runs at eight agents on the distributed task, covering the six conflicting-split cells (flat and coordinator under each file policy) and the two clean-split file cells, on the same pinned model and with the grading suite byte-identical to the released one.”

May combine two claims.

The two experiments differ in one prompt detail: Experiment 2's prompt asks agents to coordinate through messages, and its file-first behaviour runs against that instruction, so the cross-experiment contrasts are conservative with respect to it.

“The two experiments also differ in one prompt detail: Experiment 2's prompt asks agents to coordinate through messages, and its file-first behaviour runs against that instruction, so the cross-experiment contrasts are conservative with respect to it.”

May combine two claims.

The reported token totals count input and output only, excluding the cached context re-read on each turn, which is the bulk of the throughput.

“The reported token totals count input and output only, excluding the cached context re-read on each turn, which is the bulk of the throughput”

May combine two claims.

The common thread is that what the prompt declares and what the interaction structure builds can differ, and the measured outcomes follow the second.

“The common thread is that what the prompt declares and what the interaction structure builds can differ, and the measured outcomes follow the second.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The bars are non-zero because the same file is created and revised several times per run.

“the bars are non-zero because the same file is created and revised several times per run.”

May combine two claims.

A within-batch regression of messaging on run order shows no drift, so batches are internally stable.

“A within-batch regression of messaging on run order shows no drift, so batches are internally stable”

Classified as probably not a substantial claim. May combine two claims.

Every cell carries ten repetitions, the model identifier is logged per turn (no mid-study change occurred), and within a batch a regression of messaging on run order shows no drift.

“Every cell carries ten repetitions, the model identifier is logged per turn (no mid-study change occurred), and within a batch a regression of messaging on run order shows no drift.”

May combine two claims.

In every case the topology is an input: the system fixes or searches the structure and then scores the outcome, so the coordination that happens inside the structure goes unmeasured.

“In every case the topology is an input: the system fixes or searches the structure and then scores the outcome, so the coordination that happens inside the structure goes unmeasured.”

Probably not a substantial claim: may not pass S2 (checkable).

A configuration is a distribution of runs.

“so a configuration is a distribution of runs”

May combine two claims.

Leadership assigned by prompt is nominal only: it creates no structure and buys no reliable success, and a sealed replication of the eight-agent conflict cells leaves flat and coordinator teams level under every file policy.

“Leadership assigned by prompt is nominal only: it creates no structure and buys no reliable success, and a sealed replication of the eight-agent conflict cells leaves flat and coordinator teams level under every file policy.”

May combine two claims.

The two scaling arms were built without either confound and reproduce the deceleration and the plateau.

“the two scaling arms were built without either confound and reproduce the deceleration and the plateau.”

May combine two claims.

This is an undercount, so the sparse file structure we report is conservative: any unlogged operation would only add edges.

“This is an undercount, so the sparse file structure we report is conservative: any unlogged operation would only add edges.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

H7 met its pre-committed power-limited branch and is reported as directional.

“H7 met its pre-committed power-limited branch and is reported as directional”

May combine two claims.

Decomposition creates interfaces between agents, each interface needs an owner, and the graph shows which have none.

“Decomposition creates interfaces between agents, each interface needs an owner, and the graph shows which have none.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Multi-agent runs permit something stronger: every message, write, and read made through the runtime's tools is a logged event, so the temporal network of a collaboration can be recorded directly from the trace as it happens.

“Multi-agent runs permit something stronger: every message, write, and read made through the runtime's tools is a logged event, so the temporal network of a collaboration can be recorded directly from the trace as it happens.”

Probably not a substantial claim: may not pass S2 (checkable).

What is missing is an instrument: a way to observe the coordination structure that emerges during a run, on the same footing for messages and for shared artefacts, and comparable across team sizes, configurations, and frameworks.

“What is missing is an instrument: a way to observe the coordination structure that emerges during a run, on the same footing for messages and for shared artefacts, and comparable across team sizes, configurations, and frameworks.”

Classified as probably not a substantial claim.

The per-channel token figures are proxies on two bases.

“The per-channel token figures are proxies on two bases.”

May combine two claims.

At eight agents the clean main-matrix cells leave four agents idle, and the four-agent break coincides with the tasks' four-unit structure.

“At eight agents the clean main-matrix cells leave four agents idle, and the four-agent break coincides with the tasks' four-unit structure”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The graph schema and parser apply to any runtime that logs tool calls and messages.

“The graph schema and parser apply to any runtime that logs tool calls and messages”

May combine two claims.

The run-level output-token results use the model's reported totals and are independent of the division, and the direction of the channel substitution survives any monotone re-attribution within a turn.

“the run-level output-token results use the model's reported totals and are independent of the division, and the direction of the channel substitution survives any monotone re-attribution within a turn.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Human group sizes cluster near five and fifteen in Zhou et al.'s analysis.

“human group sizes cluster near five and fifteen in Zhou et al.'s analysis [37]”

• cites [37]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

A sealed replication of the load-bearing cells, with decoys where the real files had sat, both confirmed the two findings it re-tested under containment, the coordinator null and the message-to-file substitution.

“A sealed replication of the load-bearing cells, with decoys where the real files had sat, both confirmed the two findings it re-tested under containment, the coordinator null and the message-to-file substitution”

Probably not a substantial claim: may not pass S3 (load-bearing).

There are no sixteen-agent distributed runs.

“there are no sixteen-agent distributed runs”

Probably not a substantial claim: may not pass S3 (load-bearing).

The axis runs from the first message to the last, so it says nothing about where the run itself ends.

“The axis runs from the first message to the last, so it says nothing about where the run itself ends.”

May combine two claims.

In Experiment 2 the files already carry the coordination, so the rule only adds overhead.

“in Experiment 2 the files already carry the coordination, so the rule only adds overhead.”

May combine two claims.

Files, usually treated as outputs, are the team's one-to-many channel, and requiring their use cuts output tokens by about 42% at eight agents on message-heavy work, while adding cost on chain-shaped work whose files already carry the coordination.

“Files, usually treated as outputs, are the team's one-to-many channel, and requiring their use cuts output tokens by about 42% at eight agents on message-heavy work, while adding cost on chain-shaped work whose files already carry the coordination.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The agents are stochastic and a model identifier does not fix the provider's state.

“The agents are stochastic and a model identifier does not fix the provider's state.”

May combine two claims.

Token cost on file edges divides a turn's output evenly across its tool calls, while token cost on message edges is estimated from message length, so the two are not a like-for-like total and the channel bars of Figure 8 show direction only.

“Token cost on file edges divides a turn's output evenly across its tool calls, while token cost on message edges is estimated from message length, so the two are not a like-for-like total and the channel bars of Figure 8 show direction only”

May combine two claims.

The coordinator is a prompt clause with no enforced routing, so Section 7 measures the effect of nominal leadership.

“The coordinator is a prompt clause with no enforced routing, so Section 7 measures the effect of nominal leadership”

Probably not a substantial claim: may not pass S3 (load-bearing).

Dunbar links group size to limits on the relationships that can be monitored.

“Dunbar links group size to limits on the relationships that can be monitored [11]”

• cites [11]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Multi-agent AI coding systems are evaluated by their outputs, but they succeed or fail by their coordination, and the coordination is invisible in the output.

“Multi-agent AI coding systems are evaluated by their outputs, but they succeed or fail by their coordination, and the coordination is invisible in the output.”

Classified as probably not a substantial claim. May combine two claims.

The claims we generalise are structural: the handshake-then-core shape, the one-to-many economics of files, and the gap between nominal and structural leadership.

“The claims we generalise are structural: the handshake-then-core shape, the one-to-many economics of files, and the gap between nominal and structural leadership.”

May combine two claims.

The quadratic cost of communication is real but shallow: it is an opening handshake, made once, after which each agent sustains a few channels, no hub forms, and the largest teams switch increasingly to broadcast and messaging growth levels off between eight and sixteen agents.

“The quadratic cost of communication is real but shallow: it is an opening handshake, made once, after which each agent sustains a few channels, no hub forms, and the largest teams switch increasingly to broadcast and messaging growth levels off between eight and sixteen agents.”

Classified as probably not a substantial claim.

A second line of work designs the communication structure in advance: which agents may talk to which, in what order, and through what roles.

“A second line of work designs the communication structure in advance: which agents may talk to which, in what order, and through what roles.”

• cites [16]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [29]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [10]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [30]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

At ten runs a cell's success rate carries a margin of roughly thirty percentage points, so single-cell readings are directional and pooled contrasts carry the weight.

“Power is the limit: at ten runs a cell's success rate carries a margin of roughly thirty percentage points, so single-cell readings are directional and pooled contrasts carry the weight.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Our design cannot place the growth break more precisely than the eight-to-sixteen interval.

“our design cannot place the growth break more precisely than the eight-to-sixteen interval”

Classified as probably not a substantial claim. May combine two claims.

Confirmatory claims rest on hypotheses pre-registered in both prediction and test (H1, H4-H8), with Benjamini-Hochberg correction within each contrast set.

“Confirmatory claims rest on hypotheses pre-registered in both prediction and test (H1, H4-H8), with Benjamini-Hochberg correction within each contrast set”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

An ambiguous return-type clause in one specification was tightened and the worst cell re-validated (three of three passes) before the full schedules ran, leaving a cleaner outcome variable.

“an ambiguous return-type clause in one specification; the clause was tightened and the worst cell re-validated (three of three passes) before the full schedules ran, leaving a cleaner outcome variable.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Spans of workable oversight have been placed at around five direct reports by Graicunas and near seven items by Miller.

“Spans of workable oversight have been placed at around five direct reports by Graicunas [15] and near seven items by Miller [25]”

• cites [15]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [25]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The numbers come from two synthetic Python tasks, one runtime, and one pinned model, and the specific values will not carry directly to other settings.

“The numbers come from two synthetic Python tasks, one runtime, and one pinned model, and the specific values will not carry directly to other settings.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

H3 carries a separate qualification: the Experiment 2 plan pre-registers a within-Experiment-2 Fisher test of the flat condition (labelled peer in the pre-registration) against the coordinator condition (labelled orchestrator) on the conflicting split, which is inconclusive, whereas the cross-experiment interaction reported in Section 7 (p = 0.24) is an exploratory test the plan does not specify.

“H3 carries a separate qualification: the Experiment 2 plan pre-registers a within-Experiment-2 Fisher test of the flat condition (labelled peer in the pre-registration) against the coordinator condition (labelled orchestrator) on the conflicting split, which is inconclusive, whereas the cross-experiment interaction reported in Section 7 (p = 0.24) is an exploratory test the plan does not specify.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

The strict alternative of topping up every flagged cell was considered and set aside, and we record the departure here.

“The strict alternative of topping up every flagged cell was considered and set aside, and we record the departure here.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The one deviation in the other direction is the sixteen-step scaling arm, pre-registered at twenty runs per allowed cell to tighten the plateau test of hypothesis H8.

“The one deviation in the other direction is the sixteen-step scaling arm, pre-registered at twenty runs per allowed cell to tighten the plateau test of hypothesis H8.”

Classified as probably not a substantial claim. May combine two claims.

The pre-registrations released with the package are the Experiment 2 plan, which states H1 and H3-H6 with their tests, and the two scaling-arm commitments, which state H7 and H8.

“The pre-registrations released with the package are the Experiment 2 plan, which states H1 and H3-H6 with their tests, and the two scaling-arm commitments, which state H7 and H8.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Two ablations defend the design.

“Two ablations defend the design.”

Classified as probably not a substantial claim. May combine two claims.

We topped up none of them, which is a deviation from the rule as written, made deliberately and recorded at the time.

“We topped up none of them, which is a deviation from the rule as written, made deliberately and recorded at the time.”

Classified as probably not a substantial claim. May combine two claims.

We judged it unnecessary because the confirmatory success contrasts pool across cells, so no single cell decides them, and because many of the graph-statistic flags were triggered by a metric other than the one a headline result uses for that cell, a cell flagged on file-read variance, say, whose headline reading is message count or sustained degree.

“we judged it unnecessary because the confirmatory success contrasts pool across cells, so no single cell decides them, and because many of the graph-statistic flags were triggered by a metric other than the one a headline result uses for that cell, a cell flagged on file-read variance, say, whose headline reading is message count or sustained degree.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Topping the flagged cells up to twenty runs would have sharpened their estimates, the graph-statistic means as much as the success rates, by the usual factor of about √ 2.

“Topping the flagged cells up to twenty runs would have sharpened their estimates, the graph-statistic means as much as the success rates, by the usual factor of about √ 2”

Classified as probably not a substantial claim. May combine two claims.

The hypotheses committed in full, in both prediction and pre-registered test, are therefore H1 and H4-H8; H2 and H3 carry the qualifications above, and both are reported as inconclusive or null.

“The hypotheses committed in full, in both prediction and pre-registered test, are therefore H1 and H4-H8; H2 and H3 carry the qualifications above, and both are reported as inconclusive or null.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The Experiment 1 plan released alongside them pre-registers only the top-up decision above, so H2 is not a fully pre-registered hypothesis: its predicted direction was fixed from the Experiment 1 pilot, but its Fisher test and its correction set were specified after the schedule had run, before the inferential analysis.

“The Experiment 1 plan released alongside them pre-registers only the top-up decision above, so H2 is not a fully pre-registered hypothesis: its predicted direction was fixed from the Experiment 1 pilot, but its Fisher test and its correction set were specified after the schedule had run, before the inferential analysis.”