Raven: The Harness of Harnesses for Composable Agentic Intelligence
Open accessAbstract
As large language models advance, AI agents are moving beyond isolated, domain-specific tasks toward long-horizon, cross-domain workflows. This transition exposes two challenges: increasing harness complexity makes manual design difficult to scale, while tighter coupling to specific domains limits the generality of a single harness. The central question thus shifts from how to engineer a stronger harness for one domain to how to autonomously construct specialized harnesses, improve them through experience, and orchestrate them across domains. We introduce Raven, \emph{The Harness of Harnesses}, an open-source multi-agent ecosystem that automatically constructs and evolves modular harnesses for specific models and domains, treating each executable model--harness pair as a composable unit of intelligence. To support an \emph{All-Domain Collaboration Network}, its Host Agent decomposes goals, matches subtasks to specialized agents, coordinates execution dependencies, and integrates results, while a host archive and EverOS preserve experience across tasks and Skill Forge makes that experience available as reusable procedures. Our theory establishes sufficient conditions for such composition to expand reliable task coverage beyond that of the available individual agents under a shared resource budget. On complex and long-horizon tasks, Raven significantly outperforms the state-of-the-art agent systems, pushing the frontier of composable agentic intelligence.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No free lunch theorems for optimization
Wolpert, D. H., & Macready, W. G. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585893 · Cited by 14,237 · see citing works
An axiomatic basis for computer programming
Hoare, C. A. R. (1969) · Communications of the ACM · doi:10.1145/363235.363259 · Cited by 4,006 · see citing works
Evaluating Large Language Models Trained on Code
Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03374 · Cited by 1,436 · see citing works
ReAct: Synergizing Reasoning and Acting in Language Models
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.03629 · Cited by 608 · see citing works
Resources, concurrency, and local reasoning
O’Hearn, P. W. (2007) · Theoretical Computer Science · doi:10.1016/j.tcs.2006.12.035 · Cited by 556 · see citing works
Illuminating search spaces by mapping elitesPreprint
Mouret, J.-B., & Clune, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.04909 · Cited by 407 · see citing works
Voyager: An Open-Ended Embodied Agent with Large Language Models
Wang, G., Xie, Y., Jiang, Y., Mandlekar, A., Xiao, C., Zhu, Y., Fan, L., & Anandkumar, A. (2023) · arXiv · doi:10.48550/arxiv.2305.16291 · Cited by 222 · see citing works
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
Wu, Q., Bansal, G., Zhang, J., Wu, Y., Li, B., Zhu, E., Jiang, L., Zhang, X., Zhang, S., Liu, J., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.08155 · Cited by 193 · see citing works
AgentBench: Evaluating LLMs as Agents
Liu, X., Yu, H., Zhang, H., Xu, Y., Lei, X., Lai, H., Gu, Y., Ding, H., Men, K., Yang, K., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.03688 · Cited by 79 · see citing works
MemGPT: Towards LLMs as Operating Systems
Packer, C., Wooders, S., Lin, K., Fang, V., Patil, S. G., Stoica, I., & Gonzalez, J. E. (2023) · arXiv · doi:10.48550/arxiv.2310.08560 · Cited by 64 · see citing works
SkillRouter: Skill Routing for LLM Agents at Scale
Zheng, Y.-Z., Zhang, Z.-T., Ma, C., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2603.22455 · Cited by 60
ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation EvaluationPreprint
Zhang, C.-C., Li, Y., Xu, C., Liu, J.-H., Liu, A., Hu, S.-H., Wu, D.-P., Huang, G., Li, K.-J., Yi, Q., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2507.04952 · Cited by 43 · see citing works
Tools and Algorithms for the Construction and Analysis of Systems
Esparza, J., & Majumdar, R. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12002-2 · Cited by 31 · see citing works
MiroThinker-1.7 & H1: Towards Heavy-Duty Research Agents via VerificationPreprint
Бай, М., Bing, L., Lei, L., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2603.15726 · Cited by 31 · see citing works
A benchmark of expert-level academic questions to assess AI capabilities
Center for AI Safety, Phan, L., Gatti, A., Li, N., Khoja, A., Kim, R., Ren, R., Hausenloy, J., Zhang, O., Mazeika, M., et al. (2026) · Nature · doi:10.1038/s41586-025-09962-4 · Cited by 23 · see citing works
Su, S., Xing, S., Dong, X., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2602.22808 · Cited by 20
Can AI Agents Answer Your Data Questions? A Benchmark for Data Agents
Ma, R., Shankar, S., Chen, R., Lin, Y.-M., Zeighami, S., Ghosh, R., Gupta, A., Gupta, A., Gopal, T., & Parameswaran, A. G. (2026) · arXiv.org · doi:10.48550/arxiv.2603.20576 · Cited by 18
Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks
Fourney, A., Bansal, G., Mozannar, H., Tan, C., Salinas, E., Erkang, Zhu, Niedtner, F., Proebsting, G., Bassman, G., et al. (2024) · arXiv · doi:10.48550/arxiv.2411.04468 · Cited by 17 · see citing works
MasRouter: Learning to Route LLMs for Multi-Agent Systems
Yue, Y., Zhang, G., Liu, B., Wan, G., Wang, K., Cheng, D., & Qi, Y. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.757 · Cited by 14 · see citing works
PresentBench: A Fine-Grained Rubric-Based Benchmark for Slide Generation
Chen, X.-S., Zhu, J.-Y., Li, P., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2603.07244 · Cited by 13
Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory
Chhikara, P., Khant, D., Aryan, S., Singh, T., & Yadav, D. (2025) · arXiv · doi:10.48550/arxiv.2504.19413 · Cited by 10 · see citing works
Zep: A Temporal Knowledge Graph Architecture for Agent Memory
Rasmussen, P., Paliychuk, P., Beauvais, T., Ryan, J., & Chalef, D. (2025) · arXiv · doi:10.48550/arxiv.2501.13956 · Cited by 9 · see citing works
AFlow: Automating Agentic Workflow Generation
Zhang, J., Xiang, J., Yu, Z., Teng, F., Chen, X., Chen, J., Zhuge, M., Cheng, X., Hong, S., Wang, J., et al. (2024) · arXiv · doi:10.48550/arxiv.2410.10762 · Cited by 7 · see citing works
EvoAgentBench: Benchmarking Agent Self-Evolution via Ability Transfer
Gao, X., Hu, C.-R., Chen, H., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2607.05202 · Cited by 7
Cai, S.-Q., Chen, S.-P., Fei, X., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2607.20911 · Cited by 5 · see citing works
SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
Deng, X., Da, J., Pan, E., He, Y. Y., Ide, C., Garg, K., Lauffer, N., Park, A., Pasari, N., Rane, C., et al. (2025) · arXiv · doi:10.48550/arxiv.2509.16941 · Cited by 4 · see citing works
SWE Refactor Bench: Can Coding Agents Complete a Long-Horizon, Whole-Repository Stack Migration?
Hong, D.-Y., Chi, Y.-Z., Li, W.-Y., et al. (2026) · doi:10.48550/arxiv.2608.23564 · Cited by 4
MIRIX: Multi-Agent Memory System for LLM-Based Agents
Wang, Y., & Chen, X. (2025) · arXiv · doi:10.48550/arxiv.2507.07957 · Cited by 2 · see citing works
BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents
Wei, J., Sun, Z., Papay, S., McKinney, S., Han, J., Fulford, I., Chung, H. W., Passos, A. T., Fedus, W., & Glaese, A. (2025) · arXiv · doi:10.48550/arxiv.2504.12516 · Cited by 2 · see citing works
Grow the Harness, Not the Context: From Strategy-Free Scaffolds to Reusable Specialist AgentsPreprint
Li, L.-Z., Li, J.-R., Zhao, J., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.26760 · Cited by 2 · see citing works
Memory in the Age of AI Agents
Hu, Y., Liu, S., Yue, Y., Zhang, G., Liu, B., Zhu, F., Lin, J., Guo, H., Dou, S., Xi, Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2512.13564 · Cited by 1 · see citing works
SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks
Li, X., Liu, Y., Chen, W., You, B., Di, Z., He, Y., Zheng, S., Choe, K. W., Sun, J., Wang, S., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.12670 · Cited by 1 · see citing works
Towards a Science of Scaling Agent Systems
Kim, Y., Gu, K., Park, C., Park, C., Schmidgall, S., Heydari, A. A., Yan, Y., Zhang, Z., Zhuang, Y., Liu, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2512.08296 · Cited by 1 · see citing works
SkillCorpus: Consolidating and Evaluating the Open Skill Ecosystem for Real-World LLM Agents
Wang, Y., Yao, P., Sun, T.-Y., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2607.15557 · Cited by 1
xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluations
Chen, K., Ren, Y., Liu, Y., Hu, X., Tian, H., Xie, T., Liu, F., Zhang, H., Liu, H., Gong, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.13651 · Cited by 1 · see citing works
Bensalem, S., Dong, Y., Fränzle, M., Huang, X.-W., Kröger, J., Ničković, D., Nouri, A., Roy, R., & Wu, C.-S. (2026) · arXiv.org · doi:10.48550/arxiv.2605.18672 · Cited by 1 · see citing works
HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-EvolutionPreprint
Luo, X., Xue, D., Wang, F., Hu, C., & Deng, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.13683
MemOS: A Memory OS for AI System
Li, Z., Xi, C., Li, C., Chen, D., Chen, B., Song, S., Niu, S., Wang, H., Yang, J., Tang, C., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.03724
JobBench: Aligning Agent Work With Human Will
Li, Y., Feng, Y., Xu, Z., Ma, Z., Zheng, K., Jiang, F., Sun, X., Shao, R., Chen, Z., Huang, Y., et al. (2026) · arXiv · doi:10.48550/arxiv.2605.26329
SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skills
Zheng, B., Fatemi, M. Y., Jin, X., Wang, Z. Z., Gandhi, A., Song, Y., Gu, Y., Srinivasa, J., Liu, G., Neubig, G., et al. (2025) · arXiv · doi:10.48550/arxiv.2504.07079
HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?Preprint
Wu, Y., Zhang, J., Shi, J., Lei, X., Gu, Q., Zhang, Y., Wang, Z., He, C., Huang, C., Song, M., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.01437
Flagged first, then by citations
Research works printed but not linked: 24
- [1][1] Lakshya A. Agrawal, Shangyin Tan, Dilara Soylu, Noah Ziems, et al. GEPA: Reflective prompt evolution can outperform reinforcement learning. In International Conference on Learning Representations , volume 2026, pages 8479-8565. 2026. -
- [5][5] Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, et al. Large language models as tool makers. In International Conference on Learning Representations , volume 2024, pages 54067-54089. 2024. -
- [6][6] Mert Cemri, Melissa Z. Pan, Shuyi Yang, Lakshya A. Agrawal, et al. Why do multi-agent LLM systems fail? In Advances in Neural Information Processing Systems , volume 38. 2026. -
- [12][12] Yufan Dang, Chen Qian, Xueheng Luo, Jingru Fan, et al. Multi-agent collaboration via evolving orchestration. In Advances in Neural Information Processing Systems , volume 38, pages 165025-165059. 2026. -
- [16][16] Runnan Fang, Yuan Liang, Xiaobin Wang, Jialong Wu, et al. Memp: Exploring agent procedural memory. In Findings of the Association for Computational Linguistics: ACL 2026 , pages 17490-17502. 2026. -
- [22][22] Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, et al. MetaGPT: Meta programming for a multi-agent collaborative framework. In International Conference on Learning Representations , volume 2024, pages 23247-23275. 2024. -
- [23][23] Chuanrui Hu, Xingze Gao, Zuyi Zhou, Dannong Xu, et al. EverMemOS: A self-organizing memory operating system for structured long-horizon reasoning. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages 45836-45853. 2026. -
- [24][24] Shengran Hu, Cong Lu, and Jeff Clune. Automated design of agentic systems. In International Conference on Learning Representations , volume 2025, pages 21344-21377. 2025. -
- [26][26] Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, et al. SWE-bench: Can language models resolve real-world Github issues? In The Twelfth International Conference on Learning Representations . 2024. URL https://openreview.net/forum?id=VTF8yNQM66 . -
- [27][27] Jiazheng Kang, Mingming Ji, Zhe Zhao, and Ting Bai. Memory OS of AI agent. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing , pages 25972-25981. 2025. -
- [31][31] Satyapriya Krishna, Kalpesh Krishna, Anhad Mohananey, Steven Schwarcz, et al. Fact, fetch, and reason: A unified evaluation of retrieval-augmented generation. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) , pages 4745-4759. 2025. URL https://aclanthology.org/2025.naacl-long.243/ . -
- [41][41] Mike A. Merrill, Alexander G. Shaw, Nicholas Carlini, Boxuan Li, et al. Terminal-Bench: Benchmarking agents on hard, realistic tasks in command line interfaces. In International Conference on Learning Representations , volume 2026, pages 40903-40986. 2026. -
- [47][47] Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, et al. Training language models to follow instructions with human feedback. In Advances in Neural Information Processing Systems , volume 35, pages 27730-27744. 2022. -
- [49][49] Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, et al. Generative agents: Interactive simulacra of human behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology , pages 1-22. 2023. -
- [50][50] Tejal Patwardhan, Rachel Dias, Elizabeth Proehl, Grace Kim, et al. GDPval: Evaluating AI model performance on real-world economically valuable tasks. In International Conference on Learning Representations , volume 2026, pages 24005-24040. 2026. -
- [52][52] Chen Qian, Zihao Xie, YiFei Wang, Wei Liu, et al. Scaling large language model-based multi-agent collaboration. In International Conference on Learning Representations , volume 2025, pages 41488-41505. 2025. -
- [55][55] Timo Schick, Jane Dwivedi-Yu, Roberto Dessi, Roberta Raileanu, et al. Toolformer: Language models can teach themselves to use tools. In Advances in Neural Information Processing Systems . 2023. -
- [56][56] Yu Shang, Yu Li, Keyu Zhao, Likai Ma, et al. AgentSquare: Automatic LLM agent search in modular design space. In International Conference on Learning Representations , volume 2025, pages 3841-3865. 2025. -
- [60][60] Harsh Trivedi, Tushar Khot, Mareike Hartmann, Ruskin Manku, et al. AppWorld: A controllable world of apps and people for benchmarking interactive coding agents. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL) . 2024. -
- [63][63] Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, et al. A survey on large language model based autonomous agents. Frontiers of Computer Science , 18(6):186345, 2024. -
- [72][72] Wujiang Xu, Zujie Liang, Kai Mei, Hang Gao, et al. A-MEM: Agentic memory for LLM agents. In Advances in Neural Information Processing Systems , volume 38, pages 17577-17604. 2026. -
- [73][73] John Yang, Carlos E. Jimenez, Alexander Wettig, Kilian Lieret, et al. SWE-agent: Agent-computer interfaces enable automated software engineering. In Advances in Neural Information Processing Systems , volume 37, pages 50528-50652. 2024. -
- [77][77] Jenny Zhang, Shengran Hu, Cong Lu, Robert Lange, et al. Darwin Gödel Machine: Open-ended evolution of self-improving agents. In International Conference on Learning Representations , volume 2026, pages 104223-104294. 2026. -
- [79][79] Andrew Zhao, Daniel Huang, Quentin Xu, Matthieu Lin, et al. Expel: Llm agents are experiential learners. In Proceedings of the AAAI Conference on Artificial Intelligence , volume 38, pages 19632-19642. 2024. -
- Authors
- AI, E.
- Corresponding author
- AI, EverMind
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2026
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2609.33439
- OpenAlex
- W7214756539
- Cited by
- 0
- References
- 41
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- AI agents, harnesses, multi-agent systems, agent orchestration, long-horizon tasks, skill reuse, task decomposition, resource budget, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
