ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data
Open accessAbstract
Vision-Language Models (VLMs) have enabled computer use agents (CUAs) that operate GUIs autonomously, showing great potential, yet progress is limited by the lack of large-scale, open-source computer use data and foundation models. In this work, we introduce ScaleCUA, a step toward scaling open-source CUAs. It offers a large-scale dataset spanning 6 operating systems and 3 task domains, built via a closed-loop pipeline uniting automated agents with human experts. Trained on this scaled-up data, ScaleCUA can operate seamlessly across platforms. Specifically, it delivers strong gains over baselines (+26.6 on WebArena-Lite-v2, +10.7 on ScreenSpot-Pro) and sets new state-of-the-art results (94.4% on MMBench-GUI L1-Hard, 60.6% on OSWorld-G, 47.4% on WebArena-Lite-v2). These findings underscore the power of data-driven scaling for general-purpose computer use agents. We will release data, models, and code to advance future research: https://github.com/OpenGVLab/ScaleCUA.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Native GUI agents demonstrate proficiency in digital navigation but suffer from poor error recovery in stochastic environments, often failing when deviating from expert trajectories.
“they suffer from poor error recovery in stochastic environments, often failing when deviating from expert trajectories”
From OS-Themis: A Scalable Critic Framework for Generalist GUI Rewards (2026) · cites this paper as Liu et al., 2025
Figure 6 (p. 26) shows ScaleCUA repeatedly taking an ineffective action after missing a GUI element, supporting a concern about error recovery. But A.5.6 describes stochasticity in rule-driven data-collection agents, not stochastic environments in which native GUI agents fail; the cited passages do not link failures to deviations from expert trajectories or establish the claim for native GUI agents generally. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cited by
Sorted by citations
MAI-UI Technical Report: Real-World Centric Foundation GUI Agents
Zhou, H., Zhang, X., Tong, P., Zhang, J., Chen, L., Kong, Q., Cai, C., Liu, C., Wang, Y., Zhou, J., et al. (2025) · arXiv · doi:10.48550/arxiv.2512.22047
Self-citationEvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience
Xue, T., Peng, C., Huang, M.-Q., Guo, L., Han, T., Wang, H., Wang, J., Zhang, X.-C., Yang, X., Zhao, D., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2601.15876 · Cited by 58
“We assess EvoCUA’s performance across two critical dimensions: fine-grained GUI grounding (ScreenSpot-v2 [Wu et al., 2024], ScreenSpot-Pro [Li et al., 2025], OSWorld-G [Xie et al., 2025]) and general multimodal robustness (MMMU [Yue et al., 2024], MMMU-Pro [Yue et al., 2025], MathVista [Lu et al.,…”
InfluentialSelf-citationStep-GUI Technical ReportPreprint
GELab-Team, & StepFun (2025) · arXiv.org · doi:10.48550/arxiv.2512.15431 · Cited by 41 · see citing works
LongCat-Next: Lexicalizing Modalities as Discrete Tokens
Xiao, M., Wang, C., Li, C., Zhang, C., Peng, C., Yu, H., Yang, H., Yan, H., Sun, H., Zhao, H., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2603.27538 · Cited by 39
“For open-source data, we aggregate established datasets (e.g., AgentNet [116], ScaleCUA [73]) and immediately filter out abnormal samples.”
Self-citationLocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding
Wang, S.-H., Liu, S.-L., Kuang, Y., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.27365 · Cited by 32
“…e.g ., objects (Jiang et al., 2025a; Wang et al., 2023b; Yu et al., 2025; Zhang et al., 2024b), UI elements (Feizi et al., 2025; Lin et al., 2024a; Liu et al., 2025e; Nayak et al., 2025), regions (Cheng et al., 2024; Heinrich et al., 2025; Lai et al., 2024a; Ranzinger et al., 2024; Ren et al.,…”
Self-citationOS-Sentinel: Towards Safety-Enhanced Mobile GUI Agents via Hybrid Validation in Realistic Workflows
Sun, Q., Li, M., Liu, Z., et al. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2510.24411 · Cited by 25
“Liu et al., 2025c).”
Self-citationWebXSkill: Skill Learning for Autonomous Web Agents
Wang, Z., Wu, Q., Zhang, X.-C., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2604.13318 · Cited by 20
“Following prior work (Liu et al., 2025; Yang et al., 2026b), we use a cleaned subset of WebArena with 154 tasks.”
Self-citationMementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agents
Zeng, Z., Hua, H., Zou, B., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.18652 · Cited by 15
“Other computer-use agents accumulate reusable knowledge through online interaction, demonstrations, or self-improvement, including AppAgentX [28], MobileGPT [30], ScaleCUA [39], UI-Explorer [68], EvoCUA [73], and AppA-gent [82].”
Ferret-UI Lite: Lessons from Building Small On-Device GUI Agents
Yang, Z., Dou, Z.-Y., Feng, D., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2509.26539 · Cited by 15
“…(3B) (Liu et al., 2025b) 9.6 Kimi-VL (3B) (Team et al., 2025) 9.7 OpenCUA (A3B) (Wang et al., 2025b) 16.9 Ferret-UI Lite (3B) 17.3 ScaleCUA (7B) (Liu et al., 2025b) 14.3 UITars 1.5 (7B) (Qin et al., 2025) 24.5 OpenCUA (7B) (Wang et al., 2025b) 24.3 GUI-OWL (7B) (Ye et al., 2025) 32.1 QwenVL 2.5…”
InfluentialUI-Mem: Self-Evolving Experience Memory for Online Reinforcement Learning in Mobile GUI Agents
Xiao, H., Wang, G.-Z., Wang, H., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2602.05832 · Cited by 14
Self-citationLearn where to Click from Yourself: On-Policy Self-Distillation for GUI Grounding
Zhang, Y., Wu, D.-Q., Shen, H.-W., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.00642 · Cited by 12
“We conduct experiments on top of Qwen3-VL-Instruct-8B [1], using approximately 7K samples drawn from the ScaleCUA GUI datasets [20] for training.”
OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis
Cheng, K., Li, Z.-H., Ma, Z., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2604.15093 · Cited by 12
“Meanwhile, the open-source community relies on public datasets like AndroidControl (Li et al., 2024) and AMEX (Chai et al., 2025), achieves only around 30% on the same benchmark (Lu et al., 2025b; Liu et al., 2025).”
Self-citationToolCUA: Towards Optimal GUI-Tool Path Orchestration for Computer Use Agents
Hu, X., Zhang, X., Xu, H.-Y., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.12481 · Cited by 11
“OpenCUA [40] 8500 110k ScaleCUA [18] 300 20k Sandbox collected 1200 62k Source total 10k 192k critical steps ( D critical ) - 5k task as tool-beneficial when the with-tool success rate clearly exceeds the GUI-only success rate, and as non-tool-beneficial in the opposite case.”
InfluentialSelf-citationUI-Voyager: A Self-Evolving GUI Agent Learning via Failed ExperiencePreprint
Lin, Z.-C., Liu, F., Yang, Y., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2603.24533 · Cited by 11 · see citing works
“Qwen3-VL-2B (Bai et al., 2025a) 2B 36.4 MAI-UI-2B (Zhou et al., 2025b) 2B 49.1 ScaleCUA-3B (Liu et al., 2025) 3B 23.7 Ferret-UI Lite-3B (Yang et al., 2025c) 3B 28.0 Qwen3-VL-4B (Bai et al., 2025a) 4B 45.3 Step-GUI-4B (Yan et al., 2025b) 4B 63.9 UI-Tars-7B (Qin et al., 2025) 7B 33.0 UI-Tars-1.”
InfluentialSelf-citationTIDE: Trajectory-based Diagnostic Evaluation of Test-Time Improvement in LLM Agents
Yan, H., Che, X.-Y., Xu, F.-Z., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2602.02196 · Cited by 9
Self-citationStructAgent: Harness Long-horizon Digital Agents with Unified Causal Structure
Wu, W.-Y., Zhu, S.-B., Zhou, K., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2607.11388 · Cited by 8
“Recent GUI and computer-use models improve perception and action grounding, while system-level agents introduce decomposition, specialist roles, reflection, recovery, tools, or orchestration to make longer tasks more controllable [5–9, 12, 26–30].”
MemGUI-Agent: An End-to-End Long-Horizon Mobile GUI Agent with Proactive Context Management
Liu, G.-Y., Wu, G., Liu, C., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.19926 · Cited by 6
“OpenMobile-8B [3] Action-Thought 17.7 ClawGUI-2B [17] Action-Thought 17.1 OpenMobile-7B [3] Action-Thought 14.8 ScaleCUA-7B [13] Action-Thought 7.7 MemGUI-Agent-235B open-data 8B models.”
InfluentialSelf-citationLiu, G.-Y., Zhao, P.-X., Wu, G., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.19930 · Cited by 6
Self-citationRetrospective Progress-Aware Self-Refinement for LLM Agent Training
Ma, X.-B., Zheng, C.-M., Qiu, J.-Y., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.14302 · Cited by 6
OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agents
Yang, R., Wu, Q., Chen, Y.-X., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.02031 · Cited by 6
“Web agents powered by large vision-language models (VLMs) [1, 6, 39, 38, 41] have made rapid progress on realistic browser tasks, including product search, information extraction, and multi-step navigation [12, 18, 19, 50, 63, 49, 14, 25].”
OS-Oracle: A Comprehensive Framework for Cross-Platform GUI Critic ModelsPreprint
Wu, Z.-Y., Xie, J., Li, Z.-H., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2512.16295 · Cited by 6 · see citing works
Self-citationEvoCUA-1.5: Online Reinforcement Learning for Multi-turn Computer-Use Agents
Huang, M.-Q., Xue, T., Peng, C., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2607.09773 · Cited by 5
“Plus [Qwen Team, 2026] General 100 73.3% Open-Weight Models ScaleCUA-32B [Liu et al., 2025] Specialized 50 17.7% UI-TARS-72B-DPO [Qin et al., 2025] Specialized 50 24.6% OpenCUA-7B [Wang et al., 2025a] Specialized 100 26.6% UI-TARS-1.”
InfluentialSelf-citationRecovering Policy-Induced Errors: Benchmarking and Trajectory Synthesis for Robust GUI Agents
Bu, T.-P., Liu, X., Chen, Q.-H., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.29447 · Cited by 5
Self-citationMem-W: Latent Memory-Native GUI Agents
Zhang, G.-B., Ling, Y., Meng, F., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.09317 · Cited by 5
“We also incorporate reported or reproduced results from prior studies (Liu et al., 2025b; Yang et al., 2026), and (III) memory-augmented GUI agents , including Agent Workflow Memory (AWM) (Wang et al., 2024), ReasoningBank (Ouyang et al., 2026), CoMEM (Wu et al., 2025b) and HyMEM (Zhu et al.,…”
Avenir-Web: Human-Experience-Imitating Multimodal Web Agents with Mixture of Grounding ExpertsPreprint
Li, A., Hao, X., Liu, S., & Wang, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.02468
“G A GENT (Hong et al., 2024), O MNI P ARSER (Lu et al., 2024), S HOW UI (Lin et al., 2024), O PEN CUA (Wang et al., 2025b), MAI-UI (Zhou et al., 2025), E VO CUA (Xue et al., 2026), GTA1 (Yang et al., 2025), and others (OpenAI, 2025b; H Company, 2025; Lei et al., 2025; Cheng et al., 2026; Gou et al., 2025), serve as po…”
Self-citationNot All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents
Wu, B.-N., Ding, Z.-H., & Huang, J. (2026) · doi:10.48550/arxiv.2610.01787 · Cited by 4
“GUI agents are trained on trajectories, human demonstrations at first (Wang et al., 2025; Liu et al., 2026a) and now their own rollouts in verifiable environments (Wu et al., 2026j; Wang et al., 2026a).”
Self-citationUI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrations
Ding, Z., Dou, L.-X., Gao, Q., et al. (2026) · doi:10.48550/arxiv.2608.15930 · Cited by 4
“Native foundation agents such as UI-TARS [4], OpenCUA [1], ScaleCUA [2], Mobile-Agent-v3 [48], UI-Venus-1.”
Self-citationTrust the Right Teacher: Quality-Aware Self-Distillation for GUI Grounding
Huang, J.-Y., Huang, Z.-M., Shi, Y.-C., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.18101 · Cited by 4
“The training data follows the GUI-SD’s data construction, which is built based on ScaleCUA(Zhang et al., 2026a; Liu et al., 2025).”
UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents
Chai, Y., Xiao, H., Fu, X., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.29534 · Cited by 4
TreeCUA: Efficiently Scaling GUI Automation with Tree-Structured Verifiable Evolution
Jiang, D., Huang, J., Zhao, X., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2602.09662 · Cited by 4
“Although recent works (Cheng et al., 2024a; Xie et al., 2025; Chai et al., 2024; Huang et al., 2025) have successfully scaled GUI grounding datasets, these efforts focus primarily on static element recognition.”
Autonomous Continual Learning for Environment Adaptation of Computer-Use Agents
Xue, T., Liao, Z., Shi, T.-N., et al. (2026) · doi:10.48550/arxiv.2602.10356 · Cited by 4
“Prior work relies on fine-tuning with human-annotated, domain-specific data, which is costly, unscalable, and generalizes poorly to unseen environments (Wang et al., 2025c; Liu et al., 2025c; He et al., 2025).”
Fan, S.-Q., Li, M.-H., Ma, X., et al. (2026) · doi:10.48550/arxiv.2608.03327 · Cited by 3
MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillation
Yan, H., Gu, Z., Zhou, B.-T., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2607.29320 · Cited by 3
Self-citationScaling GUI Agents with Visual State Transitions
Liu, X.-Y., Li, K.-X., Wang, H.-N., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2607.24112 · Cited by 3
“Unified multimodal models (UMMs) (Xie et al., 2025; Chen et al., 2025b; Deng et al., 2025; Wu et al., 2025b) have recently gained increasing attention, as they handle flexible combinations of multimodal inputs and outputs within a single architecture.”
Scalable Behaviour Cloning on Browser Using via Skill Distillation
Yang, K.-S., Jiang, Z., Peng, Y.-Z., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.32014 · Cited by 3
“…to open-ended computer use and argues for robust observation–action abstractions over narrow memorization of UI state (Xie et al., 2024), while large-scale efforts such as ScaleCUA and OpenCUA characterize how competence scales with data and supervision (Liu et al., 2026; Wang et al., 2025a).”
Chen, Q.-S., Liu, Y., Li, L., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2510.09724 · Cited by 3
“Furthermore, with the rapid progress of GUI-based agents (Qin et al., 2025; Sun et al., 2025b; Liu et al., 2025), agent-driven testing represents a promising future direction that could offer more flexibility and broader applicability than the current scripted approach (Wang et al., 2026; Liang et…”
Self-citationWuying-Browser-Agent: Real-World Centric Fundamental Long-Horizon Browser Agents
Chen, A., Cheng, Y., Han, Z., et al. (2026) · doi:10.48550/arxiv.2608.17319 · Cited by 2
“UI-TARS [27] and UI-TARS-2 [35] develop native GUI agent models that perceive screenshots directly, while FARA [1], MolmoWeb [10] and ScaleCUA [18] demonstrate that compact models with efficient agentic design or curated demonstrations can achieve strong performance.”
Self-citationThe Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents
Li, W., Liu, J., Chu, T., et al. (2026) · doi:10.48550/arxiv.2608.06065 · Cited by 2
Thinking by Doing: Building Efficient World Model Reasoning in LLMs via Multi-turn Interaction
Shu, B., Cai, Y., Sun, J.-J., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2511.23476 · Cited by 2
“ScaleCUA [17] introduces a suite of GUI-related tasks to comprehensively lay a foundation for the digital world.”
Self-citationLabOSBench: Benchmarking Computer Use Agents for Scientific Instrument Control
Zou, A.-Q., Deng, H., Zhang, C., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.16802 · Cited by 1
“Screen parsing methods [Lu et al., 2024a, Li et al., 2025] improve agents’ ability to identify actionable elements in complex visual observations.”
Self-citationAudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation
Tian, Z.-Y., Ke, L., Liu, Z., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.12555 · Cited by 1
Self-citationA History-Aware Visually Grounded Critic for Computer Use Agents
Lee, J., Khan, Z., Prasad, A., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2606.11078 · Cited by 1
“To synthe-size a comprehensive set of common GUI failure modes reported in recent CUA literature (Li et al., 2025; Wang et al., 2025; Liu et al., 2026; Jin et al., 2026), we prompt the annotator to systematically perturb the expert action a t into a perturbed action ˆ a t (Figure 3 .”
InfluentialCutVerse: A Compositional GUI Agents Benchmark for Media Post-Production Editing
Hu, H., Guo, X., Chen, Z., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.19484 · Cited by 1
“…strong interactive capabilities across general-purpose domains [7, 21, 31, 34, 37] like web navigation [6, 19, 20, 49, 62] and operating systems [2, 27, 30, 33, 38, 41, 44, 48, 55], they aim to bridge natural language instructions and executable actions within interactive software environments.”
ReVision: Scaling Computer-Use Agents via Temporal Visual Redundancy Reduction
Abaskohi, A., He, Y.-H., West, P., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.11212 · Cited by 1
“Other approaches, including WebVoyager, SeeAct, and ScaleCUA, incorporate both visual observations and structured signals to improve robustness in complex environments (He et al., 2024; Zheng et al., 2024; Liu et al., 2025).”
IntentScore: Intent-Conditioned Action Evaluation for Computer-Use Agents
Chen, R.-Q., Li, Y., Fang, Z.-Y., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2604.05157 · Cited by 1
“At each step, the agent observes the current screen (typically as a screenshot), reasons about the task progress, and generates executable GUI actions such as mouse clicks, keyboard inputs, and scrolls Liu et al. (2025b); Wang et al. (2025a); Agashe et al. (2024; 2025).”
Video-Based Reward Modeling for Computer-Use Agents
Song, L.-X., Zhang, J., Sheng, H.-X., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2603.10178 · Cited by 1
“In contrast, we pair successful trajectories with semantically mismatched instructions to generate scalable hard negatives, while standardizing heterogeneous data sources into a unified representation [39,64,70].”
InfluentialSelf-citationEtCon: Edit-then-Consolidate for Reliable Knowledge Editing
Li, R., Wang, Y.-B., Zhu, W.-H., Li, C.-L., Zhang, J., Li, C.-L., Yan, J.-C., & Wang, J.-Q. (2025) · arXiv.org · doi:10.48550/arxiv.2512.04753 · Cited by 1
“…numerous tasks Guo et al. (2025); Wang et al. (2025b), serving as foundational reasoning engines for information retrieval Yang et al. (2025a), task automation agents He et al. (2025); Liu et al. (2025b); Wang et al. (2025a), and scientific research Rosen et al. (2025); Shmatko et al. (2025).”
OS-Themis: A Scalable Critic Framework for Generalist GUI Rewards
Li, Z., Wu, Z., Zhao, Y., Yang, B., Xie, J., Liu, Z., Liu, Z., Jin, K., Liang, J., Li, Z., et al. (2026) · arXiv · doi:10.48550/arxiv.2603.19191
“A dominant paradigm involves native agents (Wu et al., 2024b; Qin et al., 2025; Liu et al., 2025; Xu et al., 2024; Wang et al., 2025d) that integrate planning and grounding in a single-agent architecture, directly translating pixel-level observations into executable actions.”
InfluentialSelf-citationOS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agent
Yang, B., Jin, K., Wu, Z., Liu, Z., Sun, Q., Li, Z., Xie, J., Liu, Z., Xu, F., Cheng, K., et al. (2026) · arXiv · doi:10.48550/arxiv.2601.07779
Self-citationPointerBench: A Diagnostic Benchmark for Fine-Grained GUI Grounding
Sacco, V., Pandey, S., Jercher, A. F., et al. (2026) · doi:10.48550/arxiv.2610.31274
“Alongside these benchmarks, specialized GUI agents [Qin et al., 2025, Wang et al., 2025, Liu et al., 2026b, Zhou et al., 2025] and grounding models [Gou et al., 2025, Gu et al., 2025, Venus Team, 2026b,a, Chen et al., 2026] have substantially improved localization on conventional controls.”
CUA-Recovery: Benchmarking Error Recovery in Long-Horizon Computer-Use Agents
Hu, X., Li, H.-M., Wang, Y., et al. (2026) · doi:10.48550/arxiv.2610.27645
Self-citationScaling in Games: Continued Pre-Training For Embodied Agents In Diverse Virtual Worlds
Zhang, K., Chen, Y.-K., Yang, Z.-H., et al. (2026) · doi:10.48550/arxiv.2610.28698
OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents
Yang, B., Jin, K., Ding, Z., et al. (2026) · doi:10.48550/arxiv.2610.22234
Self-citationOpenGCUA: Toward a Fully Open Stack for Generalist Computer Use
Zhou, H.-Z., Li, L.-F., Kong, Q.-Y., et al. (2026) · doi:10.48550/arxiv.2610.22200
Self-citationDon't Retrain, Remix: Adaptation of Web Agents using Mixture Hypernetworks
Ishmam, M. F., Dinh, M. P., & Marino, K. (2026) · doi:10.48550/arxiv.2610.22539
“…Marino, 2026), a containerized web benchmark with three domains (Wiki, News, Shop), each rendered in six versions, and (ii) WebArena-Lite-v2 (WAL) (Liu et al., 2026), an updated version of WebArena-Lite (Liu et al., 2024), itself a curated subset of WebArena (Zhou et al., 2024), with five domains…”
GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning
Xie, Q.-S., Tian, J.-H., Tang, J.-C., et al. (2026) · doi:10.48550/arxiv.2610.19100
“GroundCUA (Feizi et al., 2026) and ScaleCUA (Liu et al., 2026b) release their data, but models trained on them are suboptimal due to limited diversity/accuracy.”
Self-citationDeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents
Gurbuz, A., Nassar, A. S., Hong, S.-J., et al. (2026) · doi:10.48550/arxiv.2610.02320
“Automated pipelines expand interface coverage (Cheng et al., 2024; Wu et al., 2025; Liu et al., 2026b), while UGround synthesizes referring expressions from webpage structure and visual content (Gou et al., 2025).”
One Rollout Is All You Get: Fully Test-Time Adaptation for GUI Agents
Wang, Z.-Q., Gu, L., Chi, Z., et al. (2026) · doi:10.48550/arxiv.2609.34321
“A GUI agent that books flights, files issues, or manages a calendar on a user’s behalf (Qin et al., 2025; Liu et al., 2025; Bai et al., 2025) ships with fixed weights, and from then on everything it experiences is discarded.”
Self-citationProbe to Act: Elevating Browser-Use Agent via Active Visual Probing
Li, K.-L., Wang, H., Hu, C., et al. (2026) · doi:10.48550/arxiv.2609.33646
On the Behavioral Traits of LLM Agents
Zhao, H.-K., Gao, J., Xiao, Y., et al. (2026) · doi:10.48550/arxiv.2609.32776
“AI agents, by contrast, produce massive, complete, and replayable trajectories recording how they think, reason, call tools, evaluate their results, and reflect on their outcomes (Liu et al., 2026; Wang et al., 2025c).”
Self-citationMintAct: A Unified Visual Agent for Digital Environments
Gao, M.-F., Tian, R., Gang, H.-M., et al. (2026) · doi:10.48550/arxiv.2609.22083
“For grounding , we report MMBench-GUI (Wang et al., 2025), ScreenSpot-v2 (Wu et al., 2025), UI-Vision (Nayak et al., 2025), and OSWorld-G (Xie et al., 2026).”
Beyond Binary: Reframing GUI Critique as Continuous Semantic Alignment
Sun, Y.-C., Fu, P., Zhang, S.-J., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2605.14311
- Authors
- Liu, Z., Xie, J., Ding, Z., Li, Z., Yang, B., Wu, Z., Wang, X., Sun, Q., Liu, S., Wang, W., Ye, S., Li, Q., Dong, X., Yu, Y., Lu, C., Mo, Y., Yan, Y., Tian, Z., Zhang, X., Huang, Y., Liu, Y., Su, W., Luo, G., Yue, X., Qi, B., Chen, K., Zhou, B., Qiao, Y., Chen, Q., & Wang, W.
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2509.15221
- OpenAlex
- W4414691912
- Semantic Scholar
- f10459002d7da8f070794feabb21624341e8c12e
- Cited by
- 0
- References
- 0
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- computer-use agents, vision-language models, open-source dataset, operating systems, WebArena
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
