PreprintCited by 21Robotic Process Automation ApplicationsBusiness Process Modeling and AnalysisArtificial Intelligence Applications

The DOI matches its DataCite record; 29 of the 29 references it cites were found in a registry or an index.

Automating the Enterprise with Foundation Models

Open access

Abstract

Automating enterprise workflows could unlock $4 trillion/year in productivity gains. Despite being of interest to the data management community for decades, the ultimate vision of end-to-end workflow automation has remained elusive. Current solutions rely on process mining and robotic process automation (RPA), in which a bot is hard-coded to follow a set of predefined rules for completing a workflow. Through case studies of a hospital and large B2B enterprise, we find that the adoption of RPA has been inhibited by high set-up costs (12-18 months), unreliable execution (60% initial accuracy), and burdensome maintenance (requiring multiple FTEs). Multimodal foundation models (FMs) such as GPT-4 offer a promising new approach for end-to-end workflow automation given their generalized reasoning and planning abilities. To study these capabilities we propose ECLAIR, a system to automate enterprise workflows with minimal human supervision. We conduct initial experiments showing that multimodal FMs can address the limitations of traditional RPA with (1) near-human-level understanding of workflows (93% accuracy on a workflow understanding task) and (2) instant set-up with minimal technical barrier (based solely on a natural language description of a workflow, ECLAIR achieves end-to-end completion rates of 40%). We identify human-AI collaboration, validation, and self-improvement as open challenges, and suggest ways they can be solved with data management techniques. Code is available at: https://github.com/HazyResearch/eclair-agents

Overview

Integrity signals

Registry

DataCite · 10.48550/arxiv.2405.03710

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Flagged first, then by citations

Show all 29 references

Cited by

Sorted by citations

See all 21

Metadata

Authors
Wornow, M., Narayan, A., Opsahl-Ong, K., McIntyre, Q., Shah, N. H., & Re, C.
Affiliations
Stanford University (US)
Venue
arXiv
Publisher
arXiv
Published
2024
Volume
17
Issue
11
Pages
2805-2812
ISSN
2150-8097 (ISSN-L)
OpenAlex
W4402043034
Cited by
15
References
29
Citations by year
2026: 6 · 2025: 8 · 2024: 1
FWCI
3.07
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the VLDB Endowment (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Science Foundation (1763315, 1563078, 1937301)
  • Accenture
  • VMware
  • National Institutes of Health (N000141712266)
  • Office of Naval Research (N000141712266)
  • National Institute of Biomedical Imaging and Bioengineering (U54EB020405)
  • U.S. Army Combat Capabilities Development Command
Topics
  • Social Sciences › Business, Management and Accounting › Management Information Systems › Robotic Process Automation Applications
  • Social Sciences › Business, Management and Accounting › Management Information Systems › Business Process Modeling and Analysis
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
Keywords
multimodal foundation models, GPT-4, robotic process automation, process mining, ECLAIRs, human-AI collaboration, workflow validation, self-improving AI

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review