CoChat

Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks

Open access
Nasiriany, Soroush, Liu, Huihan, Zhu, Yuke · 2022 · 2022 International Conference on Robotics and Automation (ICRA)

The DOI matches its Crossref record; 78 of the 89 references it cites were found in a registry or an index.

Abstract

Realistic manipulation tasks require a robot to interact with an environment with a prolonged sequence of motor actions. While deep reinforcement learning methods have recently emerged as a promising paradigm for automating manipulation behaviors, they usually fall short in long-horizon tasks due to the exploration burden. This work introduces Manipulation Primitive-augmented reinforcement Learning (MAPLE), a learning framework that augments standard reinforcement learning algorithms with a pre-defined library of behavior primitives. These behavior primitives are robust functional modules specialized in achieving manipulation goals, such as grasping and pushing. To use these heterogeneous primitives, we develop a hierarchical policy that involves the primitives and instantiates their executions with input parameters. We demonstrate that MAPLE out-performs baseline approaches by a significant margin on a suite of simulated manipulation tasks. We also quantify the compositional structure of the learned behaviors and highlight our method's ability to transfer policies to new task variants and to physical hardware. Videos and code are available at https://ut-austin-rpl.github.io/maple

Overview

Integrity signals

Registry

Crossref · 10.1109/icra46639.2022.9812140

Cites

78 of 78 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 78 references

Research works printed but not linked: 5

  1. zhu, 2020, Robosuite: A modular simulation framework and benchmark for robot learning, ArXiv Preprint
  2. yamada, 0, Motion planner augmented reinforcement learning for obstructed environments, CoRL
  3. simeonov, 0, Learning to combine primitive skills: A step towards versatile robotic manipulation, CoRL
  4. sharma, 0, Learning to combine primitive skills: A step towards versatile robotic manipulation, CoRL
  5. neumann, 2014, Learning to combine primitive skills: A step towards versatile robotic manipulation, Frontiers in Computational Neuroscience

Cited by

See all 159

Metadata

Authors
Nasiriany, S., Liu, H., & Zhu, Y.
Affiliations
The University of Texas at Austin (US)
Venue
2022 International Conference on Robotics and Automation (ICRA)
Publisher
IEEE
Published
2022-05-23
Pages
7477-7484
ISSN
1050-4729 (ISSN-L)
OpenAlex
W3204657926
Cited by
91
References
89
Citations by year
2026: 10 · 2025: 30 · 2024: 27 · 2023: 20 · 2022: 4
FWCI
11.20
Type
conference paper
Language
en
Open access
Locations
  • Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
NSF (CNS-1955523)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
Keywords
manipulation tasks, hierarchical reinforcement learning, long-horizon tasks, exploration efficiency, grasping, pushing, policy transfer, robotic manipulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks. https://app.cochat.ai/papers/10.1109/icra46639.2022.9812140
The paper
Nasiriany, S., Liu, H., & Zhu, Y. (2022). Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks. 2022 International Conference on Robotics and Automation (ICRA). https://doi.org/10.1109/icra46639.2022.9812140

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.