A Perspective on Open Challenges in Deformable Object Manipulation

Probably not a substantial claim: may not pass S3 (load-bearing).

Henrich et al.'s integrated segmentation and reconstruction model avoids deformable registration by segmenting regions directly from point cloud data using multiclass occupancy functions.

“The integrated segmentation and reconstruction model avoids the complexities of deformable registration, segmenting regions directly from point cloud data by using multiclass occupancy functions.”

• cites [28]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

DiPac can represent and track various deformable objects such as beans, cloth, and liquids within one framework.

“This particle-based detection method is flexible, allowing DiPac to represent and track various deformable objects such as beans, cloth, and liquids within a single framework.”

• cites [29]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

A common way to represent deformable objects is to use particles.

“A common approach to represent DOs is to use particles [26].”

• cites [26]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

Accurately and efficiently representing a deformable object remains a significant challenge, and solutions are often tailored to specific applications.

“However, accurately and efficiently representing a deformable object (DO) remains a significant challenge, and solutions are often tailored to specific applications.”

May combine two claims.

Nadon et al.'s segmentation method uses multi-view, multi-modal RGB-D data to build a full 3D model and address occlusions and perspective limitations.

“This method primarily relies on multi-view, multi-modal sensory data, integrating RGB-D sensors positioned at various angles to build a full 3D model of the objects within the scene.”

• cites [27]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Henrich et al.'s method requires watertight meshes for occupancy function testing, excluding some datasets and limiting broader applicability.

“Another limitation is the requirement for watertight meshes for the occupancy function testing, which excludes some available datasets and limits its broader applicability.”

• cites [28]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

When trained on synthetic data, Henrich et al.'s segmentation accuracy drops on actual physical objects, showing limited simulation-to-reality generalization.

“When trained on synthetic data, the segmentation accuracy drops when applied to actual physical objects, with the model struggling to generalize fully from simulation to reality.”

• cites [28]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Combining multi-camera setups, active vision, and tactile sensing in multimodal perception systems addresses occlusion and improves adaptability in unstructured environments.

“It highlights advancements in multimodal perception systems, including the integration of multi-camera setups, active vision, and tactile sensing, which collectively address occlusion and improve adaptability in unstructured environments.”

• cites [27]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [39]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [40]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• AssumptionRests on an assumption: Some occlusions remain intractable with vision alone, especially when visibility of certain object regions is entirely obstructed.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

DiPac merges multiple views into a unified 3D point cloud and fills occluded areas with uniformly sampled particles to model the object's unseen interior.

“To improve detection accuracy, it merges multiple views into a unified 3D point cloud, constructing a complete representation and filling in occluded areas with uniformly sampled particles to model the object's unseen interior.”

• cites [29]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Chen et al.'s DiPac uses particle-based modeling from RGB-D images to detect deformable objects and estimate their state.

“Their method DiPac for deformable object detection and state estimation uses particle-based modeling from RGBD images.”

• cites [29]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

A multi-view setup demands substantial processing power and precise sensor calibration, which complicates real-time application.

“While effective, the multi-view setup demands substantial processing power and precise sensor calibration, which can complicate its application in real-time, posing issues for real-world scenarios.”

• cites [27]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Studies in surgical robotics have shown significant progress in tracking soft tissues during medical procedures.

“DO tracking is also a focus in surgical robotics, where studies have shown significant progress in tracking soft tissues during medical procedures [32], [33].”

• cites [32]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [33]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The review by Yin et al. includes both analytical and data-driven approaches and offers a more comprehensive perspective.

“In contrast, the review by Yin et al. [12] offers a more comprehensive perspective by including both analytical and data-driven approaches.”

• cites [12]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

Weng et al. identify a Structure of Interest that dynamically informs camera viewpoint selection as the object's configuration evolves.

“Core to this approach is the identification of key structural features, termed the Structure of Interest (SOI), which dynamically inform the camera's viewpoint selection as the object's configuration evolves.”

• cites [39]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The BioTac tactile sensor captures a range of sensory information similar to that of the human fingertip.

“The BioTac tactile sensor is a notable tool capable of capturing a range of sensory information similar to that of the human fingertip [40].”

• cites [40]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Tactile sensing is rarely the sole method used for manipulation in visually occluded conditions.

“Although tactile sensing is crucial for manipulation in visually occluded conditions, it is rarely the sole method used.”

May combine two claims.

Weng et al.'s method tracks deformable objects within an interactive perception framework using an active camera and a Dynamic Active Vision Space, integrating a dual-arm setup with a coordinated active camera to handle occlusions and high degrees of freedom.

“This paper introduces an advanced methodology for tracking deformable objects within an interactive perception framework, utilizing an active camera and a specialized Dynamic Active Vision Space (DAVS).”

• cites [39]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Surgical tracking approaches are usually specific to the surgical domain and may not work for other objects such as ropes or fabrics.

“However, these approaches are usually specific to the surgical domain and may not work for other objects, like ropes or fabrics.”

• cites [32]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [33]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Weng et al.'s interactive perception with DAVS allows the camera viewpoint to adjust to changing occlusions, coordinated with a dual-arm setup to ensure robust tracking and scene understanding in real time.

“Weng et al. propose an interactive perception approach utilizing a Dynamic Active Vision Space (DAVS), allowing the camera's viewpoint to adjust in response to changing occlusions.The active camera is coordinated with a dual-arm setup, which collectively combats occlusions as they develop, thus ensuring robust tracking and scene understanding in real-time [39].”

• cites [39]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

This active perception strategy enhances adaptability to variable object shapes and unseen dynamics and optimizes computational resources, providing a scalable solution for interactive perception in deformable object manipulation.

“This active perception strategy not only enhances the system's adaptability to variable object shapes and unseen dynamics but also optimizes computational resources, presenting a scalable solution for interactive perception in deformable object manipulation.”

• cites [39]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Leveraging multiple RGB-D sensors from various angles enables comprehensive 3D modeling, mitigating occlusion and providing a holistic representation of the scene.

“Leveraging multiple RGB-D sensors positioned from various angles enables comprehensive 3D modeling, thus mitigating occlusion and providing a holistic representation of the scene.”

• cites [27]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Vision-based tactile sensors translate tactile information into visual data by capturing surface deformations with a camera and offer high spatial resolution.

“Vision-based tactile sensors represent another type of tactile technology, translating tactile information into visual data by capturing surface deformations with a camera.These sensors, offering high spatial resolution, have been effectively used in various robotic manipulation tasks.”

May combine two claims.

These physics-simulation tracking methods depend heavily on accurate physical models of deformable objects and environmental geometry, which are challenging to obtain in unstructured environments.

“Yet, these methods depend heavily on accurate physical models of DOs and environmental geometry, which are challenging to obtain in unstructured environments.”

• cites [36]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [37]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• AssumptionRests on an assumption: Accurate physical models of deformable objects and environmental geometry are challenging to obtain in unstructured environments.

May combine two claims.

Integrating DAVS with reinforcement learning enables efficient perception and manipulation, with the active camera repositioning based on SOI adjustments to achieve robust real-time tracking.

“The integration of DAVS with reinforcement learning further enables efficient perception and manipulation, as the active camera dynamically repositions based on SOI adjustments, thus achieving robust, real-time tracking.”

• cites [39]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Recent approaches use Gaussian Mixture Modeling and Coherent Point Drift to generate inputs for physics simulations.

“Recent approaches [36], [37] have further used Gaussian Mixture Modeling (GMM) and Coherent Point Drift (CPD [38]) to generate inputs for physics simulations.”

• cites [36]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [37]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [38]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Sundaram et al. created a tactile glove with 548 sensors connected by conductive wires in a piezoresistive film, using deep convolutional neural networks to analyze pressure signals for object recognition, weight estimation, and tactile pattern exploration.

“In another development, Sundaram et al. [42] created a tactile glove equipped with 548 sensors connected by conductive wires in a piezoresistive film.This glove uses deep convolutional neural networks to analyze pressure signals for tasks like object recognition, weight estimation, and tactile pattern exploration.”

• cites [42]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Whole-scene identification before planning and control is fundamental for high-level workspace understanding, including object positions, obstacles, and environmental features, and is critical for guiding planning and manipulation.

“Additionally, whole-scene identification before planning and control is fundamental for generating a high-level understanding of the workspace, which includes mapping out object positions, obstacles, and other environmental features.This comprehensive scene awareness is critical to guiding subsequent high-level planning and effective manipulation.”

• cites [27]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• AssumptionRests on an assumption: Whole-scene identification before planning and control is fundamental for generating a high-level understanding of the workspace.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Tactile sensing provides detailed local information such as texture and friction, which is useful when visibility is limited, whereas vision primarily captures global features like shape and color.

“While vision primarily captures global features like shape and color, tactile sensing provides detailed, local information, such as texture and friction, which is especially useful in situations where visibility is limited.”

Probably not a substantial claim: may not pass S3 (load-bearing).

She et al. developed a GelSight-based technique to estimate the position and friction of a cable held by a robot.

“One application is cable or fabric following; for example, She et al. [43] developed a technique to estimate the position and friction of a cable held by a robot using GelSight-based tactile sensing.”

• cites [43]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Zhang et al. extended the tactile glove to various tasks, combining predictive and contrastive learning to estimate the 3D coordinates of both hand and object from touch data alone.

“Building on the tactile glove from [42], Zhang et al. [45] extended its use to a variety of tasks involving different objects.Their model combines predictive and contrastive learning techniques to estimate the 3D coordinates of both the hand and the object based solely on touch data.”

• cites [42]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [45]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Zheng et al. proposed a BioTac-based approach to analyze tactile changes during page flipping, allowing robots to learn a logical page-turning sequence.

“Zheng et al. [10] proposed a BioTac-based approach to analyze tactile changes during page flipping, allowing robots to learn a logical page-turning sequence.”

• cites [10]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

BioTac's output requires complex signal processing and data integration, leading to higher computational demands and potential delays.

“However, BioTac's output requires complex signal processing and data integration, leading to higher computational demands and potential delays.”

• cites [40]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Hellman et al. created a real-time BioTac method for tactile perception and decision-making in tasks such as sealing a bag by tracking contours.

“Hellman et al. [44] created a real-time method using BioTac for tactile perception and decision-making in tasks like sealing a bag by tracking contours.”

• cites [44]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

In robotics, physics simulation is often used to track partially occluded deformable objects.

“In robotics, physics simulation is often employed to track partially occluded DOs, with several studies adopting this method [34], [35].”

• cites [34]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [35]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In computer graphics, precise offline simulations are often acceptable, allowing careful parameter tuning; in robotics, robustness and computational efficiency are critical for real-time tracking, interactive control, or learning in simulated environments.

“For instance, in computer graphics applications like character or scene animation, precise offline simulations are often acceptable, allowing for careful parameter tuning.In robotics, however, robustness and computational efficiency are critical for real-time tracking, interactive control, or learning in simulated environments.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Mass-spring systems represent deformable materials as a network of masses connected by spring edges, with internal force calculated by a spring-damping relationship along the displacement direction.

“Mass-spring systems (MSSs) represent deformable materials as a network, where each vertex is assigned a mass, and vertices are connected by spring edges.The internal force between two vertices, 𝑖 and 𝑗, is calculated based on a spring-damping relationship along the direction of displacement.”

• cites [54]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Simulation and modeling of deformable object dynamics commonly rely on geometric representations using particles or meshes.

“The simulation and modeling of deformable object dynamics commonly rely on geometric representations using particles or meshes [54] [55].”

• cites [54]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [55]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Stable simulations often require small time steps, with the step size depending on the specific application.

“However, stable simulations often require small time steps, where the step size depends on the specific application.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

PBD offers fast, stable simulations with full control, enabling easy incorporation of constraints and boundary conditions.

“PBD offers fast, stable simulations with full control, enabling the easy incorporation of constraints and boundary conditions.”

Probably not a substantial claim: may not pass S3 (load-bearing).

PBD allows a broad range of relations and boundary conditions rather than merely Hooke's law.

“however note rather than merely using hook's law PBD allows for the use of a broad range of relations and boudary conditions.”

Classified as probably not a substantial claim.

Properly modeling internal forces is crucial for simulating deformable objects.

“Properly modeling these internal forces is crucial for simulating deformable objects.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Continuum mechanics provides a more accurate physical model for describing material deformation in a continuous domain.

“Continuum mechanics provides a more accurate physical model for describing material deformation in a continuous domain.”

Probably not a substantial claim: may not pass S3 (load-bearing).

PBD elastic properties depend on constraint parameters, the strictness of enforcement, and the number of projection iterations.

“The elastic properties depend on the constraint parameters 𝜃, the strictness of enforcement (via 𝑘 𝑗 ), and the number of projection iterations.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Implicit integration, such as the backward Euler method, is a more robust approach than explicit integration for stable simulation.

“A more robust approach is implicit integration, such as the backward Euler method.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Position-based dynamics is a meshless approach that models materials as a discrete system of particles.

“Position-based dynamics (PBD) [54] is a meshless approach that models materials as a discrete system of particles.”

• cites [54]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Numerous constraints have been proposed to simulate effects such as volume conservation, frictional contact, or strain under continuum mechanics.

“Numerous constraints have been proposed to simulate various effects, such as volume conservation, frictional contact, or strain under continuum mechanics [55].”

• cites [55]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The Hookean material assumption is typically restricted to modeling small deformations around the rest shape.

“The Hookean material assumption is typically restricted to modeling small deformations around the rest shape.”

Probably not a substantial claim: may not pass S3 (load-bearing).

A solution using constraint compliance has been suggested in more recent extensions.

“A solution using constraint compliance has been suggested in more recent extensions [59].”

• cites [59]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Even increasing mesh resolution does not ensure convergence to the correct behavior, because network topology and spring parameters also play a role.

“Even increasing mesh resolution doesn't ensure convergence to the correct behavior, as the network's topology and spring parameters also play a role [54].”

• cites [54]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

PBD uses an implicit integration scheme in which internal forces are derived from holonomic constraints, including temporary or unilateral constraints.

“The simulation uses an implicit integration scheme where internal forces are derived from holonomic constraints, including temporary or unilateral constraints.”

• cites [54]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Mass-spring systems have been used to simulate various deformable objects, such as modeling a rope as a chain or a cloth as a two-dimensional grid.

“They have been used to simulate various deformable objects, like modeling a rope as a chain [56] or a cloth as a two-dimensional (2D) grid [57].”

• cites [56]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [57]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Similar to mass-spring systems, implicit integration in FEM requires solving the internal force term through linearization at each time step, which can be complex when using a general constitutive model.

“Similar to mass-spring systems (MSSs), implicit integration requires solving the internal force term through linearization at each time step, which can be complex in FEM when using a general constitutive model.”

Probably not a substantial claim: may not pass S3 (load-bearing).

PBD solves its optimization approximately by iteratively projecting the candidate position onto constraint manifolds, often using a Gauss-Seidel method.

“PBD solves this optimization approximately by iteratively projecting the candidate position x𝑡+1 𝑖 onto constraint manifolds, often using a Gauss-Seidel method.”

• cites [55]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The advantage of implicit integration lies in its stability because subsequent states remain closer to the dynamic constraints.

“The advantage of implicit integration lies in its stability since the subsequent states remain closer to the dynamic constraints.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

PBD typically relies on impulse updates, producing visually plausible but not always physically accurate simulations.

“Still, PBD typically relies on impulse updates, producing visually plausible but not always physically accurate simulations.”

Probably not a substantial claim: may not pass S3 (load-bearing).

More advanced constitutive models include energy terms that penalize deformation, leading to nonlinear hyperelastic models such as the Neo-Hookean model.

“More advanced constitutive models include energy terms that penalize deformation, leading to nonlinear hyperelastic models like the Neo-Hookean model [61].”

• cites [61]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Spring parameters lack a direct correlation to material properties, requiring significant tuning to achieve the desired dynamic behavior.

“Moreover, the spring parameters lack a direct correlation to material properties, requiring significant tuning to achieve the desired dynamic behavior.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

Accuracy is paramount in safety-critical fields such as medical simulations.

“Additionally, accuracy becomes paramount in safety-critical fields such as medical simulations.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Mass-spring systems are straightforward to implement and offer fast simulation speeds.

“MSSs are straightforward to implement and offer fast simulation speeds.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The original form of the continuum momentum equation can be solved effectively only for simple, small-scale problems such as a one-dimensional string.

“The original form of the equation can be solved effectively only for simple, small-scale problems, such as a 1D string.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

PBD is versatile and capable of modeling plastic deformation, fluids, and rigid-body dynamics.

“The method is also versatile, capable of modeling plastic deformation, fluids, and rigid-body dynamics [58].”

• cites [58]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

A key drawback of PBD is that it does not simulate forces accurately, and system stiffness is tied to the time-step size.

“A key drawback of PBD is that it does not simulate forces accurately, and system stiffness is tied to the time-step size.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Unlike mass-spring systems, PBD directly updates position before calculating velocity.

“Unlike mass-spring systems (MSSs), PBD directly updates the position 𝑥 𝑡+1 𝑖 before calculating the velocity using 𝑣 𝑡+1 𝑖 = (𝑥 𝑡+1 𝑖 -𝑥 𝑡 𝑖 )∕Δ𝑡.”

May combine two claims.

Mass-spring systems are most effective for small deformations and struggle to accurately capture complex elastic behaviors.

“However, a key limitation is that MSSs are most effective for small deformations and struggle with accurately capturing complex elastic behaviors.”

• cites [54]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

For more complex cases, the finite element method is the standard computational approach for solving continuum mechanics problems.

“For more complex cases, the finite element method (FEM) is the standard computational approach for solving continuum mechanics problems.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Active cameras with dynamically adjusting viewpoints are required to track deformable objects as they change shape.

“• Active cameras, with dynamically adjusting viewpoints, are necessary to track deformable objects as they change shape.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Dual-arm active camera systems effectively reduce occlusions through coordinated control.

“• Dual-arm active camera systems effectively combat occlusions through coordinated control.”

Probably not a substantial claim: may not pass S4 (based).

Adding expert demonstrations to these frameworks can handle the complex task specifications specific to DOM.

“Incorporating expert demonstrations into these frameworks can accelerate convergence and address the complex task specifications unique to DOM.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Isaac Gym executes continuous control tasks on the GPU, giving very fast simulation without CPU physics.

“By leveraging NVIDIA's high-performance PhysX engine, Isaac Gym allows continuous control tasks to run directly on the GPU, achieving exceptional simulation speeds without the need for CPU-based physics calculations.”

• cites [78]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

PhysX uses PBD for cloth, enabling rigid and flexible object simulation in one simulator.

“It incorporates cloth modeling based on Position-Based Dynamics (PBD) [73], allowing the simulation of both rigid and flexible objects without requiring multiple simulators, as seen in [74].”

• cites [73]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Physically-informed RL agents trained in differentiable simulations show large improvements in learning speed, low-level control accuracy, and generalization.

“Evidently physically-informed reinforcement learning, that is, Reinforcement Learning agents trained within differentiable simulations show orders of magnitude improved performance on several metrics, including; learning efficiency, precision in low-level control and generalization.”

• AssumptionRests on an assumption: Model-free RL suffers from sample inefficiency, particularly with infinite-dimensional deformable objects.
• AssumptionRests on an assumption: IL needs extensive demonstration data and may not generalize beyond learned instances.

May combine two claims.

Using expert demonstrations makes convergence much faster and learning more efficient.

“Moreover, the use of expert demonstrations within RL frameworks further accelerates convergence and enhances learning efficiency.”

• AssumptionRests on an assumption: IL needs extensive demonstration data and may not generalize beyond learned instances.

May combine two claims.

For Pour-Water, SHAC scored 0.91 versus PPO's 0.32, showing better generalization to fluid manipulation.

“In Pour-Water, SHAC's reward reached 0.91, compared to PPO's 0.32, demonstrating superior generalization to fluid manipulation tasks.”

• cites [108]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Zargarbashi and colleagues recently performed a comparable study outside deformable object manipulation but within robotics simulation.

“Zargarbashi et al. recently did something similar, albeit outside DOM, but within Robotics simulation [124].”

• cites [124]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

DefGraspSim generates more than a million grasp measurements, which can train gradient-based learning models.

“Although DefGraspSim itself is not gradient-based, it produces extensive data-over a million grasp measurements-providing a foundation for training gradient-based learning models.”

• cites [79]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based).

Combining multiple camera views, active vision, and tactile sensing has the potential to substantially reduce occlusions in unstructured settings.

“The combination of multi-camera perspectives, active vision systems, and tactile perception shows potential for significantly reducing occlusions in unstructured environments.”

May combine two claims.

SOFA maintains efficient computation on moderate hardware while retaining high fidelity.

“Importantly, despite its high fidelity, SOFA is engineered to maintain efficient computation even on moderate hardware.”

• cites [70]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Bullet simulates deformable bodies and their interactions using PBD.

“It also uses PBD to simulate deformable bodies and their interactions with other entities.”

• cites [85]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Isaac Gym can run thousands of environments in parallel, accelerating training by orders of magnitude versus traditional methods.

“This architecture enables highly parallelized simulations where thousands of environments run simultaneously, thus speeding up training by orders of magnitude compared to traditional methods.”

• cites [78]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

DefGraspSim is a physics-based simulator for robotic grasping of 3D deformable objects, built on Isaac Gym with GPU-accelerated FEM.

“Huang et al. introduces DefGraspSim [79], a physics-based simulation tool for robotic grasping of 3D deformable objects, utilizing the Isaac Gym environment with a GPU-accelerated finite element method (FEM).”

• cites [79]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

NSE adapts learned skills to new instances by encoding spatial information at category level, enabling optimal grasping point determination without retraining.

“NSE then adapts these learned skills to new instances by encoding spatial information at the category level, enabling the system to determine the optimal grasping point for different objects without requiring retraining.”

• cites [112]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable).

This makes graph neural networks a strong unifying framework for combining heterogeneous information across tasks.

“This makes graph neural networks a compelling unifying framework for integrating heterogeneous information across tasks.”

• AssumptionRests on an assumption: The branching structure of graph neural networks mirrors the networks of the human brain.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Physically informed RL yields orders of magnitude faster convergence and more efficient learning.

“• Physically informed RL enables orders of magnitude faster convergence and more efficient learning.”

Classified as probably not a substantial claim.

Advancements in generative networks have demonstrated effectiveness across text, images, and 3-D models.

“Advancements in generative networks have demonstrated effectiveness across text, images, 3-D models [123] according to the survey by Shi et al.”

• cites [123]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based).

Adding expert demonstrations to these frameworks can speed up convergence.

“Incorporating expert demonstrations into these frameworks can accelerate convergence and address the complex task specifications unique to DOM.”

Probably not a substantial claim: may not pass S4 (based).

Differentiable simulations enhance efficiency, precision, and generalization in physically informed reinforcement learning.

“Physically informed reinforcement learning (RL) has emerged as a critical tool, with differentiable simulations improving efficiency, precision, and generalization.”

May combine two claims.

For Whip-Rope, APG and SHAC performed near optimally; APG scored 1.00, much better than PPO's 0.34.

“For example, in the Whip-Rope task, APG and SHAC achieved near-optimal performance, with APG reaching a reward of 1.00 (perfect performance), significantly outperforming Proximal Policy Optimization (PPO), which achieved a reward of only 0.34.”

• cites [108]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Expert demonstrations allow long-horizon or complex multi-stage tasks.

“• Expert demonstrations enable long-horizon or complex multi-stage tasks.”

• Also stated in: § Manipulation Module · plain

  “• Expert demonstrations enable long-horizon or complex multi-stage tasks.”

Probably not a substantial claim: may not pass S3 (load-bearing).

MuJoCo's convex soft contact model allows optimization methods to converge faster.

“Featuring a convex soft contact model, MuJoCo enables optimization methods with faster convergence rates [82].”

• cites [82]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

RL guided by physics achieves much faster convergence and more efficient learning.

“Additionally, physically informed RL enables orders of magnitude faster convergence and more efficient learning.”

• AssumptionRests on an assumption: Model-free RL suffers from sample inefficiency, particularly with infinite-dimensional deformable objects.

Probably not a substantial claim: may not pass S3 (load-bearing).

The branching structure of graph neural networks mirrors how conventional programming languages execute algorithms.

“the branching characteristic of these networks directly mimics algorithmic behavior of conventional computer programming languages [125]”

• cites [125]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

DiffSRL uses model-free RL, specifically TD3, known for stability in continuous control.

“DiffSRL uses model-free reinforcement learning (MFRL), specifically the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm, which is known for stability in continuous control tasks.”

• cites [109]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

Task specifications, as sequences of simulation states, are highly promising as a standard data format for RL in DOM.

“In addition, task specifications (sequences of simulation states) have great potential as a standardized data format for RL applications in DOM.”

May combine two claims.

DiffSRL adapts from simulated to real-world environments by augmenting training data with noise and reducing particle density.

“To close the sim2Real gap, DiffSRL [109] adapts from simulated to real-world environments by augmenting training data with noise and reducing particle density, thus preparing the model for real sensor data, which is often sparse or noisy.”

• cites [109]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

NST aligns observed target point cloud into a standardized pose, forming a consistent basis for learning skills across a category.

“NST aligns the observed target point cloud into a predefined, standardized pose (the”

• cites [112]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based).

Simulated expert demonstrations provide a scalable way to define task specifications.

“Simulated expert demonstrations offer a scalable approach to defining task specifications, particularly when combined with generative neural networks which could be able generalize to unseen object-task combinations given enough scale.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Using multiple camera perspectives reduces occlusion problems by capturing comprehensive 3D models.

“• Multiple camera perspectives reduce occlusion issues by capturing comprehensive 3D models.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Tactile perception handles occlusions that vision alone cannot access.

“• Tactile perception addresses occlusions that are inaccessible to vision alone .”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Physically informed RL provides the precise control needed for DOM.

“• Physically informed RL enables precise control needed for DOM.”

May combine two claims.

DaXBench combines RL with differentiable physics and improves control and efficiency over traditional methods.

“Chen et al. introduces DaXBench [108] in which reinforcement learning (RL) is enhanced with differentiable physics, providing a notable improvement in control and efficiency over traditional methods.”

• cites [108]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

Deformable objects' complexity and many degrees of freedom mean precise control needs simulators that capture detailed dynamics.

“Given the vast complexity and high degrees of freedom inherent to deformable objects, achieving precise control and manipulation requires simulators that can accurately capture intricate dynamics.”

• AssumptionRests on an assumption: Deformable materials react to even small forces with nuanced nonlinear behavior that traditional models often cannot replicate.

May combine two claims.

Lv et al. demonstrated successful real-world needle threading using a residual strategy, easing simulation-to-reality transition.

“For instance, Lv et al. [110] demonstrated successful real-world needle threading by employing a residual strategy, showing that this method can significantly ease the transition from simulation to reality.”

• cites [110]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Expert demonstrations yield orders of magnitude faster convergence and more efficient learning.

“• Expert demonstrations enable orders of magnitude faster convergence and more efficient learning.”