Haptic simulation for robot-assisted dressing
Open accessAbstract
There is a considerable need for assistive dressing among people with disabilities, and robots have the potential to fulfill this need. However, training such a robot would require extensive trials in order to learn the skills of assistive dressing. Such training would be time-consuming and require considerable effort to recruit participants and conduct trials. In addition, for some cases that might cause injury to the person being dressed, it is impractical and unethical to perform such trials. In this work, we focus on a representative dressing task of pulling the sleeve of a hospital gown onto a person's arm. We present a system that learns a haptic classifier for the outcome of the task given few (2-3) real-world trials with one person. Our system first optimizes the parameters of a physics simulator using real-world data. Using the optimized simulator, the system then simulates more haptic sensory data with noise models that account for randomness in the experiment. We then train hidden Markov Models (HMMs) on the simulated haptic data. The trained HMMs can then be used to classify and predict the outcome of the assistive dressing task based on haptic signals measured by a real robot's end effector. This system achieves 92.83% accuracy in classifying the outcome of the robot-assisted dressing task with people not included in simulation optimization. We compare our classifiers to those trained on real-world data. We show that the classifiers from our system can categorize the dressing task outcomes more accurately than classifiers trained on ten times more real data.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The system needs to detect success and different error states.
“In addition, the system needs to detect success and different error states [298,301,309,315,316,317].”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [317]
Simulation becomes an ideal place for developing and testing dressing approaches.
“Hence, simulation becomes an ideal place for developing and testing dressing approaches [31,55,317].”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [317]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
End-to-end training of deep visuomotor policies
Levine, S., Finn, C., Darrell, T., & Abbeel, P. (2016) · Journal of Machine Learning Research · Cited by 2,192 · see citing works
The CMA Evolution Strategy: A TutorialPreprint
Hansen, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.00772 · Cited by 1,121 · see citing works
Graphical modeling and animation of ductile fracture
O’Brien, J. F. (2002) · doi:10.1145/2931127.2931215 · Cited by 426 · see citing works
Adaptive anisotropic remeshing for cloth simulation
Narain, R., Samii, A., & O’Brien, J. F. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366171 · Cited by 356 · see citing works
Graphical modeling and animation of brittle fracture
O’Brien, J. F., & Hodgins, J. K. (1999) · ACM SIGGRAPH Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH) · doi:10.1145/311535.311550 · Cited by 330 · see citing works
Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning
Wu, J., Yildirim, I., Lim, J. J., Freeman, W. T., & Tenenbaum, J. B. (2016) · Cited by 264 · see citing works
On-line trajectory clustering for anomalous events detection
Piciarelli, C., & Foresti, G. L. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.02.004 · Cited by 244 · see citing works
Empagliflozin for Type 2 Diabetes Mellitus: An Overview of Phase 3 Clinical Trials
Levine, M. J. (2016) · Current Diabetes Reviews · doi:10.2174/1573399812666160613113556 · Cited by 235 · see citing works
Skill learning and task outcome prediction for manipulation
Pástor, P., Kalakrishnan, M., Chitta, S., Theodorou, E. A., & Stefan Schaal, A. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980200 · Cited by 204 · see citing works
Identifying the Potential for Robotics to Assist Older Adults in Different Living Environments
Mitzner, T. L., Chen, T. L. B., Kemp, C. C., & Rogers, W. A. (2013) · International Journal of Social Robotics · doi:10.1007/s12369-013-0218-7 · Cited by 159 · see citing works
Self-citationBringing clothing into desired configurations with limited perception
Cusumano-Towner, M., Singh, A., Miller, S., O’Brien, J. F., & Abbeel, P. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980327 · Cited by 144 · see citing works
Reinforcement learning of clothing assistance with a dual-arm robot
Tamei, T., Matsubara, T., Rai, A., & Shibata, T. (2011) · 2011 11th IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/humanoids.2011.6100915 · Cited by 103 · see citing works
Dexterous manipulation using both palm and fingers
Bai, Y., & Liu, C. K. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907059 · Cited by 99 · see citing works
Self-citationMultimodal execution monitoring for anomaly detection during robot manipulation
Park, D., Erickson, Z., Bhattacharjee, T., & Kemp, C. C. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487160 · Cited by 90 · see citing works
Self-citationFailure detection in assembly: Force signature analysis
Rodriguez, A., Bourne, D., Mason, M. T., Rossano, G. F., & Wang, J. (2010) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/coase.2010.5584452 · Cited by 82 · see citing works
Iterative path optimisation for personalised dressing assistance using vision and force information
Gao, Y., Chang, H. J., & Demiris, Y. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759647 · Cited by 78 · see citing works
User modelling for personalised dressing assistance by humanoid robots
Gao, Y., Chang, H. J., & Demiris, Y. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353617 · Cited by 71 · see citing works
Personalized Assistance for Dressing Users
Klee, S. D., Ferreira, B. Q., Silva, R., Costeira, J. P., Melo, F. S., & Veloso, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25554-5_36 · Cited by 51 · see citing works
Data-driven haptic perception for robot-assisted dressing
Kapusta, A. S., Yu, W., Bhattacharjee, T., Liu, C. K., Turk, G., & Kemp, C. C. (2016) · IEEE RO-MAN · doi:10.1109/roman.2016.7745158 · Cited by 47 · see citing works
Self-citationSimulation-based design of dynamic controllers for humanoid balancing
Tan, J., Xie, Z., Boots, B., & Liu, C. K. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759424 · Cited by 43 · see citing works
Self-citationBottom dressing by a life-sized humanoid robot provided failure detection and recovery functions
Yamazaki, K., Oya, R., Nagahama, K., Okada, K., & Inaba, M. (2014) · 2014 IEEE/SICE International Symposium on System Integration · doi:10.1109/sii.2014.7028101 · Cited by 42 · see citing works
Multiple contact planning for minimizing damage of humanoid falls
Ha, S., & Liu, C. K. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353756 · Cited by 41 · see citing works
Self-citationImproving robot manipulation with data-driven object-centric models of everyday forces
Jain, A., & Kemp, C. C. (2013) · Autonomous Robots · doi:10.1007/s10514-013-9344-1 · Cited by 26 · see citing works
Self-citationCloth dynamics modeling in latent spaces and its application to robotic clothing assistance
Koganti, N., Ngeo, J. G., Tomoya, T., Ikeda, K., & Shibata, T. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353860 · Cited by 23 · see citing works
Koganti, N., Tamei, T., Matsubara, T., & Shibata, T. (2013) · Proceedings of Conference on Advances In Robotics · doi:10.1145/2506095.2506146 · Cited by 21 · see citing works
An on-line algorithm for anomaly detection in trajectory data
Rosen, O., & Medvedev, A. V. (2012) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2012.6315346 · Cited by 13 · see citing works
Learning action failure models from interactive physics-based simulations
Haidu, A., Kohlsdorf, D., & Beetz, M. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7354136 · Cited by 13 · see citing works
Learning task outcome prediction for robot control from interactive environments
Haidu, A., Kohlsdorf, D., & Beetz, M. (2014) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2014.6943183 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Modeling, learning, perception, and control methods for deformable object manipulation
Yin, H., Varava, A., & Kragic, D. (2021) · Science Robotics · doi:10.1126/scirobotics.abd8803 · Cited by 299 · see citing works
Probabilistic real-time user posture tracking for personalized robot-assisted dressing
Zhang, F., Cully, A., & Demiris, Y. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2904461 · Cited by 70 · see citing works
What does the person feel? Learning to infer applied forces during robot-assisted dressing
Erickson, Z., Clegg, A., Yu, W., Turk, G., Liu, C. K., & Kemp, C. C. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989718 · Cited by 41 · see citing works
Self-citationKadi, H. A., & Terzić, K. (2023) · Sensors · doi:10.3390/s23052389 · Cited by 19 · see citing works
“In addition, the system needs to detect success and different error states [298,301,309,315–317].”
BackgroundLearning to navigate cloth using haptics
Clegg, A., Yu, W., Erickson, Z., Tan, J., Liu, C. K., & Turk, G. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206110 · Cited by 20 · see citing works
Self-citationA Perspective on Open Challenges in Deformable Object Manipulation
McKennaa, R. P., & Oyekan, J. (2026) · arXiv · doi:10.48550/arxiv.2602.22998
“With extensions for handling frictional contact, PhysX has been employed in human dressing tasks, including haptics and force prediction [75], [76], and as a forward dynamics model for planning dressing motion [77].”
- Authors
- Yu, W., Kapusta, A., Tan, J., Kemp, C. C., Turk, G., & Liu, C. K.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- 2017 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2017-05
- Pages
- 6044-6051
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2738522242
- Cited by
- 41
- References
- 28
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 2 · 2023: 9 · 2022: 9 · 2021: 2 · 2020: 6 · 2019: 4 · 2018: 4 · 2017: 3
- FWCI
- 7.08
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- SMARTech Repository (Georgia Institute of Technology) (submittedVersion)
- Funders
- National Science Foundation (1514258)
- National Institute on Disability, Independent Living, and Rehabilitation Research (90RE5016–01-00, -01-00)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Engineering › Biomedical Engineering › Prosthetics and Rehabilitation Robotics
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Keywords
- assistive robotics, haptic simulation, hidden Markov models, few-shot learning, noise models, people with disabilities, robot training
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review