The DOI matches its Crossref record; 100 of the 100 references it cites were found in a registry or an index.
Introspective Perception for Long-Term Aerial Telemanipulation With Virtual Reality
Open accessAbstract
This article presents a novel telemanipulation system to advance aerial manipulation in dynamic and unstructured environments. The proposed system features not only a haptic device, but also a virtual reality (VR) interface that provides real-time 3-D displays of the robot’s workspace, as well as a haptic guidance to its remotely located operator. To realize this, multiple sensors, namely, a LiDAR, cameras, and inertial measurement units (IMUs) are utilized. For processing the acquired sensory data, pose estimation pipelines are devised for industrial objects of known and unknown geometries. We further propose an active learning (AL) pipeline in order to increase the sample efficiency of a pipeline component that relies on deep neural networks (DNNs)-based object detection. All of these algorithms jointly address various challenges encountered during the execution of perception tasks in industrial scenarios. In the experiments, exhaustive ablation studies are provided to validate the proposed pipelines. Methodologically, these results commonly suggest how an awareness of the algorithms’ own failures and uncertainty (“introspection”) can be used to tackle the encountered problems. In addition, outdoor experiments are conducted to evaluate the effectiveness of the overall system in enhancing aerial manipulation capabilities. In particular, with flight campaigns over days and nights, from spring to winter, and with different users and locations, we demonstrate more than 70 robust executions of pick-and-place, force application, and peg-in-hole tasks with the DLR cable-suspended aerial manipulator (SAM). As a result, we show the viability of the proposed system in future industrial applications. The project website can be accessed athttps://sites.google.com/view/vr-sam/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Other applications such as document layout detection [14,17], pose estimation [7], and surface defect detection [55] remain under-explored, as well.”
From Ten Years of Active Learning Techniques and Object Detection: A Systematic Review (2023) · cites this paper as [7]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A valid way to overcome these challenges lies in the application of ALtechniques [5-8], which focuses on the acquisition of a large and diverse set of examples, while reducing the time needed by researchers/professionals to screen the data.”
From Ten Years of Active Learning Techniques and Object Detection: A Systematic Review (2023) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Active learning has been successful in applications involving image classification [39,40], segmentation [41], pose estimation [7], and visual tracking [42] while its use in other tasks, such as OD, needs more attention [36].”
From Ten Years of Active Learning Techniques and Object Detection: A Systematic Review (2023) · cites this paper as [7]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 1×
“For this, we train a DNN based object detector (Redmon et al., 2016) using the eye-to-hand camera (mako).”
Method(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“trained with other regularization techniques such as batch normalization (Ioffe and Szegedy, 2015).”
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103 · cited 10×
“…geometrically unknown, we devise a LiDAR based pose estimation pipeline that combines LiDAR Odometry And Mapping (LOAM Zhang and Singh (2017)) with a pose graph, a point cloud registration algorithm (Besl and McKay, 1992), and a Deep Neural Network (DNN) based object detector (Lin et al., 2017).”
InfluentialFocal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858826 · Cited by 9,556
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471 · cited 8×
“We add uniform sampling from pool data (denoted as random) and MC-dropout (Gal and Ghahramani, 2016) as the baseline.”
InfluentialPattern Recognition and Machine Learning
Neal, R. M. (2007) · Technometrics · doi:10.1198/tech.2007.s518 · Cited by 4,571
Efficient variants of the ICP algorithm
Rusinkiewicz, S., & Levoy, M. (2002) · Proceedings Third International Conference on 3-D Digital Imaging and Modeling · doi:10.1109/im.2001.924423 · Cited by 3,945 · cited 11×
“, 2019), point-to-plane ICP (Park et al., 2017; Rusinkiewicz and Levoy, 2001) and the combination with the global registration methods (Zhou et al.”
InfluentialSimple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Lakshminarayanan, B., Pritzel, A., & Blundell, C. (2016) · arXiv · doi:10.48550/arxiv.1612.01474 · Cited by 3,666 · cited 2×
“Deep ensemble (Lakshminarayanan et al., 2017) is another scalable framework with a relaxed assumption on the model.”
BackgroundMultiple view geometry in computer vision
Opower, H. (2002) · Optics and Lasers in Engineering · doi:10.1016/s0143-8166(01)00145-2 · Cited by 3,007
Research works printed but not linked: 17
- 10.1023/A:1022275518082 · DOI
- 10.1109/ICRA.2017.7989522 · DOI · Paper page
- 10.1109/ICRA48891.2023.10161029 · DOI
- Mellet, 2024, Evaluation of human–robot interfaces based on 2D/3D visual and haptic feedback for aerial manipulation, arXiv:2410.15398 · arXiv
- 10.1117/12.57955 · DOI · Paper page
- 10.1109/ICCV.2017.324 · DOI · Paper page
- 10.1109/IROS45743.2020.9340843 · DOI
- 10.1007/978-3-319-46475-6_47 · DOI · Paper page
- 10.1016/j.vrih.2020.05.002 · DOI
- 10.1007/s10462-023-10562-9 · DOI · Paper page
- 10.5555/3045390.3045502 · doi:10.5555/3045390.3045502
- 10.5555/3045118.3045167 · doi:10.5555/3045118.3045167
- 10.1177/10384111070450030802 · doi:10.1177/10384111070450030802
- 10.1109/ACCESS.2024.3383774 · doi:10.1109/access.2024.3383774
- 10.1109/LRA.2024.3434928 · doi:10.1109/lra.2024.3434928
- 10.1145/358669.358692 · DOI · Paper page
- 10.1613/jair.295 · DOI · Paper page
Cited by
Ten Years of Active Learning Techniques and Object Detection: A Systematic Review
Garcia, D., Carias, J., Adão, T., Jesus, R., Cunha, A., & Magalhães, L. G. (2023) · Applied Sciences · doi:10.3390/app131910667 · Cited by 17
Multi-fingered Dynamic Grasping for Unknown Objects
Burkhardt, Y., Feng, Q., Feng, J., Sharma, K., Chen, Z., & Knoll, A. (2024) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids58906.2024.10769601 · Cited by 9
Self-citationSuárez, A., González-Morgado, A., & Ollero, A. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611383 · Cited by 7
“Space robotics is one of the most representative domains where methods and techniques for robot teleoperation have been extensively studied [1], [2], [3], adopting later some concepts to the aerial manipulation field [4], [5], where time delays are much lower.”
BackgroundDesign, Integration, and Field Testing of a Digital Twin-Based Teleoperated Rock Scaling Robot
Le, D. T., Sutjipto, S., Nguyen, D. D. K., & Paul, G. (2025) · IEEE transactions on field robotics. · doi:10.1109/tfr.2025.3547807 · Cited by 5
“Another potential avenue for research is the integration of haptic feedback devices with VR interfaces, which has shown promise in enhancing the control and dexterity of teleoperated industrial robots in delicate and precision-required environments [23], [24].”
Prespecified-Performance Kinematic Tracking Control for Aerial Manipulation
Cao, H., Shen, J., Li, Z., Ren, Q., & Zhao, S. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3609098 · Cited by 3
“In recent years, numerous ground-breaking advances have emerged (see [1], [2], [3] for recent surveys), with typical applications covering aerial grasping [4], [5], contact-based inspection [6], [7], peg-in-hole operations [8], [9] (Fig.”
Metadata
- Authors
- Lee, J., Balachandran, R., Kondak, K., Coelho, A., Stefano, M. D., Humt, M., Feng, J., Asfour, T., & Triebel, R.
- Affiliations
- Karlsruhe Institute of Technology (DE)
- Deutsches Zentrum für Luft- und Raumfahrt e. V. (DLR) (DE)
- Apptronik Inc., Austin, TX, USA
- Corresponding author
- Lee, Jongseok
- ORCID
- Venue
- IEEE Transactions on Field Robotics
- Published
- 2024
- Volume
- 1
- Pages
- 360-393
- ISSN
- 2771-3989 (ISSN-L)
- 2997-1101
- OpenAlex
- W4360976273
- Cited by
- 8
- References
- 98
- Citations by year
- 2025: 3 · 2024: 3
- FWCI
- 0.79
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Field Robotics (publishedVersion, cc-by)
- elib (German Aerospace Center) (acceptedVersion)
- University of Twente Research Information (submittedVersion, cc-by)
- Funders
- Helmholtz Association’s Initiative and Networking Fund (INF) through the Helmholtz AI Platform (ID ZT-I-PF-5-1)
- European Commission through AEROARMS (644271 EU2020)
- RIMA (824990 EU2020)
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- aerial manipulation, virtual reality interface, haptic guidance, active learning (machine learning), object detection, pose estimation, LiDAR, inertial measurement unit, pick-and-place, peg-in-hole, industrial robotics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Introspective Perception for Long-Term Aerial Telemanipulation With Virtual Reality. https://app.cochat.ai/papers/10.55417/fr.2023010
- The paper
- Lee, J., Balachandran, R., Kondak, K., Coelho, A., Stefano, M. D., Humt, M., Feng, J., Asfour, T., & Triebel, R. (2024). Introspective Perception for Long-Term Aerial Telemanipulation With Virtual Reality. IEEE Transactions on Field Robotics. https://doi.org/10.55417/fr.2023010
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.