Real-time 3D Perception System of Construction Equipment for Autonomous Mobile Robots
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index; 2 of the 6 sources its claims cite were checked for support.
Abstract
Automation using mobile robots at construction sites is gaining attention as a key technology to enhance productivity and safety.However, due to the unstructured nature of construction sites with dynamic elements like construction equipment, robots must perceive their positions and movements in real-time to adapt to workflow changes while performing tasks.To address this issue, this paper proposes a system that enables mobile robots to detect the spatial positions of construction equipment in real time.The system integrates a voxel-based deep learning detection model with a Simultaneous Localization and Mapping (SLAM) algorithm, allowing real-time detection of construction equipment within a consistent reference coordinate system using 3D point cloud data collected by the mobile LiDAR.Experimental results demonstrate that the system achieves an average detection accuracy of 74.51% (AP@R40, IoU 0.25) for excavators, dump trucks, graders, and rollers, demonstrating its capability to accurately recognize the spatial information of construction equipment.This approach highlights the potential for mobile robots to effectively perceive construction equipment in active construction sites, enabling safer and more efficient task execution.
Overview
CoChat Summary
TL;DR
This paper proposes a real-time perception system that lets a mobile robot detect construction equipment in 3D point clouds and register those detections in a global coordinate frame using SLAM. On the test set, the system reported AP@R40, IoU 0.25 scores of 79.13% for dump trucks, 70.81% for excavators, 68.74% for graders, and 79.36% for rollers.
Key findings
- The proposed system achieved an average detection accuracy of 74.51% (AP@R40, IoU 0.25) across excavators, dump trucks, graders, and rollers.
- Class-wise 3D bounding box accuracies on the test set were 79.13% (dump truck), 70.81% (excavator), 68.74% (grader), and 79.36% (roller) at AP@R40, IoU 0.25.
- In a live experiment on sequential point clouds from Site 4, the ROS-based system detected construction equipment at an average speed of 2.8 Hz on the mini-PC and continuously integrated detections with LIO-SAM.
- Transfer-learning experiments showed that full fine-tuning without freezing gave the highest average class performance; freezing more backbone layers hurt especially for equipment structurally different from KITTI, such as excavators.
Methods
- The system combines VoxelNeXt (a voxel-based 3D object detector) with LIO-SAM to detect construction equipment from mobile LiDAR point clouds and transform bounding boxes into a consistent global coordinate system.
- Data were collected by a quadruped robot (Unitree AlienGo) equipped with a Velodyne VLP-32 LiDAR, Microstrain IMU, and Intel NUC 11 PHKi7C mini-PC with NVIDIA GeForce RTX 2060 at four large-scale construction sites.
- The dataset contained 1,246 frames for training/validation and 261 frames for testing; the model was trained for 50 epochs with batch size 4, using AdamW one-cycle learning and transfer learning from KITTI-pretrained weights.
Limitations
- The paper states that mobile LiDAR point clouds are visually sparse, which makes consistent detection difficult, especially in dense, complex construction environments.
- It also states that there is a domain gap between autonomous-driving datasets and construction-site data, and that equipment structural diversity directly affects performance.
- The paper notes that standardized 3D point cloud datasets for construction equipment are lacking; this is an explicit limitation motivating the use of virtual data augmentation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
2 Valid · 0 Not valid · 3 Not checked · 18 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, the low level of standardization and the dynamic nature of construction environments present significant challenges for robotic automation [2].”
What the sources say
- Supportedcites [2] [2] B. Xiao, C. Chen, & X. Yin. Recent advancements of robotics in construction. Automation in Construction, 144: 104591, 2022. source
The Introduction says that adopting robotics in construction faces challenges because construction processes are less standardized and less controlled than manufacturing. Section 4.5.3 describes construction sites as open, flexible, and complex environments that existing robotic algorithms struggle to adapt to. Page numbers are not available in our copy. (LLM, conf=0.93)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results demonstrated that VoxelNeXt, implemented within the proposed ROS-based system, detected construction equipment at an average speed of 2.8 Hz on the mini-PC.”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“dump truck (79.13%), excavator (70.81%), grader (68.74%), and roller (79.36%)”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“dump truck (79.13%), excavator (70.81%), grader (68.74%), and roller (79.36%)”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Experimental results demonstrate that the system achieves an average detection accuracy of 74.51% (AP@R40, IoU 0.25) for excavators, dump trucks, graders, and rollers”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
9 more claims
Create a free account to see all 23 claims and every source verdict.
- It may state two separate claims as one. 6
- Probably not a substantial claim. 3
Citations
Cites
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913
LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping
Shan, T., Englot, B., Meyers, D., Wang, W., Ratti, C., & Rus, D. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341176 · Cited by 2,199
IEEE Robotics and automation letters
(n.d.) · GSI Repository (German Federal Government) · Cited by 687
VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Tracking
Chen, Y., Liu, J., Zhang, X., Qi, X., & Jia, J. (2023) · arXiv · doi:10.48550/arxiv.2303.11301 · Cited by 486
VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Tracking
Chen, Y., Liu, J., Zhang, X., Qi, X., & Jia, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.02076 · Cited by 472
Recent advancements of robotics in construction
Xiao, B., Chen, C., & Yin, X. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104591 · Cited by 204
Brainwave-driven human-robot collaboration in construction
Liu, Y., Habibnezhad, M., & Jebelli, H. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103556 · Cited by 187
Štibinger, P., Broughton, G., Majer, F., Rozsypálek, Z., Wang, A., Jindal, K., Zhou, A., Thakur, D., Loianno, G., Krajník, T., et al. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3061377 · Cited by 112
Kim, P., Park, J., Cho, Y. K., & Kang, J. (2019) · Automation in Construction · doi:10.1016/j.autcon.2019.102918 · Cited by 101
LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and MappingPreprint
Shan, T., Englot, B., Meyers, D., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00258 · Cited by 101
Autonomous mobile construction robots in built environment: A comprehensive review
Zeng, L., Guo, S., Wu, J., & Markert, B. A. (2024) · Developments in the Built Environment · doi:10.1016/j.dibe.2024.100484 · Cited by 65
Automated Object Manipulation Using Vision-Based Mobile Robotic System for Construction Applications
Asadi, K., Haritsa, V. R., Han, K. K., & Ore, J. (2020) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000946 · Cited by 63
Automated system of scaffold point cloud data acquisition using a robot dog
Chung, D., Kim, J., Paik, S., Im, S., & Kim, H. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105944 · Cited by 32
Self-citationCalibration and Accuracy Analysis of a Low-Cost Mapping-Grade Mobile Laser Scanning System
Hauser, D., Glennie, C., & Brooks, B. (2016) · Journal of Surveying Engineering · doi:10.1061/(asce)su.1943-5428.0000178 · Cited by 29
Understanding human-robot proxemic norms in construction: How do humans navigate around robots?
Kim, Y., Kim, S., Chen, Y., Yang, H., Kim, S., Ha, S., Gombolay, M., Ahn, Y., & Cho, Y. K. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105455 · Cited by 28
Self-citationKim, J., Kim, J., Paik, S., & Kim, H. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105277 · Cited by 26
Self-citation
Cited by
Wang, Y., Xiao, H., Chen, N., Wu, Z., & Zhou, C. (2026) · Advanced Engineering Informatics · doi:10.1016/j.aei.2026.105095
Metadata
- Authors
- Chung, D., Im, S., Kim, Y., & Kim, H.
- Affiliations
- Yonsei University (KR)
- Venue
- Proceedings of the International Symposium on Automation and Robotics in Construction (IAARC)
- Published
- 2025-07-27
- ISSN
- 2413-5844 (ISSN-L)
- OpenAlex
- W4412691151
- Semantic Scholar
- faa25030651c8f4764dcbc0f0ba460a53f5338cb
- Cited by
- 1
- References
- 11
- Citations by year
- 2026: 1
- FWCI
- 2.46
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- International Symposium on Automation and Robotics in Construction (ISARC) (publishedVersion)
- Funders
- National Research Foundation
- Ministry of Land, Infrastructure and Transport (RS-2020-KA156488)
- National Research Foundation of Korea (RS-2024-00457308)
- Korea Agency for Infrastructure Technology Advancement (RS-2020-KA156488)
- Ministry of Science and ICT, South Korea (RS-2024-00457308)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Earth and Planetary Sciences › Geology › 3D Surveying and Cultural Heritage
- Keywords
- autonomous mobile robots, construction site automation, SLAM, LiDAR point cloud, construction machinery, excavators, graders, rollers, dump trucks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.