Cyber-Physical On-Site Construction Processes using a Spider Crane Robotic Platform

Research Project 16-2 (RP 16-2)

Weiße Schrift

IntCDC Research Project 16-2 – Cyber-Physical On-Site Construction Processes using a Spider Crane Robotic Platform
CYBER-PHYSICAL ON-SITE CONSTRUCTION PROCESSES USING A SPIDER CRANE ROBOTIC PLATFORM

We will focus on robotic assembly of form-fit timber building systems developed in IntCDC, such as the FIT pavilion or the multi-story building system of RP-3, which can be used to add floors onto existing buildings thanks to their light weight. By automating time-consuming tasks using our spider crane cyber-physical construction platform, we hope to counteract the shortage of skilled workers and increase construction speed. This robotic system must be able to coordinate its own movements on site to pick up and assemble a variety of building components. We will thus develop an absolute tracking and positioning system that uses the camera modules of the image-assisted total stations (IATSs) and image-processing techniques. It will automatically recognize the target building component and constantly estimate its position and orientation without prisms or other markers. We will use this high-quality visual pose-estimation system to investigate processes ranging from smart teleoperation to fully autonomous control, including haptic feedback, automation of time-consuming tasks, force control, trajectory generation in contact situations, and machine-machine collaboration. High contact forces can damage the manipulator and the manipulated object; therefore, we will characterize the possible contact situations and develop an accurate real-time haptic perception system based on data of teleoperated assembly of form-fit timber parts. For increased safety and efficiency, our smart teleoperation system will enable the operator to feel steady-state interaction forces and/or torques as well as digital guidance toward the desired component pose. It will also let the operator record brief actions that can then be autonomously repeated through task-parameterized movement learning. During autonomous assembly, the pose data from the IATSs and the predicted interaction forces will be used to generate trajectories and parameterize the controller according to the different interaction situations. Then, we will study collaborative assembly between the tower crane and the spider crane. This configuration beneficially combines the high payload capacity of the tower crane and the positioning accuracy of the spider crane. To close the loop from automated fabrication to automated assembly, we will also work on pick-up strategies from an autonomous mobile robot (AMR) that transports the components from the prefabrication platform to the construction site.

 
PRINCIPAL INVESTIGATOR

Dr. Katherine J. Kuchenbecker
Haptic Intelligence Department (MPI HI), Max Planck Institute for Intelligent Systems
Prof. Dr.-Ing. Dr. h.c. Oliver Sawodny
Institute for System Dynamics (ISYS), University of Stuttgart
Prof. Dr.-Ing. habil. Volker Schwieger
Institute of Engineering Geodesy (IIGS), University of Stuttgart

TEAM

Dr. Bernard Javot (MPI)
Dr.-Ing. Gabriel Kerekes (IIGS)
Yijie Gong (MPI)
Anja Lauer (ISYS)
Lyudmila Gorokhova (IIGS)
Mayumi Mohan (MPI)
Naomi Tashiro (MPI)
Martin Rupp (ISYS)
Philipp Arnold (ISYS)

 

PEER-REVIEWED PUBLICATIONS

  1. 2024

    1. Gienger, A., Stein, C., Lauer, A. P. R., Sawodny, O., & Tarín, C. (2024). Data-Based Reachability Analysis and Optimized Robot Positioning for Co-Design of Construction Processes. 2024 IEEE/SICE International Symposium on System Integration (SII).

  2. 2023

    1. Gong, Y., Javot, B., Lauer, A. P. R., Sawodny, O., & Kuchenbecker, K. J. (2023). Naturalistic Vibrotactile Feedback Could Facilitate Telerobotic Assembly on Construction Sites. In 2023 IEEE World Haptics Conference Committee (Ed.), 2023 IEEE World Haptics Conference (WHC) (pp. 169–175). https://doi.org/10.1109/WHC56415.2023.10224499
    2. Lauer, A. P. R., Benner, E., Stark, T., Klassen, S., Abolhasani, S., Schroth, L., Gienger, A., Wagner, H. J., Schwieger, V., Menges, A., & Sawodny, O. (2023). Automated on-site assembly of timber buildings on the example of a biomimetic shell. Automation in Construction. https://doi.org/10.1016/j.autcon.2023.105118
    3. Lauer, A. P. R., Lerke, O., Blagojevic, B., Schwieger, V., & Sawodny, O. (2023). Tool Center Point Control of a Large-Scale Manipulator Using Absolute Position Feedback. Control Engineering Practice.
    4. Lauer, A. P. R., Lerke, O., Gienger, A., Schwieger, V., & Sawodny, O. (2023). State Estimation with Static Displacement Compensation for Large-Scale Manipulators. SII Atlanta.
    5. Lauer, A. P. R., Schürmann, T., Gienger, A., & Sawodny, O. (2023). Force-Controlled On-Site Assembly using Pose-Dependent Stiffness of Large-Scale Manipulators. Proceedings of the 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE).
    6. Müller, B., Densborn, S., Kübel, J., & Sawodny, O. (2023). Smooth Path Planning for Redundant Large-Scale Robots using Measured Reference Points. Proceedings of The 22nd World Congress of the International Federation of Automatic Control (IFAC).

  3. 2022

    1. Burns, R. B., Lee, H., Seifi, H., Faulkner, R., & Kuchenbecker, K. J. (2022). Endowing a NAO Robot With Practical Social-Touch Perception. Frontiers in Robotics and AI, 9. https://doi.org/10.3389/frobt.2022.840335
    2. Oberdorfer, M., & Sawodny, O. (2022). Modeling and flatness based feedforward control of a hydraulic axial piston pump. Proceedings of the 2022 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM). https://doi.org/10.1109/AIM52237.2022.9863384
    3. Ortenzi, V., Filipovica, M., Abdlkarim, D., Pardi, T., Takahashi, C., Wing, A. M., Di Luca, M., & Kuchenbecker, K. J. (2022). Robot, Pass Me the Tool: Handle Visibility Facilitates Task-oriented Handovers. 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 256–264. https://doi.org/10.1109/HRI53351.2022.9889546
    4. Parlapanis, C., Müller, D., Frontull, M., & Sawodny, O. (2022). Modeling the Driving Dynamics of a Hydraulic Construction Vehicle. Proceedings of the 9th IFAC Symposium on Mechatronic Systems (Mechatronics 2022).
    5. Parlapanis, C., Müller, D., Frontull, M., & Sawodny, O. (2022). Modeling of the Work Functionality of a Hydraulically Actuated Telescopic Handler. IFAC-PapersOnLine, 55(20), Article 20.

  4. 2021

    1. Abdlkarim, D., Ortenzi, V., Pardi, T., Filipovica, M., Wing, A., Kuchenbecker, K., & Di Luca, M. (2021). PrendoSim: Proxy-Hand-Based Robot Grasp Generator. Proceedings of the 18th International Conference on Informatics in Control, Automation and Robotics - ICINCO, 60–68. https://doi.org/10.5220/0010549800600068
    2. Abdlkarim., D., Ortenzi., V., Pardi., T., Filipovica., M., Wing., A. M., Kuchenbecker., K. J., & Di Luca., M. (2021). PrendoSim: Proxy-Hand-Based Robot Grasp Generator. Proceedings of the 18th International Conference on Informatics in Control, Automation and Robotics - ICINCO, 60–68. https://doi.org/10.5220/0010549800600068
    3. Lauer, A. P. R., Blagojevic, B., Lerke, O., Schwieger, V., & Sawodny, O. (2021). Flexible Multibody System Model of a Spider Crane with two Extendable Booms. Proceedings of the 47th Annual Conference on the IEEE Industrial Electronics Society (IECON).
    4. Lerke, O., & Schwieger, V. (2021). Analysis of a kinematic real-time robotic total station network for robot control. Journal of Applied Geodesy, 15(3), Article 3. https://doi.org/doi:10.1515/jag-2021-0016
    5. Oei, M., & Sawodny, O. (2021). Attitude estimation for ground vehicles using low-cost sensors with in-vehicle calibration.
    6. Rupp, M. T. M., Valder, R., Knoll, C., & Sawodny, O. (2021). Cascaded Time Delay Compensation and Sensor Data Fusion for Visual Servoing.

  5. 2019

    1. Schwieger, V., Menges, A., Zhang, L., & Schwinn, T. (2019). Engineering Geodesy for Integrative Computational Design and Construction. Zeitschrift Für Geodäsie, Geoinformation Und Landmanagement (ZfV), 144(4), Article 4. https://doi.org/10.12902/zfv-0272-2019

OTHER PUBLICATIONS

  1. 2022

    1. Schwieger, V., Zhang, L., Lerke, O., & Balangé, L. (2022). The Research Cluster Integrative Computational Design and Construction (IntCDC) – Current Engineering Geodetic Contribution. XXVII FIG Congress 2022, Warsaw, Poland.

DATA SETS

  1. 2023

    1. Gong, Y., Javot, B., Lauer, A. P. R., Sawodny, O., & Kuchenbecker, K. J. (2023). User Study Dataset for Understanding On-Site Construction Activities with Haptic Perception. Edmond. https://doi.org/10.17617/3.PAFGCA

  2. 2022

    1. Burns, R. B., Lee, H., Seifi, H., Faulkner, R., & Kuchenbecker, K. J. (2022). User Study Dataset for Endowing a NAO Robot with Practical Social-Touch Perception. Edmond. https://doi.org/10.17617/3.6w
    2. Burns, R. B., Lee, H., Seifi, H., Faulkner, R., & Kuchenbecker, K. J. (2022). Sensor Patterns Dataset for Endowing a NAO Robot with Practical Social-Touch Perception. Edmond. https://doi.org/10.17617/3.6x

  

To the top of the page