Safe2Real: A Toolchain for Safe Simulation-to-Reality Transfer of Learning-based Robot Controllers

Research output: Contribution to conferencesPosterContributedpeer-review

Contributors

  • Konstantin Wrede - , Fraunhofer Institute for Integrated Circuits IIS Division Engineering of Adaptive Systems EAS (Author)
  • Sebastian Zarnack - , Fraunhofer Institute for Integrated Circuits IIS Division Engineering of Adaptive Systems EAS (Author)
  • Yibo Di - , Fraunhofer Institute for Integrated Circuits IIS Division Engineering of Adaptive Systems EAS (Author)
  • Julius Neumann - , Fraunhofer Institute for Integrated Circuits IIS Division Engineering of Adaptive Systems EAS (Author)
  • Zahid Iqbal - , Fraunhofer Institute for Integrated Circuits IIS Division Engineering of Adaptive Systems EAS (Author)
  • Martin Dehmel - , Fraunhofer Institute for Integrated Circuits IIS Division Engineering of Adaptive Systems EAS (Author)
  • Ron Martin - , Fraunhofer Institute for Integrated Circuits IIS Division Engineering of Adaptive Systems EAS (Author)
  • Dirk Mayer - , Fraunhofer Institute for Integrated Circuits IIS Division Engineering of Adaptive Systems EAS (Author)
  • Peter Schneider - , Chair of Design Methods for Adaptive Microelectronic Systems, Institute of Electromechanical and Electronic Design (Author)

Abstract

Learning-based methods such as reinforcement learning (RL) and imitation learning (IL) offer new flexibility in robotics, enabling robots to handle complex tasks with reduced programming effort and mechanical constraints. However, the deployment of such systems in the real world introduces significant safety risks. To address these, we present Safe2Real – a modular toolchain designed to enable the safe and efficient transfer of trained control policies from simulation to physical robots.
The toolchain comprises three key components: (1) a simulation platform optimized for reality-gap reduction, (2) a ROS 2 software stack for policy deployment, perception, and logging, and (3) a unified safety controller available in both simulation and hardware environments. We evaluate Safe2Real using a cube-pushing task with a Franka Emika Panda robot and three training configurations with varying safety constraints. Our experiments show that integrating safety mechanisms during training leads to more robust and accurate real-world behavior without compromising learning performance. Particularly, including a safety controller during training significantly reduces sim-to-real mismatch, while even default policies can perform well when safety is enforced during execution. All implementations and resources will be made available via GitHub.

Details

Original languageEnglish
Number of pages1
Publication statusPublished - 25 Mar 2025
Peer-reviewedYes

Conference

Title16th European Robotics Forum
SubtitleBoosting the Synergies between Robotics and AI for a Stronger Europe
Abbreviated titleERF 2025
Conference number16
Duration25 - 27 March 2025
Website
Degree of recognitionInternational event
LocationKultur- und Kongresszentrum Liederhalle
CityStuttgart
CountryGermany

Keywords

Keywords

  • Adaptive Robotics ; Simulation-to-Reality Transfer ; Safe Reinforcement Learning ; Safe Deployment