A Hybrid Approach of No-Code Robot Programming for Agile Production: Integrating Finger-Gesture and Point Cloud

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

  • Jayanto Halim - , Fraunhofer Institute for Machine Tools and Forming Technology (Author)
  • Paul Eichler - , Fraunhofer Institute for Machine Tools and Forming Technology (Author)
  • Sebastian Krusche - , Fraunhofer Institute for Machine Tools and Forming Technology (Author)
  • Mohamad Bdiwi - , Fraunhofer Institute for Machine Tools and Forming Technology (Author)
  • Steffen Ihlenfeldt - , Fraunhofer Institute for Machine Tools and Forming Technology (Author)

Abstract

Industrial robot programming necessitates specialized expertise and significant time commitment, particularly for small-batch productions. In response to the escalating demand for production agility, novel approaches have emerged in intuitive robot programming. These inventive systems, rooted in diverse conceptual frameworks, are designed to expedite the deployment of robot systems. A prominent innovation in this domain is adopting no-code robot programming through finger-based gestures. A robot program can be generated by capturing and tracking non-expert users' finger movements and gestures, converting 3D coordinates into an executable robot programming language. However, accurately determining finger positions for 3D coordinates and precise geometrical features presents an ongoing challenge. In pursuit of heightened trajectory precision and reducing more significant effort for the users, we propose a hybrid methodology that amalgamates finger-gesture programming with point cloud data. This synergistic integration demonstrates promising outcomes, substantiating its potential to facilitate the precise and adaptive generation of robot paths within robot applications.

Details

Original languageEnglish
Title of host publication33rd IEEE International Conference on Robot and Human Interactive Communication, ROMAN 2024
PublisherIEEE Computer Society
Pages732-739
Number of pages8
ISBN (electronic)9798350375022
Publication statusPublished - 2024
Peer-reviewedYes
Externally publishedYes

Publication series

SeriesIEEE International Workshop on Robot and Human Communication, RO-MAN
ISSN1944-9445

Conference

Title33rd IEEE International Conference on Robot and Human Interactive Communication
SubtitleEmbracing Human-Centered HRI
Abbreviated titleRO-MAN 2024
Conference number33
Duration26 - 30 August 2024
Website
LocationPasadena Convention Center
CityPasadena
CountryUnited States of America