Enhanced No-Code Finger-Gesture-Based Robot Programming: Simultaneous Path and Contour Awareness for Orientation Estimation

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

  • Jayanto Halim - , Fraunhofer Institute for Machine Tools and Forming Technology (Author)
  • Paul Eichler - , Fraunhofer Institute for Machine Tools and Forming Technology (Author)
  • Sebastian Krusche - , Fraunhofer Institute for Machine Tools and Forming Technology (Author)
  • Mohamad Bdiwi - , Fraunhofer Institute for Machine Tools and Forming Technology (Author)
  • Steffen Ihlenfeldt - , Chair of Machine Tools Development and Adaptive Controls, Fraunhofer Institute for Machine Tools and Forming Technology (Author)

Abstract

The programming of industrial robots necessitates specialized expertise and significant time and effort, particularly for small batch sizes. However, with the increasing demand for agility in production, the solutions used for robot programming have evolved significantly. Intuitive robot programming systems based on diverse concepts have been introduced to facilitate rapid deployment of robot systems. One such approved concept is no-code robot programming with finger-based gesture. In this concept, non-expert users draw a robot path via finger movement, which is subsequently translated into robot programming language to facilitate the corresponding movement. A significant challenge associated with this method is the valid replication of the corresponding robot Tool Center Point (TCP) orientation. Reachability issues, non-compliant hand contortions, and sensor occlusions make it difficult to directly derive the robot's TCP orientation from the finger's orientation. This work presents two novel approaches for estimating robot orientation using numerical analysis and point cloud information for finger-based robot programming without requiring prior knowledge. The first approach utilizes numerical analysis to estimate the relative robot orientation based on the geometry of the trajectory. In contrast, the second approach uses point-cloud to derive the robot orientation based on the object contour. Input shaping algorithms are employed and evaluated to reduce the divergence in the orientation estimations. Experiments demonstrate the effectiveness of the proposed approach utilizing a low-cost camera as a cost-efficient alternative to existing no-code programming strategies, potentially accelerating the real-world deployment of robotic applications in industrial environments.

Details

Original languageEnglish
Title of host publication2023 32nd IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2023
PublisherIEEE Computer Society
Pages1502-1508
Number of pages7
ISBN (electronic)9798350336702
Publication statusPublished - 2023
Peer-reviewedYes

Publication series

SeriesIEEE International Symposium on Robot and Human Interactive Communication proceedings
ISSN1944-9445

Conference

Title32nd IEEE International Conference on Robot and Human Interactive Communication
SubtitleDesign a New Bridge for H-R-I
Abbreviated titleIEEE RO-MAN 2023
Conference number32
Duration28 - 31 August 2023
Website
Degree of recognitionInternational event
LocationParadise Hotel
CityBusan
CountryKorea, Republic of