Enhanced No-Code Finger-Gesture-Based Robot Programming: Simultaneous Path and Contour Awareness for Orientation Estimation

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Beitragende

  • Jayanto Halim - , Fraunhofer-Institut für Werkzeugmaschinen und Umformtechnik (Autor:in)
  • Paul Eichler - , Fraunhofer-Institut für Werkzeugmaschinen und Umformtechnik (Autor:in)
  • Sebastian Krusche - , Fraunhofer-Institut für Werkzeugmaschinen und Umformtechnik (Autor:in)
  • Mohamad Bdiwi - , Fraunhofer-Institut für Werkzeugmaschinen und Umformtechnik (Autor:in)
  • Steffen Ihlenfeldt - , Professur für Werkzeugmaschinenentwicklung und adaptive Steuerungen, Fraunhofer-Institut für Werkzeugmaschinen und Umformtechnik (Autor:in)

Abstract

The programming of industrial robots necessitates specialized expertise and significant time and effort, particularly for small batch sizes. However, with the increasing demand for agility in production, the solutions used for robot programming have evolved significantly. Intuitive robot programming systems based on diverse concepts have been introduced to facilitate rapid deployment of robot systems. One such approved concept is no-code robot programming with finger-based gesture. In this concept, non-expert users draw a robot path via finger movement, which is subsequently translated into robot programming language to facilitate the corresponding movement. A significant challenge associated with this method is the valid replication of the corresponding robot Tool Center Point (TCP) orientation. Reachability issues, non-compliant hand contortions, and sensor occlusions make it difficult to directly derive the robot's TCP orientation from the finger's orientation. This work presents two novel approaches for estimating robot orientation using numerical analysis and point cloud information for finger-based robot programming without requiring prior knowledge. The first approach utilizes numerical analysis to estimate the relative robot orientation based on the geometry of the trajectory. In contrast, the second approach uses point-cloud to derive the robot orientation based on the object contour. Input shaping algorithms are employed and evaluated to reduce the divergence in the orientation estimations. Experiments demonstrate the effectiveness of the proposed approach utilizing a low-cost camera as a cost-efficient alternative to existing no-code programming strategies, potentially accelerating the real-world deployment of robotic applications in industrial environments.

Details

OriginalspracheEnglisch
Titel2023 32nd IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2023
Herausgeber (Verlag)IEEE Computer Society
Seiten1502-1508
Seitenumfang7
ISBN (elektronisch)9798350336702
PublikationsstatusVeröffentlicht - 2023
Peer-Review-StatusJa

Publikationsreihe

ReiheIEEE International Symposium on Robot and Human Interactive Communication proceedings
ISSN1944-9445

Konferenz

Titel32nd IEEE International Conference on Robot and Human Interactive Communication
UntertitelDesign a New Bridge for H-R-I
KurztitelIEEE RO-MAN 2023
Veranstaltungsnummer32
Dauer28 - 31 August 2023
Webseite
BekanntheitsgradInternationale Veranstaltung
OrtParadise Hotel
StadtBusan
LandSüdkorea