Q-Learning-Based Real-Time Control of a 3D-Printed Compliant Actuator Driven by Shape Memory Alloy Wires

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/Gutachten › Beitrag in Konferenzband › Beigetragen › Begutachtung

Beitragende

Abstract

Modeling and controlling actuators driven by smart materials, such as shape-memory alloys (SMAs), is challenging due to their strong nonlinearities, hysteresis characteristics, and Multiphysics coupling, which limits the effectiveness of classical model-based control. This paper presents and evaluates a data-driven Q-learning controller for SMA-based actuators that learns a state-feedback policy without requiring an explicit model of the plant. The target system is a single-input, single-output, 3D-printed compliant actuator driven by SMA wires, tasked with real-time trajectory tracking. The approach bypasses system identification and controller tuning in favor of policy learning via the action-value Q-function. In real-time simulation, the learned policy reliably tracks diverse reference signals (constant, sinusoidal, square). The mean absolute tracking error ranges from 0.8 to 1.9 percent, indicating good practical accuracy even though perfect tracking is not achieved-an acceptable trade-off for many smart-material applications.

Details

OriginalspracheEnglisch
Titel2025 13th International Conference on Control, Mechatronics and Automation, ICCMA 2025
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers (IEEE)
Seiten383-387
Seitenumfang5
ISBN (elektronisch)979-8-3315-9141-0, 979-8-3315-9140-3
ISBN (Print)979-8-3315-9142-7
PublikationsstatusVeröffentlicht - 2025
Peer-Review-StatusJa

Publikationsreihe

ReiheInternational Conference on Control, Mechatronics and Automation (ICCMA)
ISSN2837-5114

Konferenz

Titel13th Internationale Conferenc on Control, Mechatronics and Automation
KurztitelICCMA 2025
Veranstaltungsnummer13
Dauer24 - 26 November 2025
Webseite
BekanntheitsgradInternationale Veranstaltung
OrtUniversity of Versailles
StadtParis
LandFrankreich

Externe IDs

ORCID /0000-0002-2108-1095/work/219262940
ORCID /0000-0002-3347-0864/work/219266426

Schlagworte

Schlagwörter

  • Q-Learning, Reinforcement Learning, SMA-based Actuator, Smart Materials, Tracking Control