Q-Learning-Based Real-Time Control of a 3D-Printed Compliant Actuator Driven by Shape Memory Alloy Wires
Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/Gutachten › Beitrag in Konferenzband › Beigetragen › Begutachtung
Beitragende
Abstract
Modeling and controlling actuators driven by smart materials, such as shape-memory alloys (SMAs), is challenging due to their strong nonlinearities, hysteresis characteristics, and Multiphysics coupling, which limits the effectiveness of classical model-based control. This paper presents and evaluates a data-driven Q-learning controller for SMA-based actuators that learns a state-feedback policy without requiring an explicit model of the plant. The target system is a single-input, single-output, 3D-printed compliant actuator driven by SMA wires, tasked with real-time trajectory tracking. The approach bypasses system identification and controller tuning in favor of policy learning via the action-value Q-function. In real-time simulation, the learned policy reliably tracks diverse reference signals (constant, sinusoidal, square). The mean absolute tracking error ranges from 0.8 to 1.9 percent, indicating good practical accuracy even though perfect tracking is not achieved-an acceptable trade-off for many smart-material applications.
Details
| Originalsprache | Englisch |
|---|---|
| Titel | 2025 13th International Conference on Control, Mechatronics and Automation, ICCMA 2025 |
| Herausgeber (Verlag) | Institute of Electrical and Electronics Engineers (IEEE) |
| Seiten | 383-387 |
| Seitenumfang | 5 |
| ISBN (elektronisch) | 979-8-3315-9141-0, 979-8-3315-9140-3 |
| ISBN (Print) | 979-8-3315-9142-7 |
| Publikationsstatus | Veröffentlicht - 2025 |
| Peer-Review-Status | Ja |
Publikationsreihe
| Reihe | International Conference on Control, Mechatronics and Automation (ICCMA) |
|---|---|
| ISSN | 2837-5114 |
Konferenz
| Titel | 13th Internationale Conferenc on Control, Mechatronics and Automation |
|---|---|
| Kurztitel | ICCMA 2025 |
| Veranstaltungsnummer | 13 |
| Dauer | 24 - 26 November 2025 |
| Webseite | |
| Bekanntheitsgrad | Internationale Veranstaltung |
| Ort | University of Versailles |
| Stadt | Paris |
| Land | Frankreich |
Externe IDs
| ORCID | /0000-0002-2108-1095/work/219262940 |
|---|---|
| ORCID | /0000-0002-3347-0864/work/219266426 |
Schlagworte
ASJC Scopus Sachgebiete
Schlagwörter
- Q-Learning, Reinforcement Learning, SMA-based Actuator, Smart Materials, Tracking Control