Q-Learning-Based Real-Time Control of a 3D-Printed Compliant Actuator Driven by Shape Memory Alloy Wires
Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review
Contributors
Abstract
Modeling and controlling actuators driven by smart materials, such as shape-memory alloys (SMAs), is challenging due to their strong nonlinearities, hysteresis characteristics, and Multiphysics coupling, which limits the effectiveness of classical model-based control. This paper presents and evaluates a data-driven Q-learning controller for SMA-based actuators that learns a state-feedback policy without requiring an explicit model of the plant. The target system is a single-input, single-output, 3D-printed compliant actuator driven by SMA wires, tasked with real-time trajectory tracking. The approach bypasses system identification and controller tuning in favor of policy learning via the action-value Q-function. In real-time simulation, the learned policy reliably tracks diverse reference signals (constant, sinusoidal, square). The mean absolute tracking error ranges from 0.8 to 1.9 percent, indicating good practical accuracy even though perfect tracking is not achieved-an acceptable trade-off for many smart-material applications.
Details
| Original language | English |
|---|---|
| Title of host publication | 2025 13th International Conference on Control, Mechatronics and Automation, ICCMA 2025 |
| Publisher | Institute of Electrical and Electronics Engineers (IEEE) |
| Pages | 383-387 |
| Number of pages | 5 |
| ISBN (electronic) | 979-8-3315-9141-0, 979-8-3315-9140-3 |
| ISBN (print) | 979-8-3315-9142-7 |
| Publication status | Published - 2025 |
| Peer-reviewed | Yes |
Publication series
| Series | International Conference on Control, Mechatronics and Automation (ICCMA) |
|---|---|
| ISSN | 2837-5114 |
Conference
| Title | 13th International Conference on Control, Mechatronics and Automation |
|---|---|
| Abbreviated title | ICCMA 2025 |
| Conference number | 13 |
| Duration | 24 - 26 November 2025 |
| Website | |
| Degree of recognition | International event |
| Location | University of Versailles |
| City | Paris |
| Country | France |
External IDs
| ORCID | /0000-0002-2108-1095/work/219262940 |
|---|---|
| ORCID | /0000-0002-3347-0864/work/219266426 |
Keywords
ASJC Scopus subject areas
Keywords
- Q-Learning, Reinforcement Learning, SMA-based Actuator, Smart Materials, Tracking Control