Q-Learning-Based Real-Time Control of a 3D-Printed Compliant Actuator Driven by Shape Memory Alloy Wires

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

Abstract

Modeling and controlling actuators driven by smart materials, such as shape-memory alloys (SMAs), is challenging due to their strong nonlinearities, hysteresis characteristics, and Multiphysics coupling, which limits the effectiveness of classical model-based control. This paper presents and evaluates a data-driven Q-learning controller for SMA-based actuators that learns a state-feedback policy without requiring an explicit model of the plant. The target system is a single-input, single-output, 3D-printed compliant actuator driven by SMA wires, tasked with real-time trajectory tracking. The approach bypasses system identification and controller tuning in favor of policy learning via the action-value Q-function. In real-time simulation, the learned policy reliably tracks diverse reference signals (constant, sinusoidal, square). The mean absolute tracking error ranges from 0.8 to 1.9 percent, indicating good practical accuracy even though perfect tracking is not achieved-an acceptable trade-off for many smart-material applications.

Details

Original languageEnglish
Title of host publication2025 13th International Conference on Control, Mechatronics and Automation, ICCMA 2025
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages383-387
Number of pages5
ISBN (electronic)979-8-3315-9141-0, 979-8-3315-9140-3
ISBN (print)979-8-3315-9142-7
Publication statusPublished - 2025
Peer-reviewedYes

Publication series

SeriesInternational Conference on Control, Mechatronics and Automation (ICCMA)
ISSN2837-5114

Conference

Title13th International Conference on Control, Mechatronics and Automation
Abbreviated titleICCMA 2025
Conference number13
Duration24 - 26 November 2025
Website
Degree of recognitionInternational event
LocationUniversity of Versailles
CityParis
CountryFrance

External IDs

ORCID /0000-0002-2108-1095/work/219262940
ORCID /0000-0002-3347-0864/work/219266426

Keywords

Keywords

  • Q-Learning, Reinforcement Learning, SMA-based Actuator, Smart Materials, Tracking Control