Volume 22, Issue 2 (JIAEEE Vol.22 No.2 2025)
Journal of Iranian Association of Electrical and Electronics Engineers 2025, 22(2): 0-0 |
Back to browse issues page
Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
Shamaghdari S, Roshanravan S. Integrated Fault-Tolerant Attitude Control of Quadrotor Using Reinforcement Learning. Journal of Iranian Association of Electrical and Electronics Engineers 2025; 22 (2)
URL: http://jiaeee.com/article-1-1608-en.html
URL: http://jiaeee.com/article-1-1608-en.html
Iran University of Science and Technology (IUST)
Abstract: (146 Views)
This paper deals with the optimal attitude control problem for quadrotor unmannd air vehicles with unknown nonlinear dynamics subject to component and actuator faults. The proposed integrated optimal fault tolerant control (FTC) scheme is based on reinforcement learning (RL) algorithm, without requiring prior knowledge of the system dynamics. To solve the Hamilton-Jacobi-Bellman (HJB) equation, an identifier-critic-based online RL strategy is employed with a dual neural network (NN) approximation structure. The forgetting factor in the proposed identifier update law is variable and dependent on the state estimation errors and measurement noise estimation. Choosing this variable forgetting factor increases the convergence speed and decreases the estimation error of identifier NN weights compared to the constant one while maintaining its robustness. When a fault occurs, the system continues to operate under the former control policy until the fault is detected. On the other hand, the optimal control design in the RL framework requires the initial stabilizing control condition. In order to make it possible to initiate the control learning process from the former applied FTC, this condition is relaxed by leveraging a stabilizing term in the critic update law. The Uniformly Ultimately Boundedness (UUB) of identifier and critic NN weight errors and, as a result, the convergence of the control input to the neighborhood of the optimal solution are all proved by Lyapunov theory. In the proposed method, changes in the values of faults are detected by comparing the HJB error to a predefined threshold. Finally, the simulation results are given to validate the effectiveness of the developed method.
Keywords: Quadrature Attitude Control, Component and Actuator Faults, Fault-Tolerant Optimal Control, Fault Detection, Reinforcement Learning
Send email to the article author
| Rights and permissions | |
 |
This Journal is an open access Journal Licensed under the Creative Commons Attribution-NonCommercial 4.0 International License. (CC BY NC 4.0) |
