Optimization of a robust reinforcement learning policy

Simple item page
dc.contributor.authorInce, Bilkan
dc.contributor.authorShin, Hyo-Sang
dc.contributor.authorTsourdos, Antonios
dc.date.accessioned2023-02-15T08:56:43Z
dc.date.available2023-02-15T08:56:43Z
dc.date.issued2023-01-19
dc.description.abstractA major challenge for the integration of unmanned air vehicle (UAV) in the current civil applications is the sense-and-avoid (SAA) capability and the consequent possibility of mid-air collision avoidance. Although UAS have been shown to be efficient under different and varied conditions, their safety, reliability, and compliance with aviation regulations remain to be proven. In autonomous collision avoidance, UAS sense hazards with the sensors equipped on them and make decisions on manoeuvres autonomously for collision avoidance at the minimum safe time before impact. Thus, it is required for each individual UAS to have capabilities to recognize urgent threats and undertake the evasive manoeuvres immediately. Most of the current sense and avoid algorithms are composed of separated obstacle detection and tracking algorithm and decision-making algorithm on avoidance manoeuvre. Implementing artificial intelligence (AI), reinforcement learning (RL) algorithm combines both sense and avoid functions through state and action space. An autonomous agent learns to perform complex tasks by maximizing reward signals while interacting with its environment. It may be infeasible to test a policy in all contexts since it is difficult to ensure it works as broadly as intended. In these cases, it is important to trade-off between performance and robustness while learning a policy. This work develops an optimization method for a robust reinforcement learning policy for a nonlinear small unmanned air systems (sUAS), in AirSim using a model-free architecture. Using an on-line trained reinforcement learning agent, the difference of an optimized robust reinforcement learning (RRL) policy together with a conventional RL and RRL algorithm will be reproduced.en_UK
dc.description.sponsorshipEngineering and Physical Sciences Research Council (EPSRC): 2454266 Thales UKen_UK
dc.identifier.citationInce B, Shin H-S, Tsourdos A. (2023) Optimization of a robust reinforcement learning policy. In: AIAA SciTech Forum 2023, 23-27 January 2023, National Harbor, Maryland, USA. Paper number AIAA 2023-0967en_UK
dc.identifier.isbn978-1-62410-699-6
dc.identifier.urihttps://doi.org/10.2514/6.2023-0967
dc.identifier.urihttps://dspace.lib.cranfield.ac.uk/handle/1826/19183
dc.language.isoenen_UK
dc.publisherAIAAen_UK
dc.rightsAttribution 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/*
dc.titleOptimization of a robust reinforcement learning policyen_UK
dc.typeConference paperen_UK

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Robust_reinforcement_learning_policy-2023.pdf
Size:
3.96 MB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.63 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Staff publications (SATM)