Action robust reinforcement learning for air mobility deconfliction against conflict induced spoofing
dc.contributor.author | Panda, Deepak Kumar | |
dc.contributor.author | Guo, Weisi | |
dc.date.accessioned | 2024-10-14T13:42:21Z | |
dc.date.available | 2024-10-14T13:42:21Z | |
dc.date.freetoread | 2024-10-14 | |
dc.date.issued | 2024-12 | |
dc.date.pubOnline | 2024-09-17 | |
dc.description.abstract | Increased dynamic drone usage has increased complexity in aerial navigation and often demands distributed local deconfliction. Due to the high velocities and few landmarks, robust deconfliction relies on precise positioning and synchronization. However, intentional spoofing attacks aimed at inducing navigation conflicts threaten the reliability of conventional techniques. Here, we address these concerns by establishing a baseline on the impact of novel conflict-inducing spoofing attacks on existing geometric navigation methods. Based on the impact of the attacks on the navigation, reinforcement learning (RL) strategy is used to counter the effects of spoofing attacks. In order to counter the effect of spoofing in randomized dynamic airspace conditions, a zero-sum action-robust (ZSAR) RL based on mixed Nash equilibrium objective is used. The proposed methodology yields an improved number of conflict-free paths while reducing average conflicts compared to existing state of the art RL strategies, thus making it suitable for deploying autonomous aircrafts. | |
dc.description.journalName | IEEE Transactions on Intelligent Transportation Systems | |
dc.description.sponsorship | Engineering and Physical Sciences Research Council (EPSRC) | |
dc.description.sponsorship | This work was supported in part by the Royal Academy of Engineering and the Office of the Chief Science Adviser for National Security under the UK Intelligence Community Postdoctoral Research under Grant ICRF2324-7-150; in part by the Engineering and Physical Sciences Research Council (EPSRC); and in part by the U.K. Research and Innovation (UKRI), “TAS-S: Trustworthy Autonomous Systems: Security” under Grant EP/V026763/1. | |
dc.format.extent | 21343-21355 | |
dc.identifier.citation | Panda DK, Guo W. (2024) Action robust reinforcement learning for air mobility deconfliction against conflict induced spoofing. IEEE Transactions on Intelligent Transportation Systems, Volume 25, Issue 12, December 2024, pp. 21343-21355 | |
dc.identifier.eissn | 1558-0016 | |
dc.identifier.elementsID | 554045 | |
dc.identifier.issn | 1524-9050 | |
dc.identifier.issueNo | 99 | |
dc.identifier.issueNo | 12 | |
dc.identifier.uri | https://doi.org/10.1109/tits.2024.3454354 | |
dc.identifier.uri | https://dspace.lib.cranfield.ac.uk/handle/1826/23038 | |
dc.identifier.volumeNo | 25 | |
dc.language.iso | en | |
dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) | |
dc.publisher.uri | https://ieeexplore.ieee.org/document/10682497 | |
dc.rights | Attribution 4.0 International | en |
dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | |
dc.subject | Aircraft | |
dc.subject | Autonomous aerial vehicles | |
dc.subject | Heuristic algorithms | |
dc.subject | Aircraft navigation | |
dc.subject | Air traffic control | |
dc.subject | Global Positioning System | |
dc.subject | Artificial intelligence | |
dc.subject | Spoofing | |
dc.subject | conflict resolution | |
dc.subject | reinforcement learning | |
dc.subject | UAV | |
dc.subject | adversarial network | |
dc.subject | deconfliction | |
dc.subject | 46 Information and Computing Sciences | |
dc.subject | 4602 Artificial Intelligence | |
dc.subject | Logistics & Transportation | |
dc.subject | 3509 Transportation, logistics and supply chains | |
dc.subject | 4602 Artificial intelligence | |
dc.subject | 4603 Computer vision and multimedia computation | |
dc.title | Action robust reinforcement learning for air mobility deconfliction against conflict induced spoofing | |
dc.type | Article | |
dc.type.subtype | Article | |
dc.type.subtype | Early Access | |
dcterms.dateAccepted | 2024-08-30 |