Strategic conflict management for performance-based urban air mobility operations with multi-agent reinforcement learning

Simple item page
dc.contributor.authorHuang, Cheng
dc.contributor.authorPetrunin, Ivan
dc.contributor.authorTsourdos, Antonios
dc.date.accessioned2022-08-03T14:02:58Z
dc.date.available2022-08-03T14:02:58Z
dc.date.issued2022-07-26
dc.description.abstractWith the urban air mobility (UAM) quickly evolving, the great demand for public airborne transit and deliveries, besides creating a big market, will result in a series of technical, operational, and safety problems. This paper addresses the strategic conflict issue in low-altitude UAM operations with multi-agent reinforcement learning (MARL). Considering the difference in flight characteristics, the aircraft performance is fully integrated into the design process of strategic deconfliction components. With this concept, the multi-resolution structure for the low-altitude airspace organization, Gaussian Mixture Model (GMM) for the speed profile generation, and dynamic separation minima enable efficient UAM operations. To resolve the demand and capacity balancing (DCB) issue and the separation conflict at the strategic stage, the multi-agent asynchronous advantage actor-critic (MAA3C) framework is built with mask recurrent neural networks (RNNs). Meanwhile, variable agent number, dynamic environments, heterogeneous aircraft performance, and action selection between speed adjustment and ground delay can be well handled. Experiments conducted on a developed prototype and various scenarios indicate the obvious advantages of the constructed MAA3C in minimizing the delay cost and refining speed profiles. And the effectiveness, scalability, and stabilization of the MARL solution are ultimately demonstrated.en_UK
dc.identifier.citationHuang C, Petrunin I, Tsourdos A. (2022) Strategic conflict management for performance-based urban air mobility operations with multi-agent reinforcement learning. In: 2022 International Conference on Unmanned Aircraft Systems (ICUAS), 21-24 June 2022, Dubrovnik, Croatiaen_UK
dc.identifier.eisbn978-1-6654-0593-5
dc.identifier.eissn2575-7296
dc.identifier.isbn978-1-6654-0594-2
dc.identifier.issn2373-6720
dc.identifier.urihttps://doi.org/10.1109/ICUAS54217.2022.9836139
dc.identifier.urihttps://dspace.lib.cranfield.ac.uk/handle/1826/18274
dc.language.isoenen_UK
dc.publisherIEEEen_UK
dc.rightsAttribution-NonCommercial 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by-nc/4.0/*
dc.subjectRecurrent neural networksen_UK
dc.subjectScalabilityen_UK
dc.subjectRefiningen_UK
dc.subjectWeather forecastingen_UK
dc.subjectReinforcement learningen_UK
dc.subjectOrganizationsen_UK
dc.subjectDelaysen_UK
dc.titleStrategic conflict management for performance-based urban air mobility operations with multi-agent reinforcement learningen_UK
dc.typeConference paperen_UK

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Strategic_conflict_management-2022.pdf
Size:
3.1 MB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.63 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Staff publications (SATM)