Swarm decoys deployment for missile deceive using multi-agent reinforcement learning

Date

2024-06-19

Supervisor/s

Journal Title

Journal ISSN

Volume Title

Publisher

IEEE

Department

Type

Conference paper

ISSN

2373-6720

Format

Free to read from

Citation

Bildik E, Tsourdos A, Perrusquía A, Inalhan G. (2024), Swarm decoys deployment for missile deceive using multi-agent reinforcement learning. In: 2024 International Conference on Unmanned Aircraft Systems (ICUAS), 04-07 June 2024, Crete, Greece, pp. 256-263

Abstract

The development of novel radar seeker technologies has improved the hit-to-kill capability of missiles. This is particularly worrying in safety and security domains that need the design of appropriate countermeasures against adversarial missiles to ensure protection of naval facilities. This paper aims to contribute in these domains by developing an artificial intelligence (AI) based decoy deployment system capable of deceiving the missile threat. Here, a Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm is developed to maximise the distance between the target and the missile by learning the optimal/near optimal route planning of the six decoys to reach the global mission. As case study, the deployment of six decoys from the top deck of the main platform is assumed. The decoys are launched from the platform at the initial phase of the mission, and they establish a leader-follower formation that enhances the signal strength of the swarm decoys. The reward function is designed to guarantee a triangular formation configuration for swarm decoys. The reported results show that the proposed approach is capable to deceive the missile threat and has the potential to be integrated in current naval platforms.

Description

Software Description

Software Language

Github

Keywords

Missiles, Reinforcement learning, Radar, Radar countermeasures, Planning, Security, Protection

DOI

10.1109/ICUAS60882.2024.10556889

Rights

Attribution 4.0 International

Relationships

Relationships

Supplements

Funder/s

Engineering and Physical Sciences Research Council (EPSRC)