ACD-G: Enhancing autonomous cyber defense agent generalization through graph embedded network representation

dc.contributor.authorCollyer, Josh
dc.contributor.authorAndrew, Alex
dc.contributor.authorHodges, Duncan
dc.date.accessioned2022-08-08T09:24:43Z
dc.date.available2022-08-08T09:24:43Z
dc.date.issued2022-07-23
dc.descriptionPresented at ML4Cyber Workshop : not included in the Proceedings of the 39th International Conference on Machine Learningen_UK
dc.description.abstractThe adoption of autonomous cyber defense agents within real-world contexts requires them to be able to cope with differences between their training and target environments, bridging the simulation to real gap to provide robust, generalized defensive responses. Whilst the simulation to real gap has been studied in-depth across domains such as robotics, to date there has been minimal research considering generalizability in the context of cyber defense agents and how differences in observation space could enhance agent generalizability when placed into environments that differ from the training environment. Within this paper, we propose a method of enhancing agent generalizability and performance within unseen environments by integrating a graph embedded network representation into the agent’s observation space. We then compare agent performance with and without a graph embedded network representation based observation space within a series of randomized cyber defense simulations. We find that there is a trade-off between the effectiveness of the graph embedding representation and the complexity of the graph, in terms of node count and number of edges.en_UK
dc.identifier.citationCollyer J, Andrew A, Hodges D. (2022) ACD-G: Enhancing autonomous cyber defense agent generalization through graph embedded network representation. In: 39th International Conference on Machine Learning (ICML 2022), 17-23 July 2022, Baltimore, Maryland, USA. (ML4Cyber workshop)en_UK
dc.identifier.urihttps://icml.cc/
dc.identifier.urihttps://dspace.lib.cranfield.ac.uk/handle/1826/18288
dc.language.isoenen_UK
dc.publisherInternational Conference on Machine Learningen_UK
dc.rightsAttribution-NonCommercial 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by-nc/4.0/*
dc.titleACD-G: Enhancing autonomous cyber defense agent generalization through graph embedded network representationen_UK
dc.typeConference paperen_UK

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
ACD-G-Enhancing_autonomous_cyber_defense-2022.pdf
Size:
296.27 KB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.63 KB
Format:
Item-specific license agreed upon to submission
Description: