Attention mechanism enhanced spatiotemporal-based deep learning approach for classifying barely visible impact damages in CFRP materials

Abstract

Most existing machine learning approaches for analysing thermograms mainly focus on either thermal images or pixel-wise temporal profiles of specimens. To fully leverage useful information in thermograms, this article presents a novel spatiotemporal-based deep learning model incorporating an attention mechanism. Using captured thermal image sequences, the model aims to better characterise barely visible impact damages (BVID) in composite materials caused by different impact energy levels. This model establishes the relationship between patterns of BVID in thermography and their corresponding impact energy levels by learning from spatial and temporal information simultaneously. Validation of the model using 100 composite specimens subjected to five different low-velocity impact forces demonstrates its superior performance with a classification accuracy of over 95%. The proposed approach can contribute to Structural Health Monitoring (SHM) community by enabling cause analysis of impact incidents based on predicting the potential impact energy levels. This enables more targeted predictive maintenance, which is especially significant in the aviation industry, where any impact incidents can have catastrophic consequences.