CNN-fusion architecture with visual and thermographic images for object detection

dc.contributor.authorAdiuku, Amaka
dc.contributor.authorAvdelidis, Nicolas Peter
dc.contributor.authorTang, Gilbert
dc.contributor.authorPlastropoulos, Angelos
dc.contributor.authorPerinpanayagam, Suresh
dc.date.accessioned2023-07-20T13:08:00Z
dc.date.available2023-07-20T13:08:00Z
dc.date.issued2023-06-12
dc.description.abstractMobile robots performing aircraft visual inspection play a vital role in the future automated aircraft maintenance, repair and overhaul (MRO) operations. Autonomous navigation requires understanding the surroundings to automate and enhance the visual inspection process. The current state of neural network (NN) based obstacle detection and collision avoidance techniques are suitable for well-structured objects. However, their ability to distinguish between solid obstacles and low-density moving objects is limited, and their performance degrades in low-light scenarios. Thermal images can be used to complement the low-light visual image limitations in many applications, including inspections. This work proposes a Convolutional Neural Network (CNN) fusion architecture that enables the adaptive fusion of visual and thermographic images. The aim is to enhance autonomous robotic systems’ perception and collision avoidance in dynamic environments. The model has been tested with RGB and thermographic images acquired in Cranfield’s University hangar, which hosts a Boeing 737-400 and TUI hangar. The experimental results prove that the fusion-based CNN framework increases object detection accuracy compared to conventional models.en_UK
dc.identifier.citationAdiuku N, Avdelidis NP, Tang G, et al., (2023) CNN-fusion architecture with visual and thermographic images for object detection. In: SPIE Defense + Commercial Sensing, 30 April - 4 May 2023, Orlando, Florida, Volume 12536, Thermosense: Thermal Infrared Applications XLVen_UK
dc.identifier.issn0277-786X
dc.identifier.urihttps://doi.org/10.1117/12.2665984
dc.identifier.urihttps://dspace.lib.cranfield.ac.uk/handle/1826/20022
dc.language.isoenen_UK
dc.publisherSPIEen_UK
dc.rightsAttribution-NonCommercial 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by-nc/4.0/*
dc.titleCNN-fusion architecture with visual and thermographic images for object detectionen_UK
dc.typeConference paperen_UK
dcterms.dateAccepted2023-06-12

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
CNN-fusion_architecture-2023.pdf
Size:
7.43 MB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.63 KB
Format:
Item-specific license agreed upon to submission
Description: