Radar-camera fusion for ground-based perception of small UAV in urban air mobility

Date published

2023-07-27

Free to read from

Supervisor/s

Journal Title

Journal ISSN

Volume Title

Publisher

IEEE

Department

Type

Conference paper

ISSN

2575-7482

Format

Citation

Huang C, Petrunin I, Tsourdos A. (2023) Radar-camera fusion for ground-based perception of small UAV in urban air mobility. In: 2023 IEEE International Workshop on Metrology for AeroSpace, 19-21 June 2023, Milan, Italy

Abstract

The resilient surveillance of cooperative and non-cooperative aerial targets is critical for the safety and security of urban air mobility operations. Accurate detection, tracking, and trajectory prediction are essential to the subsequent tasks, e.g. tactical conflict prediction and resolution. Meanwhile, the combination of radar and camera is a classic option to provide perception services in different challenging environments. In this paper, a deep semantic association network is proposed for building relationships between the image detections and raw radar points, which then contributes to subsequent tasks, e.g. detecting, tracking, and predicting the small UAV with networked radar and camera systems. Various flight trials are conducted for collecting multi-sensor data, finally, training and testing results on this dataset demonstrate the outstanding performance of the proposed fusion workflow in comparison to single-sensor performance. At the same time, the 2D predictions in the sensor network are reconstructed to 3D trajectories for comparison and also reveal the improvements of the radar-camera fusion approach.

Description

Software Description

Software Language

Github

Keywords

DOI

Rights

Attribution-NonCommercial 4.0 International

Relationships

Relationships

Supplements

Funder/s