Drone segmentation and orientation detection using a SPAD array camera

Stirling Scholes; Alice Ruget; Germán Mora Martín; Feng Zhu; Istvan Gyongy; Robert K. Henderson; Jonathan Leach

doi:10.1117/12.2618748

30 May 2022 Drone segmentation and orientation detection using a SPAD array camera

Stirling Scholes, Alice Ruget, Germán Mora Martín, Feng Zhu, Istvan Gyongy, Robert K. Henderson, Jonathan Leach

Proceedings Volume 12089, Advanced Photon Counting Techniques XVI; 1208906 (2022) https://doi.org/10.1117/12.2618748
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

The recent development of single-photon avalanche diode (SPADs) arrays as imaging sensors with both picosecond binning capabilities and single photon sensitivity has led to the rapid development of time-of-flight imaging systems. When used in conjunction with a synchronised light source these sensors produce a 3D image. Here, we apply this 3D imaging ability to the problem of drone identification, orientation, and, segmentation. The proliferation of semi-autonomous aerial multi-copters i.e. drones, has raised concerns over the ability of existing aerial detection systems to accurately characterise such vehicles. Here, we fuse the 3D imaging of SPAD sensors with the classification capabilities of a bespoke convolutional neural network (CNN) into a system capable of determining drone pose in flight. To overcome the lack of publicly available training data we generate a photorealistic dataset to enable the training of our network. After training, we are able to predict the roll, pitch, and yaw of the several different drone types with an accuracy greater than 90%.

Conference Presentation

Citation Download Citation

Stirling Scholes, Alice Ruget, Germán Mora Martín, Feng Zhu, Istvan Gyongy, Robert K. Henderson, and Jonathan Leach "Drone segmentation and orientation detection using a SPAD array camera", Proc. SPIE 12089, Advanced Photon Counting Techniques XVI, 1208906 (30 May 2022); https://doi.org/10.1117/12.2618748

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available