Accumulating confidence for deep neural network object detections and semantic segmentations in sequential UAS imagery through spatiotemporal feature correspondences generated from SfM techniques

Trevor Bajkowski; J. Alex Hurt; David Huangal; Jeffrey Dale; James Keller; Grant Scott; Stanton Price

doi:10.1117/12.2585905

12 April 2021 Accumulating confidence for deep neural network object detections and semantic segmentations in sequential UAS imagery through spatiotemporal feature correspondences generated from SfM techniques

Trevor Bajkowski, J. Alex Hurt, David Huangal, Jeffrey Dale, James Keller, Grant Scott, Stanton Price

Author Affiliations +

Proceedings Volume 11746, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications III; 117462V (2021) https://doi.org/10.1117/12.2585905
Event: SPIE Defense + Commercial Sensing, 2021, Online Only

Conference Poster

Abstract

Unmanned aerial systems (UAS) equipped with visual sensors can be quickly deployed to map novel regions, a useful ability in GPS-denied regions, search and rescue operations, disaster response, and defense. Assisted by such a UAS, a ground vehicle could safely navigate a given region, aware of the potential hazards seen from airborne sensors. Here, we propose a pipeline for identifying and mapping maneuverable regions and objects pertinent to safe navigation (cars, barriers, etc.) in sequential imagery captured from UAS sensors. First we use a semantic labeling deep neural network for identifying roads, an object detection neural network for detecting hazards of known classes, and a model that uses linear features to detect potential road hazards in labeled road pixels. This visual evidence regarding maneuverability is collected across temporally-sequential images and is spatially fused into a single map via visual feature correspondence. Fusion of road evidence is done on a per-pixel basis while clustering techniques are used to find objects given a set of co-mapped detections. We show the use of this pipeline for the quick and automated creation of maps that contain useful information with regard to safe navigation of a region captured by UAS sensors. These techniques serve as a part in the development of a model for safe, ecient navigation of GPS-denied/rapidly changing regions through the use of UAS-enabled mapping.

Conference Presentation

Citation Download Citation

Trevor Bajkowski, J. Alex Hurt, David Huangal, Jeffrey Dale, James Keller, Grant Scott, and Stanton Price "Accumulating confidence for deep neural network object detections and semantic segmentations in sequential UAS imagery through spatiotemporal feature correspondences generated from SfM techniques", Proc. SPIE 11746, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications III, 117462V (12 April 2021); https://doi.org/10.1117/12.2585905

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available