Comparing hand-crafted and learned key-point feature extraction for co-location of sequential low-altitude UAS video frames

Trevor Bajkowski; J. Alex Hurt; Jeffrey Dale; James Keller; Grant Scott; Stanton Price

doi:10.1117/12.2663586

12 June 2023 Comparing hand-crafted and learned key-point feature extraction for co-location of sequential low-altitude UAS video frames

Trevor Bajkowski, J. Alex Hurt, Jeffrey Dale, James Keller, Grant Scott, Stanton Price

Author Affiliations +

Proceedings Volume 12538, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications V; 1253817 (2023) https://doi.org/10.1117/12.2663586
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Abstract

The ability to accurately monitor the position of an object or group of objects in some video sequence can be of high value when making decisions with respect to security, maneuverability, ecology, and infrastructure. Efforts from our previous work^{1, 2} provided evidence that in overhead video, a system’s ability to perform this tracking could be greatly enhanced through effective and segmented calculation of frame-to-frame spatial correspondences. We now continue the investigations began by this previous work (wherein frames and their detections are co-mapped) through a case study wherein hand-crafted and machine learning (ML) approaches for co-registration of video frames are reviewed and compared. First, the merits and shortcomings of hand-crafted algorithms, ML models, and hybrid approaches are discussed for key-point detection and key-point description. Modifications to feature matching and homography estimation are discussed as well, and following this, a more recently published class of co-registration involving “detector-less” correspondence is outlined. These approaches are applied and evaluated on four overhead image sequences with ground-truth corresponding to object detection locations only. Because of this lack of ground control points for evaluation, co-mapped centroids of stationary objects are used to generate an accuracy metric for the various mapping approaches. Further, given the value of mapping and tracking in real-time contexts, this notion of accuracy is compared to computation time so that trade-offs in temporal and spatial performance can be better understood.

Conference Presentation

Citation Download Citation

Trevor Bajkowski, J. Alex Hurt, Jeffrey Dale, James Keller, Grant Scott, and Stanton Price "Comparing hand-crafted and learned key-point feature extraction for co-location of sequential low-altitude UAS video frames", Proc. SPIE 12538, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications V, 1253817 (12 June 2023); https://doi.org/10.1117/12.2663586

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available