Comparing visual co-registration methods for UAV and satellite RGB imagery with semantic filtering of key points

Trevor Bajkowski; J. Alex Hurt; Christopher Scully; James Keller; Samantha Carley; Grant Scott; Stanton Price

doi:10.1117/12.3013504

7 June 2024 Comparing visual co-registration methods for UAV and satellite RGB imagery with semantic filtering of key points

Trevor Bajkowski, J. Alex Hurt, Christopher Scully, James Keller, Samantha Carley, Grant Scott, Stanton Price

Author Affiliations +

Proceedings Volume 13051, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications VI; 1305106 (2024) https://doi.org/10.1117/12.3013504
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

Image-to-image correspondence is important in numerous remote sensing applications ranging from image mosaicking to 3D reconstruction. While many local features used for these methods aim for robustness to changes in viewpoint/illumination, recent studies have suggested that traditional feature extractors may lack stability in multi-temporal applications. We have discovered that this is especially true in multi-modal sensor contexts, such as corresponding high-resolution UAS images to broad area overhead imagery (e.g., satellite images). This paper explores the performance of various local feature extraction methods as they pertain to image-to-image correspondence in scenes captured at different times, with different sensors. Experiments here specifically evaluate co-registration between low-altitude, nadir UAV frames, and imagery collected from satellite sources. Due to challenges in the localization of imagery with significantly different resolutions, spatial extents, and spectral characteristics, two further studies are presented beyond baseline evaluation. First, images undergo histogram matching to better understand how the discussed algorithms’ performance changes as image characteristics become more or less similar. Secondly, experiments are performed where key point feature matches are refined with information taken from segmentation maps inferred by pre-trained segmentation models. These methods are evaluated in regions where satellite and UAV images have been collected at different times, with spatial correspondences being hand-labeled.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Trevor Bajkowski, J. Alex Hurt, Christopher Scully, James Keller, Samantha Carley, Grant Scott, and Stanton Price "Comparing visual co-registration methods for UAV and satellite RGB imagery with semantic filtering of key points", Proc. SPIE 13051, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications VI, 1305106 (7 June 2024); https://doi.org/10.1117/12.3013504

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available