Evaluating the influence of simulation fidelity in infrared sensor modeling on machine learning performance using explainable AI

Justin T. Carrillo; Barbara N. Pilate; Andrew C. Trautz; Matthew D. Bray; Jonathan D. Sherburn; Madeline S. Karr; Orie M. Cecil; Matthew W. Farthing

doi:10.1117/12.3013428

7 June 2024 Evaluating the influence of simulation fidelity in infrared sensor modeling on machine learning performance using explainable AI

Justin T. Carrillo, Barbara N. Pilate, Andrew C. Trautz, Matthew D. Bray, Jonathan D. Sherburn, Madeline S. Karr, Orie M. Cecil, Matthew W. Farthing

Author Affiliations +

Proceedings Volume 13035, Synthetic Data for Artificial Intelligence and Machine Learning: Tools, Techniques, and Applications II; 1303513 (2024) https://doi.org/10.1117/12.3013428
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

The increasing deployment of AI in critical sectors necessitates advancements in explainable AI (XAI) to ensure transparency and trustworthiness of AI decisions. This paper introduces a novel methodology that leverages the Virtual Environmental Simulation for Physics-based Analysis (VESPA) framework in conjunction with Randomized Input Sampling for Explanation (RISE) to provide enhanced explainability for AI models, particularly in complex simulated environments. VESPA, known for its high-fidelity, physics-based simulations across diverse conditions, generates a vast dataset encompassing various sensor configurations, environmental factors, and material responses. This dataset serves as the foundation for applying RISE, a model-agnostic approach that generates pixel-level importance maps by probing the AI model with masked versions of the input images. Through this integration, we offer a systematic way to visualize and understand the influence of different environmental elements on AI decisions. Our approach not only sheds light on the ”black box” of AI decision-making processes but also provides a scalable framework for evaluating AI models’ robustness and reliability under a wide array of simulated scenarios.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Justin T. Carrillo, Barbara N. Pilate, Andrew C. Trautz, Matthew D. Bray, Jonathan D. Sherburn, Madeline S. Karr, Orie M. Cecil, and Matthew W. Farthing "Evaluating the influence of simulation fidelity in infrared sensor modeling on machine learning performance using explainable AI", Proc. SPIE 13035, Synthetic Data for Artificial Intelligence and Machine Learning: Tools, Techniques, and Applications II, 1303513 (7 June 2024); https://doi.org/10.1117/12.3013428

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available