Object detection on resource-constrained platforms using a configurable ensemble of detectors

Eung-Joo Lee; Alexander Mattingly; Jing Xie; Heesung Kwon; Shuvra S. Bhattacharyya

doi:10.1117/12.2618342

27 May 2022 Object detection on resource-constrained platforms using a configurable ensemble of detectors

Eung-Joo Lee, Alexander Mattingly, Jing Xie, Heesung Kwon, Shuvra S. Bhattacharyya

Proceedings Volume 12102, Real-Time Image Processing and Deep Learning 2022; 121020C (2022) https://doi.org/10.1117/12.2618342
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

Object detection from high resolution images is increasingly used for many important application areas of defense and commercial sensing. However, object detection on high resolution images requires intensive computation, which makes it challenging to apply on resource-constrained platforms such as in edge-cloud deployments. In this work, we present a novel system for streamlined object detection on edge-cloud platforms. The system integrates multiple object detectors into an ensemble to improve detection accuracy and robustness. The subset of object detectors that is active in the ensemble can be changed dynamically to provide adaptively adjusted trade-offs among object detection accuracy, real-time performance, and energy consumption. Such adaptivity can be of great utility for resource-constrained deployment to edge-cloud environments, where the execution time and energy cost of full-accuracy processing may be excessive if utilized all of the time. To promote efficient and reliable implementation on resource-constrained devices, the proposed system design employs principles of signal processing oriented data ow modeling along with pipelining of data ow subsystems and integration on top of optimized, off-the-shelf software components for lower level processing. The effectiveness of the proposed object detection system is demonstrated through extensive experiments involving the Unmanned Aerial Vehicle Benchmark and KITTI Vision Benchmark Suite. While the proposed system is developed for the specific problem of object detection, we envision that the underlying design methodology, which integrates adaptive ensemble processing with data ow modeling and optimized lower level libraries, is applicable to a wide range of applications in defense and commercial sensing.

Conference Presentation

Citation Download Citation

Eung-Joo Lee, Alexander Mattingly, Jing Xie, Heesung Kwon, and Shuvra S. Bhattacharyya "Object detection on resource-constrained platforms using a configurable ensemble of detectors", Proc. SPIE 12102, Real-Time Image Processing and Deep Learning 2022, 121020C (27 May 2022); https://doi.org/10.1117/12.2618342

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available