Image enhancement towards object detection via foreground salience guidance

XiaoYu Xu; Wang Luo; Xin Liu; Xian Yu; Chao Wu; Jun Xie

doi:10.1117/12.2655848

12 January 2023 Image enhancement towards object detection via foreground salience guidance

XiaoYu Xu, Wang Luo, Xin Liu, Xian Yu, Chao Wu, Jun Xie

Proceedings Volume 12509, Third International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI 2022); 125091S (2023) https://doi.org/10.1117/12.2655848
Event: Third International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI 2022), 2022, Guangzhou, China

Abstract

Although the schemes based on deep learning applied to car autonomous driving show good performance in object detection un- der condition of normal weather, there are many difficulties in complex weather scenarios. When facing heavy fog interference, the general solution is to design two networks for image enhancement and object detection respectively, which means one dehazes the foggy image and the other detects the dehazed image. But this may bring two problems: 1. After the image is dehazed, it may cause some distortion of the image, especially the areas that are unlikely to be reconstructed due to severe haze; 2. For object detection, the interesting part of an image is the nearby area where the object is located. The rest background area that is far away from the object may not help. In response to the above two problems, in this work we proposed to use foggy images except whose area of object bounding box is clear as ground-truth in the training of image enhancement. In other words, only the key area around the object is clear in order to guide the network to perform image dehazing operations focusing on the target areas and finally improves the following object detection performance. By using U-net for image dehazing on the Foggy Cityscapes dataset and Faster R- CNN network with the same structure for object detection, the average accuracy mAP is increased by % compared to normal training, which demonstrates the effectiveness of our approach on foggy image object detection.

Citation Download Citation

XiaoYu Xu, Wang Luo, Xin Liu, Xian Yu, Chao Wu, and Jun Xie "Image enhancement towards object detection via foreground salience guidance", Proc. SPIE 12509, Third International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI 2022), 125091S (12 January 2023); https://doi.org/10.1117/12.2655848

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
5 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image enhancement

Air contamination

Fiber optic gyroscopes

Atmospheric modeling

Image segmentation

Atmospheric physics

Light scattering

Show All Keywords

Keywords/Phrases

Search In:

Publication Years