5 October 2023 Deformable element-wise dynamic convolution
Wonjik Kim, Masayuki Tanaka, Yoko Sasaki, Masatoshi Okutomi
Author Affiliations +
Abstract

The shape and values of a typical static convolution kernel remain fixed once the network is trained. Recently, dynamic convolutions were proposed to change the kernel’s values depending on the input during the test phase. We aim to extend the concept of dynamic convolutions by introducing an element-wise dynamic convolution approach. This method enables adaptive changes in kernel values for each output data element. Furthermore, a deformable element-wise dynamic convolution is proposed to enable simultaneous changes in kernel shape and value. The proposed deformable dynamic convolution is compatible with the static convolution in terms of input–output relationships. The capability of existing network architectures can be enhanced by replacing the static convolution with the suggested deformable dynamic convolution. Extensive experiments demonstrate that the proposed deformable dynamic convolution can improve the network performance in various computer vision tasks, including image classification and semantic segmentation.

© 2023 SPIE and IS&T
Wonjik Kim, Masayuki Tanaka, Yoko Sasaki, and Masatoshi Okutomi "Deformable element-wise dynamic convolution," Journal of Electronic Imaging 32(5), 053029 (5 October 2023). https://doi.org/10.1117/1.JEI.32.5.053029
Received: 7 June 2023; Accepted: 13 September 2023; Published: 5 October 2023
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Convolution

Deformation

Education and training

Image segmentation

Image classification

Object detection

Semantics

Back to Top