Improving neural network performance on SIMD architectures

Elena Limonova; Dmitry Ilin; Dmitry Nikolaev

doi:10.1117/12.2228594

8 December 2015 Improving neural network performance on SIMD architectures

Elena Limonova, Dmitry Ilin, Dmitry Nikolaev

Proceedings Volume 9875, Eighth International Conference on Machine Vision (ICMV 2015); 98750L (2015) https://doi.org/10.1117/12.2228594
Event: Eighth International Conference on Machine Vision, 2015, Barcelona, Spain

Abstract

Neural network calculations for the image recognition problems can be very time consuming. In this paper we propose three methods of increasing neural network performance on SIMD architectures. The usage of SIMD extensions is a way to speed up neural network processing available for a number of modern CPUs. In our experiments, we use ARM NEON as SIMD architecture example. The first method deals with half float data type for matrix computations. The second method describes fixed-point data type for the same purpose. The third method considers vectorized activation functions implementation. For each method we set up a series of experiments for convolutional and fully connected networks designed for image recognition task.

Citation Download Citation

Elena Limonova, Dmitry Ilin, and Dmitry Nikolaev "Improving neural network performance on SIMD architectures", Proc. SPIE 9875, Eighth International Conference on Machine Vision (ICMV 2015), 98750L (8 December 2015); https://doi.org/10.1117/12.2228594

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available