Detecting text in natural scene images with conditional clustering and convolution neural network

Anna Zhu; Guoyou Wang; Yangbo Dong; Brian Kenji Iwana

doi:10.1117/1.JEI.24.5.053019

29 September 2015 Detecting text in natural scene images with conditional clustering and convolution neural network

Anna Zhu, Guoyou Wang, Yangbo Dong, Brian Kenji Iwana

Author Affiliations +

Journal of Electronic Imaging, Vol. 24, Issue 5, 053019 (September 2015). https://doi.org/10.1117/1.JEI.24.5.053019

Abstract

We present a robust method of detecting text in natural scenes. The work consists of four parts. First, automatically partition the images into different layers based on conditional clustering. The clustering operates in two sequential ways. One has a constrained clustering center and conditional determined cluster numbers, which generate small-size subregions. The other has fixed cluster numbers, which generate full-size subregions. After the clustering, we obtain a bunch of connected components (CCs) in each subregion. In the second step, the convolutional neural network (CNN) is used to classify those CCs to character components or noncharacter ones. The output score of the CNN can be transferred to the postprobability of characters. Then we group the candidate characters into text strings based on the probability and location. Finally, we use a verification step. We choose a multichannel strategy to evaluate the performance on the public datasets: ICDAR2011 and ICDAR2013. The experimental results demonstrate that our algorithm achieves a superior performance compared with the state-of-the-art text detection algorithms.

Citation Download Citation

Anna Zhu, Guoyou Wang, Yangbo Dong, and Brian Kenji Iwana "Detecting text in natural scene images with conditional clustering and convolution neural network," Journal of Electronic Imaging 24(5), 053019 (29 September 2015). https://doi.org/10.1117/1.JEI.24.5.053019

Published: 29 September 2015

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available