Perceptually relevant grouping of image tokens on the basis of constraint propagation from local binary patterns

Sadaf Iqbal Behlim; Tahir Qasim Syed; Muhammad Yameen Malik; Vincent Vigneron

doi:10.1117/1.JEI.25.6.061616

29 November 2016 Perceptually relevant grouping of image tokens on the basis of constraint propagation from local binary patterns

Sadaf Iqbal Behlim, Tahir Qasim Syed, Muhammad Yameen Malik, Vincent Vigneron

Author Affiliations +

Journal of Electronic Imaging, Vol. 25, Issue 6, 061616 (November 2016). https://doi.org/10.1117/1.JEI.25.6.061616

Abstract

Grouping image tokens is an intermediate step needed to arrive at meaningful image representation and summarization. Usually, perceptual cues, for instance, gestalt properties inform token grouping. However, they do not take into account structural continuities that could be derived from other tokens belonging to similar structures irrespective of their location. We propose an image representation that encodes structural constraints emerging from local binary patterns (LBP), which provides a long-distance measure of similarity but in a structurally connected way. Our representation provides a grouping of pixels or larger image tokens that is free of numeric similarity measures and could therefore be extended to nonmetric spaces. The representation lends itself nicely to ubiquitous image processing applications such as connected component labeling and segmentation. We test our proposed representation on the perceptual grouping or segmentation task on the popular Berkeley segmentation dataset (BSD500) that with respect to human segmented images achieves an average F-measure of 0.559. Our algorithm achieves a high average recall of 0.787 and is therefore well-suited to other applications such as object retrieval and category-independent object recognition. The proposed merging heuristic based on levels of singular tree component has shown promising results on the BSD500 dataset and currently ranks 12th among all benchmarked algorithms, but contrary to the others, it requires no data-driven training or specialized preprocessing.

Citation Download Citation

Sadaf Iqbal Behlim, Tahir Qasim Syed, Muhammad Yameen Malik, and Vincent Vigneron "Perceptually relevant grouping of image tokens on the basis of constraint propagation from local binary patterns," Journal of Electronic Imaging 25(6), 061616 (29 November 2016). https://doi.org/10.1117/1.JEI.25.6.061616

Published: 29 November 2016

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $24.00

Non-members: $28.00 ADD TO CART

JOURNAL ARTICLE
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image segmentation

Binary data

Image processing algorithms and systems

Detection and tracking algorithms

Visualization

Image processing

Associative arrays

Show All Keywords

Keywords/Phrases

Search In:

Publication Years