Special Section on Perceptually Driven Visual Information Analysis

Perceptually relevant grouping of image tokens on the basis of constraint propagation from local binary patterns

[+] Author Affiliations
Sadaf Iqbal Behlim, Tahir Qasim Syed, Muhammad Yameen Malik

Visual Analytics Lab

National University of Computer and Emerging Sciences, Department of Computer Science, St-4, Sector 17-D, Shah Latif Town, National Highway, Karachi 75030 Pakistan

Vincent Vigneron

Visual Analytics Lab

Université d’Évry Val d’Essonne, 40 rue du Pelvoux, Evry 91020, France

J. Electron. Imaging. 25(6), 061616 (Nov 29, 2016). doi:10.1117/1.JEI.25.6.061616
History: Received April 1, 2016; Accepted October 27, 2016
Text Size: A A A

Abstract.  Grouping image tokens is an intermediate step needed to arrive at meaningful image representation and summarization. Usually, perceptual cues, for instance, gestalt properties inform token grouping. However, they do not take into account structural continuities that could be derived from other tokens belonging to similar structures irrespective of their location. We propose an image representation that encodes structural constraints emerging from local binary patterns (LBP), which provides a long-distance measure of similarity but in a structurally connected way. Our representation provides a grouping of pixels or larger image tokens that is free of numeric similarity measures and could therefore be extended to nonmetric spaces. The representation lends itself nicely to ubiquitous image processing applications such as connected component labeling and segmentation. We test our proposed representation on the perceptual grouping or segmentation task on the popular Berkeley segmentation dataset (BSD500) that with respect to human segmented images achieves an average F-measure of 0.559. Our algorithm achieves a high average recall of 0.787 and is therefore well-suited to other applications such as object retrieval and category-independent object recognition. The proposed merging heuristic based on levels of singular tree component has shown promising results on the BSD500 dataset and currently ranks 12th among all benchmarked algorithms, but contrary to the others, it requires no data-driven training or specialized preprocessing.

Figures in this Article
© 2016 SPIE and IS&T

Citation

Sadaf Iqbal Behlim ; Tahir Qasim Syed ; Muhammad Yameen Malik and Vincent Vigneron
"Perceptually relevant grouping of image tokens on the basis of constraint propagation from local binary patterns", J. Electron. Imaging. 25(6), 061616 (Nov 29, 2016). ; http://dx.doi.org/10.1117/1.JEI.25.6.061616


Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

PubMed Articles
Advertisement


 

  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.