Progress in building a cognitive vision system

D. Paul Benjamin; Damian Lyons; Hong Yue

doi:10.1117/12.2229551

3 August 2016 Progress in building a cognitive vision system

D. Paul Benjamin, Damian Lyons, Hong Yue

Proceedings Volume 9872, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2016; 98720D (2016) https://doi.org/10.1117/12.2229551
Event: SPIE Commercial + Scientific Sensing and Imaging, 2016, Baltimore, MD, United States

Abstract

We are building a cognitive vision system for mobile robots that works in a manner similar to the human vision system, using saccadic, vergence and pursuit movements to extract information from visual input. At each fixation, the system builds a 3D model of a small region, combining information about distance, shape, texture and motion to create a local dynamic spatial model. These local 3D models are composed to create an overall 3D model of the robot and its environment. This approach turns the computer vision problem into a search problem whose goal is the acquisition of sufficient spatial understanding for the robot to succeed at its tasks. The research hypothesis of this work is that the movements of the robot’s cameras are only those that are necessary to build a sufficiently accurate world model for the robot’s current goals. For example, if the goal is to navigate through a room, the model needs to contain any obstacles that would be encountered, giving their approximate positions and sizes. Other information does not need to be rendered into the virtual world, so this approach trades model accuracy for speed.

Citation Download Citation

D. Paul Benjamin, Damian Lyons, and Hong Yue "Progress in building a cognitive vision system", Proc. SPIE 9872, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2016, 98720D (3 August 2016); https://doi.org/10.1117/12.2229551

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

3D modeling

Visual process modeling

Visualization

Data modeling

Motion models

Sensors

Cognitive modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years