ScienceDirect® Home Skip Main Navigation Links
You have guest access to ScienceDirect. Find out more.
 
Home
Browse
My Settings
Alerts
Help
 Quick Search
 Search tips (Opens new window)
    Clear all fields    
Computer Vision and Image Understanding
Volume 100, Issues 1-2, October-November 2005, Pages 124-151
Special Issue on Attention and Performance in Computer Vision
 
Font Size: Decrease Font Size  Increase Font Size
 Abstract - selected
Article
Purchase PDF (1169 K)

 
 
 
Related Articles in ScienceDirect
View More Related Articles
 
View Record in Scopus
 
doi:10.1016/j.cviu.2004.08.005    How to Cite or Link Using DOI (Opens New Window)
Copyright © 2005 Elsevier Inc. All rights reserved.

A Bimodal Laser-Based Attention System

Simone Frintropa, Corresponding Author Contact Information, E-mail The Corresponding Author, E-mail The Corresponding Author, Erich Romea, E-mail The Corresponding Author, E-mail The Corresponding Author, Andreas Nüchterb, E-mail The Corresponding Author, E-mail The Corresponding Author and Hartmut Surmanna, E-mail The Corresponding Author, E-mail The Corresponding Author

aFraunhofer Institut für Autonome Intelligente Systeme, Schloss Birlinghoven, 53754 Sankt Augustin, Germany bUniversity of Osnabrück, Institute for Computer Science, Knowledge-Based Systems Research Group, Albrechtstraße 28, D-49069 Osnabrück, Germany

Received 24 July 2003; 
accepted 30 August 2004. 
Available online 6 July 2005.

Purchase the full-text article



References and further reading may be available for this article. To view references and further reading you must purchase this article.

Abstract

In this paper, we present a new bimodal attention system for robotic applications capable of processing data from different sensor modes simultaneously. Considering several sensor modalities is an obvious approach to regard a variety of object properties. Nevertheless, conventional attention systems only regard the processing of camera images. In contrast to these systems, the input data to our system are provided by a bimodal 3D laser scanner, mounted on top of an autonomous mobile robot. In a single 3D scan pass, the scanner yields range as well as reflectance data. Both data modes are illumination independent, yielding a robust approach that enables all day operation. Data from both laser modes are fed into our attention system built on principles of one of the standard models of visual attention by Koch and Ullman. The system computes conspicuities of both modes in parallel and fuses them into one saliency map. The focus of attention is directed to the most salient points in this map sequentially. We present results on recorded scans of indoor and outdoor scenes showing the respective advantages of the sensor modalities enabling the mode-specific detection of different object properties. Furthermore, we show as an application of the attention system the recognition of objects for building semantic 3D maps of the robot’s environment.

Keywords: Visual attention; Saliency detection; Bimodal sensor fusion; 3D laser scanner

Article Outline

1. Introduction
2. State of the art
2.1. Visual attention models
2.2. Laser scanners
3. The bimodal 3D laser scanner
3.1. Rendering images from laser data
3.2. Laser data versus stereo vision
4. The Bimodal Laser-Based Attention System
4.1. Feature computations
4.2. Fusing saliencies
4.3. The focus of attention
5. Results
5.1. General performance
5.2. The two laser modes
5.3. Camera versus laser
6. An application scenario: semantic map building with Kurt3D
7. Discussion and outlook
7.1. Summary
7.2. Strengths and limitations
7.3. Future work
Acknowledgements
References
















Computer Vision and Image Understanding
Volume 100, Issues 1-2, October-November 2005, Pages 124-151
Special Issue on Attention and Performance in Computer Vision
 
Home
Browse
My Settings
Alerts
Help
Elsevier.com (Opens new window)
About ScienceDirect  |  Contact Us  |  Information for Advertisers  |  Terms & Conditions  |  Privacy Policy
Copyright © 2008 Elsevier B.V. All rights reserved. ScienceDirect® is a registered trademark of Elsevier B.V.