Copyright © 2005 Elsevier Inc. All rights reserved.
A Bimodal Laser-Based Attention System
Received 24 July 2003;
References and further reading may be available for this article. To view references and further reading you must purchase this article.
Abstract
In this paper, we present a new bimodal attention system for robotic applications capable of processing data from different sensor modes simultaneously. Considering several sensor modalities is an obvious approach to regard a variety of object properties. Nevertheless, conventional attention systems only regard the processing of camera images. In contrast to these systems, the input data to our system are provided by a bimodal 3D laser scanner, mounted on top of an autonomous mobile robot. In a single 3D scan pass, the scanner yields range as well as reflectance data. Both data modes are illumination independent, yielding a robust approach that enables all day operation. Data from both laser modes are fed into our attention system built on principles of one of the standard models of visual attention by Koch and Ullman. The system computes conspicuities of both modes in parallel and fuses them into one saliency map. The focus of attention is directed to the most salient points in this map sequentially. We present results on recorded scans of indoor and outdoor scenes showing the respective advantages of the sensor modalities enabling the mode-specific detection of different object properties. Furthermore, we show as an application of the attention system the recognition of objects for building semantic 3D maps of the robot’s environment.
Keywords: Visual attention; Saliency detection; Bimodal sensor fusion; 3D laser scanner
Article Outline
- 1. Introduction
- 2. State of the art
- 2.1. Visual attention models
- 2.2. Laser scanners
- 3. The bimodal 3D laser scanner
- 4. The Bimodal Laser-Based Attention System
- 4.1. Feature computations
- 4.2. Fusing saliencies
- 4.3. The focus of attention
- 5. Results
- 5.1. General performance
- 5.2. The two laser modes
- 5.3. Camera versus laser
- 6. An application scenario: semantic map building with Kurt3D
- 7. Discussion and outlook
- 7.1. Summary
- 7.2. Strengths and limitations
- 7.3. Future work
- Acknowledgements
- References






E-mail Article
Add to my Quick Links

Cited By in Scopus (3)






