Abstract
We present a computer vision system that helps blind people find lost objects. To this end, we combine color- and SIFT-based object detection with sonification to guide the hand of the user towards potential target object locations. This way, we are able to guide the user’s attention and effectively reduce the space in the environment that needs to be explored. We verified the suitability of the proposed system in a user study.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Amazon: Mechanical turk, https://www.mturk.com/
Bigham, J.P., Jayant, C., Miller, A., White, B., Yeh, T.: VizWiz:LocateIt - enabling blind people to locate objects in their environment. In: Proc. CVPR Workshop: Computer Vision Applications for the Visually Impaired (2010)
Caperna, S., Cheng, C., et al.: A navigation and object location device for the blind. Tech. rep., University of Maryland, College Park (2009)
Collet, A., Martinez, M., Srinivasa, S.S.: The MOPED framework: Object recognition and pose estimation for manipulation. Int. J. Robotics Research 30(10), 1284–1306 (2011)
Constantinescu, A., Schultz, T.: Redundancy versus complexity in auditory displays for object localization - a pilot study. In: Proc. Int. Conf. Auditory Display (2011)
Durette, B., Louveton, N., Alleysson, D., Hrault, J.: Visuo-auditory sensory substitution for mobility assistance: Testing thevibe. In: Workshop on Computer Vision Applications for the Visually Impaired (2008)
Google Mobile: Google Goggles, http://www.google.com/mobile/goggles/
Hub, A., Diepstraten, J., Ertl, T.: Design and development of an indoor navigation and object identification system for the blind. In: Proc. Int. ACM SIGACCESS Conf. Computers and Accessibility (2004)
Schauerte, B., Fink, G.A.: Web-based learning of naturalized color models for human-machine interaction. In: Proc. Int. Conf. Digital Image Computing: Techniques and Applications (2010)
Tuytelaars, T., Mikolajczyk, K.: Local invariant feature detectors: a survey. Found. Trends. Comput. Graph. Vis. 3, 177–280 (2008)
Wenqin, S., Wei, J., Jian, C.: A machine vision based navigation system for the blind. In: Proc. Int. Conf. Computer Science and Automation Engineering (2011)
Winlock, T., Christiansen, E., Belongie, S.: Toward real-time grocery detection for the visually impaired. In: Proc. CVPR Workshop: Computer Vision Applications for the Visually Impaired (2010)
World Health Organization: Visual impairment and blindness, http://www.who.int/mediacentre/factsheets/fs282/en/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schauerte, B., Martinez, M., Constantinescu, A., Stiefelhagen, R. (2012). An Assistive Vision System for the Blind That Helps Find Lost Things. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds) Computers Helping People with Special Needs. ICCHP 2012. Lecture Notes in Computer Science, vol 7383. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31534-3_83
Download citation
DOI: https://doi.org/10.1007/978-3-642-31534-3_83
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31533-6
Online ISBN: 978-3-642-31534-3
eBook Packages: Computer ScienceComputer Science (R0)