Abstract
Sequences of visual and haptic exploration were obtained on surfaces of different curvature from human subjects. We then extracted regions of interest (ROI) from the data as a function of number of times a subject fixated on a certain location on object and amount of time spent on such each location. Simple models like a plane, cone, cylinder, paraboloid, hyperboloid, ellipsoid, simple-saddle and a monkey-saddle were generated. Gaussian curvature representation of each point on all the surfaces was pre-computed. The surfaces have been previously tested for haptic and visual realism and distinctness by human subjects in a separate experiment. Both visual and haptic rendering were subsequently used for exploration by human subjects to study whether there is a similarity between the visual ROI and haptic ROIs. Additionally, we wanted to see if there is a correlation between curvature values and the ROIs thus obtained. A multiple regression model was further developed to see if this data can be used to predict the visual exploration path using haptic curvature saliency measures.
Chapter PDF
Similar content being viewed by others
References
Ballard, D.H.: Cortical connections and parallel processing: Structure and function. In: Arbib, M.A., Hanson, A.R. (eds.) Vision, brain, and cooperative computation, pp. 563–621. MIT Press, Cambridge (1986)
Brown, J.M., Weisstein, N., May, J.G.: Visual search for simple volumetric shapes. Perception and Psychophysics 51(4), 42–48 (1992)
Cheal, M., Lyon, D.: Attention in visual search: Multiple search classes. Perception and Psychophysics 52(2), 113–138 (1992)
Ernst, M.O., Banks, M.S.: Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870), 429–433 (2002)
Itti, L., Koch, C., Neibur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(11), 1254–1259 (1998)
Jenmalm, P., Birznieks, I.I., Goodwin, A., Johansson, R.: Differential responses in populations of fingertip tactile afferents to objects’ surface curvatures. Acta. Physiologica Scandinavica A24, 181
Mesulam, M.-M.: From sensation to cognition. Brain 121, 1013–1052 (1998)
Ouerhani, N., Hugli, H.: Computing visual attention from scene depth. In: Paper presented at the 15th International Conference on Pattern Recognition (2000)
Pashler, H. (ed.): Attention. University College London Press, London (1998)
Posner, M.I., Dehaene, S.: Attentional networks. Trends in Neuroscience 17, 75–79 (1994)
Riggs, L.A.: Curvature as a feature of pattern vision. Science 181, 1070–1072 (1973)
Spence, C., Driver, J. (eds.): Crossmodal space and crossmodal attention. Oxford University Press Inc., USA (2004)
Sridaran, A., Hansford, D., Kahol, K., Panchanathan, S.: Surface interrogation methods for haptic rendering of virtual objects. Paper presented at the World Haptics 2007, Tsukuba, Japan (March 22-24, 2007)
Sun, J., Perona, P.: Preattentive perception of elementary three dimensional shapes. Invest. Ophtalmol. Vis. Sci. 41(Supplement), 1083 (1993)
Tsotsos, J.K.: Analyzing vision at the complexity level. Brain and Behavioral Sciences 13, 423 (1990)
Tsotsos, J.K.: Computaional resources do constrain behavior. Brain and Behavioral Sciences 13, 506 (1991)
Wolfe, J.: Visual search. In: Pashler, H. (ed.) Attention, University College London Press, London, UK (1998)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tripathi, P., Kahol, K., Sridaran, A., Panchanathan, S. (2007). A Model for Visio-Haptic Attention for Efficient Resource Allocation in Multimodal Environments. In: Schmorrow, D.D., Reeves, L.M. (eds) Foundations of Augmented Cognition. FAC 2007. Lecture Notes in Computer Science(), vol 4565. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73216-7_37
Download citation
DOI: https://doi.org/10.1007/978-3-540-73216-7_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73215-0
Online ISBN: 978-3-540-73216-7
eBook Packages: Computer ScienceComputer Science (R0)