Skip to main content
Log in

An evaluation of the virtual curvature with the StickGrip haptic device: a case study

  • Long paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

Dynamic simulation of distance to the physical surface could promote the development of new inexpensive tools for blind and visually impaired users. The StickGrip is a haptic device comprised of the Wacom pen input device added with a motorized penholder. The goal of the research presented in this paper was to assess the accuracy and usefulness of the new pen-based interaction technique when the position and displacement of the penholder in relation to the pen tip provided haptic feedback to the user about the distance to the physical or virtual surface of interaction. The aim was to examine how accurately people are able (1) to align the randomly deformed virtual surfaces to the flat surface and (2) to adjust the number of surface samples having a randomly assigned curvature to the template having the given curvature and kept fixed. These questions were approached by measuring both the values of the adjusted parameters and the parameters of the human performance, such as a ratio between inspection time and control time spent by the participants to complete the matching task with the use of the StickGrip device. The test of the pen-based interaction technique was conducted in the absence of visual feedback when the subject could rely on the proprioception and kinesthetic sense. The results are expected to be useful for alternative visualization and interaction with complex topographic and mathematical surfaces, artwork, and modeling.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Balakrishnan, R., Kurtenbac, G.P., Fitzmaurice, G.W.: Techniques for pointing to locations within a volumetric display. US Patent app. 2008/0040689. Int. Cl. G09G 5/00 (2008)

  2. Brewster, S., Brown, L.M.: Tactons: structured tactile messages for non-visual information display. In: Proceedings of 5th Australasian User Interface Conference, AUIC 2004, Dunedin, New Zealand, 18–22 Jan 2004, pp. 15–23 (2004)

  3. Burr, D., Binda, P., Gori, M.: Combining vision with audition and touch, in adults and in children. In: Landy, M.S. (ed.) Cue Integration in Multi-sensory Perception. Oxford University Press, Oxford (2010, in press)

  4. Coello, Y.: Spatial context and visual perception for action. Psicológica 26(1), 39–59 (2005)

    Google Scholar 

  5. Davidson, P.W.: Haptic judgments of curvature by blind and sighted humans. J. Exp. Psychol. 93(1), 43–55 (1972)

    Article  Google Scholar 

  6. Dostmohamed, H., Hayward, V.: Trajectory of contact region on the fingerpad gives the illusion of haptic shape. Exp. Brain Res. 164(3), 387–394 (2005). doi:10.1007/s00221-005-2262-5

    Article  Google Scholar 

  7. Drewing, K., Ernst, M.O.: Integration of force and position cues for shape perception through active touch. Brain Res. 1078, 92–100 (2006). doi:10.1016/j.brainres.2005.12.026

    Article  Google Scholar 

  8. Evreinov, G., Evreinova, T.V., Raisamo, R.: Method, computer program and device for interacting with a computer. Finnish patent application, G06F ID20090434 (2009)

  9. Evreinova, T.V., Evreinov, G., Raisamo, R.: Interpretation of ambiguous images inspected by the StickGrip device. In: Proceedings of IADIS International Conference on Interfaces and Human Computer Interaction 2011, IADIS IHCI, Rome, Italy, 24–26 July 2011, pp. 209–217 (2011)

  10. Fiorentino, M., Uva, A., Monno, G.: The senstylus: a novel rumble-feedback pen device for CAD application in virtual reality. In: Proceedings of the 13th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision‘2005, Plzen-Bory, Czech Republic, WSCG’2005, 31 Jan–4 Feb 2005, pp. 131–138 (2005)

  11. Gallese, V., Sinigaglia, C.: The bodily self as power for action. Neuropsychologia 48(3), 746–755 (2009). doi:10.1016/j.neuropsychologia.2009.09.038

    Article  Google Scholar 

  12. Henriques, D.Y.P., Soechting, J.F.: Bias and sensitivity in the haptic perception of geometry. Exp. Brain Res. 150(1), 95–108 (2003). doi:10.1007/s00221-003-1402-z

    Google Scholar 

  13. Hilsenrat, M., Reiner, M.: Hapto-visual virtual reality as a tool in psychophysical research on roughness sensitivity. In: Proceedings of Third International Conference on Advances in Computer–Human Interactions, ACHI‘10, St. Maarten, Netherlands Antilles, 10–16 Feb 2010, pp. 139–142 (2010). doi:10.1109/ACHI.2010.32

  14. Jenmalm, P., Birznieks, I., Goodwin, A.W., Johansson, R.S.: Influence of object shape on responses of human tactile afferents under conditions characteristic of manipulation. Eur. J. Neurosci. 18(1), 164–176 (2003). doi:10.1046/j.1460-9568.2003.02721.x

    Article  Google Scholar 

  15. Jones, M.G., Bokinsky, A., Tretter, T., Negishi, A.: A comparison of learning with haptic and visual modalities. Haptics-e Electron. J. Haptics Res. 3(6), 1–20 (2005)

    Google Scholar 

  16. Kajimoto, H., Inami, M., Kawakami, N., Tachi, S.: SmartTouch—augmentation of skin sensation with electrocutaneous display. In: Proceedings of 11th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, HAPTICS 2003, Los Angeles, USA, 22–23 March 2003, pp. 40–46 (2003). doi:10.1109/HAPTIC.2003.1191225

  17. Kamuro, S., Minamizawa, K., Kawakami, N., Tachi, S.: Pen de touch. In: Proceedings of 36th International Conference on Computer Graphics and Interactive Techniques. ACM SIGGRAPH 2009, Emerging Technologies, New Orleans, USA, 3–7 Aug 2009, art.51 (2009). doi:10.1145/1597956.1597973

  18. Kappers, A.M.L., Koenderink, J.J.: Haptic unilateral and bilateral discrimination of curved surfaces. Perception 25(6), 739–749 (1996). doi:10.1068/p250739

    Article  Google Scholar 

  19. Kappers, A.M.L., Koenderink, J.J., te Pas, S.F.: Haptic discrimination of doubly curved surfaces. Perception 23(12), 1483–1490 (1994). doi:10.1068/p231483

    Article  Google Scholar 

  20. Kruijff, E., Wesche, G., Riege, K., Goebbels, G., Kunstman, M., Scmalstieg, D.: Tactylus, a pen-input device exploring audiotactile sensory binding. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology VRST-ACM, Limassol, Cyprus, 1–3 Nov 2006, pp. 312–315 (2006). doi:10.1145/1180495.1180557

  21. Kyung, K.-U., Lee, J.-Y.: wUbi-Pen: windows graphical user interface interacting with haptic feedback stylus. ACM SIGGRAPH. New Tech Demos, pp. 1–4 (2008). doi:10.1145/1401615.1401657

  22. Kyung, K.-U., Park, J.-S.: Ubi-Pen: development of a compact tactile display module and its application to a haptic stylus. In: Proceedings of the 2nd EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Tsukuba, Japan., 22–24 March 2007, pp. 109–114 (2007). doi:10.1109/WHC.2007.121

  23. Kyung, K.-U., Lee, J.-Y.: Ubi-Pen: a haptic interface with texture and vibrotactile display. IEEE Comput. Graph. Appl. 29(1), 24–32 (2009). doi:10.1109/MCG.2009.17

    Article  Google Scholar 

  24. Lapides, P., Sharlin, E., Sousa, M.C., Streit, L.: The 3D tractus: a three-dimensional drawing board. In: Proceedings of the First IEEE International Workshop on Horizontal Interactive Human–Computer Systems, Washington, USA, 5–7 Jan 2006, pp. 169–176 (2006). doi:10.1109/TABLETOP.2006.33

  25. Lee, J.C., Dietz, P.H., Leigh, D., Yerazunis, W.S., Hudson, S.E.: Haptic pen: a tactile feedback stylus for touch screens. In: Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST), Santa Fe, USA, 24–27 Oct 2004, pp. 291–294 (2004)

  26. Levesque, V., Pasquero, J., Hayward, V., Legault, M.: Display of virtual braille dots by lateral skin deformation: feasibility study. ACM Trans. Appl. Percep. 2(2), 132–149 (2005). doi:10.1145/1060581.1060587

    Google Scholar 

  27. Loomis, J.M., da Silva, J.A., Fujita, N., Fukusima, S.S.: Visual space perception and visually directed action. J. Exp. Psychol. Hum. Percept. Perform. 18(4), 906–921 (1992)

    Article  Google Scholar 

  28. Louw, S., Kappers, A.M.L., Koenderink, J.J.: Active haptic detection and discrimination of shape. Percept. Psychophys. 64(7), 1108–1119 (2002). doi:10.3758/BF03194760

    Article  Google Scholar 

  29. Nakadaira, A., Suzuki, N., Ochi, D.: 3D pointing method, 3D display control method, 3D pointing device, 3D display control device, 3D pointing program, and 3D display control program. US Patent App. 2008/0225007. Int. Cl. G06F 3/038 (2008)

  30. Norman, J.F., Lappin, J.S., Norman, H.F.: The perception of length on curved and flat surfaces. Percept. Psychophys. 62(6), 1133–1145 (2000)

    Article  Google Scholar 

  31. Pichler, A., Fisher, R.B., Vincze, M.: Decomposition of range images using Markov random fields. In: Proceedings of IEEE International Conference on Image Processing. pp. 1205–1208 (2004). doi:10.1109/ICIP.2004.1419521

  32. Plaisier, M.A., Bergmann, T.W.M., Kappers, A.M.L.: Salient features in 3-D haptic shape perception. Atten. Percept. Psychophys. 71(2), 421–430 (2009). doi:10.3758/APP.71.2.421

    Article  Google Scholar 

  33. Pont, S.C., Kappers, A.M.L., Koenderink, J.J.: Haptic curvature discrimination at several regions of the hand. Percept. Psychophys. 59(8), 1225–1240 (1997)

    Article  Google Scholar 

  34. Pont, S.C., Kappers, A.M.L., Koenderink, J.J.: The influence of stimulus tilt on haptic curvature matching and discrimination by dynamic touch. Perception 27(7), 869–880 (1998). doi:10.1068/p270869

    Article  Google Scholar 

  35. Pont, S.C., Kappers, A.M.L., Koenderink, J.J.: Similar mechanisms underlie curvature comparison by static and dynamic touch. Percept. Psychophys. 61(5), 874–894 (1999). doi:10.3758/BF03206903

    Article  Google Scholar 

  36. Provancher, W.R., Cutkosky, M.R., Kuchenbecker, K.J., Niemeyer, G.: Contact location display for haptic perception of curvature and object motion. Int. J. Rob. Res. 24(9), 691–702 (2005). doi:10.1177/0278364905057121

    Article  Google Scholar 

  37. Ramos, G.A.: Pressure-sensitive pen interactions. Ph.D. thesis, University of Toronto. Available at (accessed on Sept 2009): http://hdl.handle.net/1807/11121 (2009)

  38. Robles-De-La-Torre, G., Hayward, V.: Virtual surfaces and haptic shape perception. In: Proceedings of the Haptic Interfaces for Virtual Environment and Teleoperator Systems Symposium, ASME IMECE. ASME, vol. 69, no. 2, pp. 1081–1087 (2000)

  39. Robles-De-La-Torre, G., Hayward, V.: Force can overcome object geometry in the perception of shape through active touch. Nature 412, 445–448 (2001). doi:10.1038/35086588

    Article  Google Scholar 

  40. Sanders, A.F.J., Kappers, A.M.L.: Curvature affects haptic length perception. Acta Psychol. 129(3), 340–351 (2008). doi:10.1016/j.actpsy.2008.08.011

    Article  Google Scholar 

  41. Sribunruangrit, N., Marque, C., Lenay, C., Gapenne, O., Vanhoutte, C.: Speed-accuracy tradeoff during performance of a tracking task without visual feedback. IEEE Trans. Neural Syst. Rehabil. Eng. 12(1), 131–139 (2004). doi:10.1109/TNSRE.2004.824222

    Article  Google Scholar 

  42. Tan, H.Z., Srinivasan, M.A., Reed, C.M., Durlach, N.I.: Discrimination and identification of finger joint-angle position using active motion. ACM Trans. Appl. Percept. 4(2), 10 (2007). doi:10.1145/1265957.1265959

    Article  Google Scholar 

  43. Taylor, G., Kleeman, L.: Robust range data segmentation using geometric primitives for robotic applications. In: Proceedings of the 9th International Conference on Signal and Image Processing, Honolulu, USA, 13–15 Aug, 2003, pp. 467–472 (2003)

  44. Teather, R., Stuerzlinger, W.: Guidelines for 3D object positioning techniques. In: Proceedings of the Conference on Future Play, Toronto, Canada, 15–17 Nov 2007, pp. 61–68 (2007). doi:10.1145/1328202.1328214

  45. Touma, P., Murr, H., Bachaalani, E., Maalouf, I.: 3D mouse and game controller based on spherical coordinates system and system for use. US Patent app. 2006/0092133. Int. Cl. G09G 5/08 (2006)

  46. van der Horst, B.J., Kappers, A.M.L.: Curvature discrimination in various finger conditions. Exp. Brain Res. 177(3), 304–311 (2007)

    Article  Google Scholar 

  47. van der Horst, B.J., Kappers, A.M.L.: Using curvature information in haptic shape perception of 3D objects. Exp. Brain Res. 190(3), 361–367 (2008). doi:10.1007/s00221-008-1478-6

    Article  Google Scholar 

  48. van der Horst, B.J., Kappers, A.M.L.: Haptic curvature comparison of convex and concave shapes. Perception 37(8), 1137–1151 (2008). doi:10.1068/p5780

    Article  Google Scholar 

  49. van der Horst, B.J., Willebrands, W.P., Kappers, A.M.L.: Transfer of the curvature aftereffect in dynamic touch. Neuropsychologia 46(12), 2966–2972 (2008). doi:10.1016/j.neuropsychologia.2008.06.003

    Article  Google Scholar 

  50. Vogels, I.M.L.C., Kappers, A.M.L., Koenderink, J.J.: Haptic after-effect of curved surfaces. Perception 25(1), 109–119 (1996). doi:10.1068/p250109

    Article  Google Scholar 

  51. Vogels, I.M.L.C., Kappers, A.M.L., Koenderink, J.J.: Haptic after-effect of successively touched curved surfaces. Acta Psychol. 106(3), 247–263 (2001)

    Article  Google Scholar 

  52. Weinshall, D.: Shortcuts in shape classification from two images. CVGIP Image Unders. 56(1), 57–68 (1992). doi:10.1016/1049-9660(92)90085-H

  53. Wijntjes, M.W.A., Sato, A., Hayward, V., Kappers, A.M.L.: Local surface orientation dominates haptic curvature discrimination. IEEE Trans. Haptics 2(2), 94–102 (2009). doi:10.1109/TOH.2009.1

    Article  Google Scholar 

  54. Wilson, E.T., Wong, J., Gribble, P.L.: Mapping proprioception across a 2D horizontal workspace. PLoS ONE 5(7), e11851 (2010). doi:10.1371/journal.pone.0011851

    Article  Google Scholar 

  55. Withana, A., Makino, Y., Kondo, M., et al.: ImpAct: Immersive haptic stylus to enable direct touch and manipulation for surface computing. ACM J. Comput. Entertain. 8(2), 16, art. 9 (2010). doi:10.1145/1899687.1899691

Download references

Acknowledgments

The authors would like to thank the anonymous reviewers for their constructive and helpful criticism of the manuscript. This work was supported by the Academy of Finland (grant 127774).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Grigori Evreinov.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Evreinova, T.V., Evreinov, G. & Raisamo, R. An evaluation of the virtual curvature with the StickGrip haptic device: a case study. Univ Access Inf Soc 12, 161–173 (2013). https://doi.org/10.1007/s10209-012-0273-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-012-0273-0

Keywords

Navigation