Abstract
Recently touch screens are widely used for mobile devices to provide intuitive and natural interactions with hands and fingers. However, the lack of tactile responses makes it difficult for users to get key-click confirmations during text entry with soft keyboards. This paper examines the effect of tactile feedback on typing performance with the soft QWERTY keyboard, the most commonly-used, multi-finger text entry and thumb typing methods in mobile devices. In order to investigate the typing performance, we implemented tactile feedback functions by embedding multiple piezoelectric actuators that was attached under the touchscreen to simulate the key-click effect in commercial mobile platforms, MS Surface Pro (tablet) and Nokia Lumia520 (phone). We conducted an experiment of transcription tasks to measure typing performance and user preference. The experiments involved transcribing given phrases with three feedback conditions: visual only, visual with audio, and visual with tactile. The results showed that the typing performance (KSPC, WPM, UER, CER) has been significantly improved by adding tactile feedback to the existing visual display on a commercial tablet and phone. A further quantitative analysis by questionnaire also showed that all of the participants preferred tactile or aural feedback to visual feedback only. This study thus provides researchers and designers with practical guidelines regarding tactile feedback on commercial mobile devices.
Similar content being viewed by others
References
Findlater L, Wobbrock J (2012) Personalized input: improving ten-finger touchscreen typing through automatic adaptation. In: Proceedings of the SIGCHI conference on human factors in computing systems ACM, pp 815–824
Li F, Guy R, Yatani K, Truong K (2011) The 1line keyboard: a QWERTY layout in a single line. In: Proceedings of the 24th annual ACM symposium on user interface software and technology, pp 461–470
Goel M, Jansen A, Mandel, T, Patel SN, and Wobbrock J (2013) Contexttype: using hand posture information to improve mobile touch screen text entry. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 2795–2798
Rabin E, Gordon AM (2004) Tactile feedback contributes to consistency of finger movements during typing. Exp Brain Res 1553:362–369
Findlater L, Wobbrock J, Wigdor D (2011) Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces, In: Proceedings of the SIGCHI conference on human factors in computing systems ACM, pp 2453–2462
Jansen Y, Karrer T, Borchers J (2010) MudPad: localized tactile feedback on touch surfaces. In: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology, pp 385–386
Kyung KU, Lee JY, Srinivasan MA (2009) Precise manipulation of GUI on a touch screen with haptic cues. In: Proceedings on the 3rd joint eurohaptics symposium and symposium on haptic interfaces for virtual environment and teleoperator systems, pp 202–207
Brewster SA, Chohan F, Brown L (2007) Tactile feedback for mobile interactions. In: Proceedings of the SIGCHI conference on human factors in computing systems ACM, pp 159–162
Hoggan E, Brewster SA, Johnston J (2008) Investigating the effectiveness of tactile feedback for mobile touchscreens. In: Proceedings of the SIGCHI conference on human factors in computing systems ACM, pp 1573–1582
McAdam C, Brewster SA (2009) Distal tactile feedback for text entry on tabletop computers. In: Proceedings of the 23rd british HCI group annual conference on people and computers: celebrating people and technology british computer society, pp 504–511
Hoffmann A, Spelmezan D, Borchers J (2009) TypeRight: a keyboard with tactile error prevention. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 2265–2268
MacKenzie IS, Soukoreff RW (2003) Phrase sets for evaluating text entry techniques. In: CHI’03 extended abstracts on human factors in computing systems, pp 754–755
Chen HY, Park J, Dai S, Tan HZ (2011) Design and evaluation of identifiable key-click signals for mobile devices. IEEE Trans Haptics 4(4):229–241
Soukoreff RW, MacKenzie IS (2003) Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 113–120
Koskinen E, Kaaresoja T, Laitinen P (2008) Feel-good Touch: finding the most pleasant tactile feedback for a mobile touch screen button. In: Proceedings of the 10th international conference on multimodal interfaces ACM, pp 297–304
Soukoreff RW, MacKenzie IS (2001) Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic. In: CHI’01 extended abstracts on human factors in computing systems ACM, pp 319–320
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Han, B., Kim, K. Typing performance evaluation with multimodal soft keyboard completely integrated in commercial mobile devices. J Multimodal User Interfaces 9, 173–181 (2015). https://doi.org/10.1007/s12193-015-0177-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12193-015-0177-4