The Effects of Multi-Modality on the Use of Smart Phones

Gaeun Lee; Seongmin Kim; Jaeho Choe; Eui Seung Jung

주제분류

...

저널정보

저자정보

Gaeun Lee (Korea University)
Seongmin Kim (Korea University)
Jaeho Choe (Daejin University)
Eui Seung Jung (Korea University)

이용수
내서재: 2

내서재에 추가
되었습니다. 내서재에서
삭제되었습니다.

초록·키워드

오류제보하기

Objective: The objective of this study was to examine multi-modal interaction effects of input-mode switching on the use of smart phones.

Background: Multi-modal is considered as an efficient alternative for input and output of information in mobile environments. However, there are various limitations in current mobile UI (User Interface) system that overlooks the transition between different modes or the usability of a combination of multi modal uses.

Method: A pre-survey determined five representative tasks from smart phone tasks by their functions. The first experiment involved the use of a uni-mode for five single tasks; the second experiment involved the use of a multi-mode for three dual tasks. The dependent variables were user preference and task completion time. The independent variable in the first experiment was the type of modes (i.e., Touch, Pen, or Voice) while the variable in the second experiment was the type of tasks (i.e., internet searching, subway map, memo, gallery, and application store).

Results: In the first experiment, there was no difference between the uses of pen and touch devices. However, a specific mode type was preferred depending on the functional characteristics of the tasks. In the second experiment, analysis of results showed that user preference depended on the order and combination of modes. Even with the transition of modes, users preferred the use of multi-modes including voice.

Conclusion: The order of combination of modes may affect the usability of multimodes. Therefore, when designing a multi-modal system, the fact that there are frequent transitions between various mobile contents in different modes should be properly considered.

Application: It may be utilized as a user-centered design guideline for mobile multi modal UI system.

#Mobile #Multi-modal interaction #Mode-switching #Multi-modality #Voice