Skip to main content
SpringerLink
Log in
SpringerLink
Log in

Introducing Mobile Device-Based Interactions to Users: An Investigation of Onboarding Tutorials

  • Conference paper
  • First Online:
Human-Computer Interaction. Multimodal and Natural Interaction (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12182))

Included in the following conference series:

Abstract

Various built-in sensors enable interacting with mobile devices beyond the screen. So-called mobile device-based interaction techniques are characterized by movements and positions in real space, e.g. twisting the device to switch between front and rear camera or pouring photos from one device into another for sharing. Although interactions should be as intuitive as possible, it is often necessary to introduce them, especially if they are complex or new to the user. Applications have to present interactions appropriately so that users can understand and use them easily. We conducted a user study to investigate the suitability of onboarding tutorials for mobile device-based interaction techniques. Results show that these types of tutorials are insufficient for communicating mobile device-based interactions, mainly because of their spatial and tangible characteristics but also their collaborative and representative interdependencies. Based on this, we propose suggestions for improving the design of tutorials for device-based interactions with mobile phones.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Easy Mute feature: https://www.samsung.com/ca/support/mobile-devices/what-are-the-advanced-features-available-on-my-galaxy-note8/.

  2. 2.

    Flip camera gesture: https://support.google.com/nexus/answer/7443425.

References

  1. Alt, F., Geiger, S., Höhl, W.: ShapelineGuide: teaching mid-air gestures for large interactive displays. In: Proceedings of the 7th ACM International Symposium on Pervasive Displays, PerDis 2018, pp. 3:1–3:8. ACM (2018). https://doi.org/10.1145/3205873.3205887

  2. Ashbrook, D., Starner, T.: MAGIC: a motion gesture design tool. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2010, pp. 2159–2168 (2010). https://doi.org/10.1145/1753326.1753653

  3. Chong, M.K., Mayrhofer, R., Gellersen, H.: A survey of user interaction for spontaneous device association. J. ACM Comput. Surv. (CSUR) 47(1), 8–40 (2014). https://doi.org/10.1145/2597768

    Article  Google Scholar 

  4. Daiber, F., Kosmalla, F., Murlowski, C., Krüger, A.: Slackliner: using whole-body gestures for interactive slackline training. In: Proceedings of the Symposium on Spatial User Interaction, SUI 2018, pp. 174–174. ACM (2018). https://doi.org/10.1145/3267782.3274691

  5. Delamare, W., Coutrix, C., Nigay, L.: Designing guiding systems for gesture-based interaction. In: Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2015), pp. 44–53. ACM (2015). https://doi.org/10.1145/2774225.2774847

  6. Dingler, T., Rzayev, R., Shirazi, A.S., Henze, N.: Designing consistent gestures across device types: eliciting rsvp controls for phone, watch, and glasses. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, pp. 419:1–419:12. ACM (2018). https://doi.org/10.1145/3173574.3173993

  7. Harley, A.: Instructional overlays and coach marks for mobile apps (2014). https://www.nngroup.com/articles/mobile-instructional-overlay/. Accessed 18 Jan 2020

  8. Harrison, S.M.: A comparison of still, animated, or nonillustrated on-line help with written or spoken instructions in a graphical user interface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1995, pp. 82–89 (1995). https://doi.org/10.1145/223904.223915

  9. Higgins, K.: First time user experiences in mobile apps (2012). http://www.kryshiggins.com/first-time-user-experiences-in-mobile-apps/. Accessed 18 Jan 2020

  10. Ismair, S., Wagner, J., Selker, T., Butz, A.: MIME: teaching mid-air pose-command mappings. In: Proceedings of 17th International Conference on HCI with Mobile Devices and Services, MobileHCI 2015, pp. 199–206. ACM (2015). https://doi.org/10.1145/2785830.2785854

  11. Joyce, G., Lilley, M., Barker, T., Jefferies, A.: Mobile application tutorials: perception of usefulness from an HCI expert perspective. In: Kurosu, M. (ed.) HCI 2016. LNCS, vol. 9732, pp. 302–308. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-39516-6_29

    Chapter  Google Scholar 

  12. Korzetz, M., Kühn, R., Heisig, P., Schlegel, T.: Natural collocated interactions for merging results with mobile devices. In: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, MobileHCI 2016, pp. 746–752. ACM (2016). https://doi.org/10.1145/2957265.2961839

  13. Korzetz, M., Kühn, R., Kegel, K., Georgi, L., Schumann, F.-W., Schlegel, T.: MilkyWay: a toolbox for prototyping collaborative mobile-based interaction techniques. In: Antona, M., Stephanidis, C. (eds.) HCII 2019. LNCS, vol. 11573, pp. 477–490. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23563-5_38

    Chapter  Google Scholar 

  14. Korzetz, M., Kühn, R., Schlegel, T.: Turn it, pour it, twist it: a model for designing mobile device-based interactions. In: Proceedings of the 5th International Conference on Human-Computer Interaction and User Experience in Indonesia, CHIuXiD 2019, pp. 20–23. ACM (2019). https://doi.org/10.1145/3328243.3328246

  15. Kühn, R., Korzetz, M., Büschel, L., Korger, C., Manja, P., Schlegel, T.: Natural voting interactions for collaborative work with mobile devices. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA 2016, pp. 2570–2575. ACM (2016). https://doi.org/10.1145/2851581.2892300

  16. Kühn, R., Korzetz, M., Büschel, L., Schumann, F.-W., Schlegel, T.: Device-based interactions for anonymous voting and rating with mobile devices in collaborative scenarios. In: Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia, MUM 2016, pp. 315–317. ACM (2016). https://doi.org/10.1145/3012709.3016067

  17. Kühn, R., Korzetz, M., Schumann, F.-W., Büschel, L., Schlegel, T.: Vote-for-It: investigating mobile device-based interaction techniques for collocated anonymous voting and rating. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11746, pp. 585–605. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29381-9_36

    Chapter  Google Scholar 

  18. Kühn, R., Schlegel, T.: Mixed-focus collaboration activities for designing mobile interactions. In: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, MobileHCI 2018, pp. 71–78. ACM (2018). https://doi.org/10.1145/3236112.3236122

  19. Leigh, S.W., Schoessler, P., Heibeck, F., Maes, P., Ishii, H.: THAW: tangible interaction with see-through augmentation for smartphones on computer screens. In: Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction, TEI 2015, pp. 89–96 (2015). https://doi.org/10.1145/2677199.2680584

  20. Linjama, J., Korpipää, P., Kela, J., Rantakokko, T.: ActionCube: a tangible mobile gesture interaction. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction, TEI 2008, Bonn, Germany, pp. 169–172 (2008). https://doi.org/10.1145/1347390.1347428

  21. Lucero, A., Keränen, J., Jokela, T.: Social and spatial interactions: shared co-located mobile phone use. In: CHI 2010 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2010, pp. 3223–3228 (2010). https://doi.org/10.1145/1753846.1753962

  22. Lucero, A., Porcheron, M., Fischer, J.E.: Collaborative use of mobile devices to curate sources of inspiration. In: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, MobileHCI 2016, pp. 611–616. ACM (2016). https://doi.org/10.1145/2957265.2961830

  23. Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 409–420. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-24598-8_38

    Chapter  Google Scholar 

  24. Novick, D.G., Ward, K.: Why don’t people read the manual? In: Proceedings of the 24th Annual ACM International Conference on Design of Communication, SIGDOC 2006, pp. 11–18. ACM (2006). https://doi.org/10.1145/1166324.1166329

  25. Paay, J., et al.: A comparison of techniques for cross-device interaction from mobile devices to large displays. In: Proceedings of the 14th International Conference on Advances in Mobile Computing and Multi Media, MoMM 2016, p. 137–146. ACM (2016). https://doi.org/10.1145/3007120.3007140

  26. Perelman, G., Serrano, M., Bortolaso, C., Picard, C., Derras, M., Dubois, E.: Combining tablets with smartphones for data analytics. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11749, pp. 439–460. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29390-1_24

    Chapter  Google Scholar 

  27. Rico, J., Brewster, S.: Usable gestures for mobile interfaces: evaluating social acceptability. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2010, pp. 887–896 (2010). https://doi.org/10.1145/1753326.1753458

  28. Rodrigues, A., Camacho, L., Nicolau, H., Montague, K., Guerreiro, T.: AidMe: interactive non-visual smartphone tutorials. In: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, MobileHCI 2018, pp. 205–212. ACM Press (2018). https://doi.org/10.1145/3236112.3236141

  29. Satia, G.: Mobile onboarding: a beginner’s guide. Smashing Mag. (2014). https://www.smashingmagazine.com/2014/08/mobile-onboarding-beginners-guide/. Accessed 18 Jan 2020

  30. Scoditti, A., Blanch, R., Coutaz, J.: A novel taxonomy for gestural interaction techniques based on accelerometers. In: Proceedings of the 16th International Conference on Intelligent User Interfaces, IUI 2011, pp. 63–72 (2011). https://doi.org/10.1145/1943403.1943414

Download references

Acknowledgements

The European Social Fund (ESF) and the German Federal State of Saxony have funded this work within the project CyPhyMan (100268299). Also funded by the German Research Foundation (DFG, Deutsche Forschungsgemeinschaft) as part of Germany’s Excellence Strategy – EXC 2050/1 – Project ID 390696704 – Cluster of Excellence “Centre for Tactile Internet with Human-in-the-Loop” (CeTI) of Technische Universität Dresden.

Author information

Authors and Affiliations

  1. Software Technology Group, TU Dresden, Dresden, Germany

    Mandy Korzetz, Romina Kühn, Lukas Büschel, Franz-Wilhelm Schumann & Uwe Aßmann

  2. Karlsruhe University of Applied Sciences, Karlsruhe, Germany

    Thomas Schlegel

Authors
  1. Mandy Korzetz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Romina Kühn
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lukas Büschel
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Franz-Wilhelm Schumann
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Uwe Aßmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Thomas Schlegel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Mandy Korzetz or Romina Kühn .

Editor information

Editors and Affiliations

  1. The Open University of Japan, Chiba, Japan

    Masaaki Kurosu

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Korzetz, M., Kühn, R., Büschel, L., Schumann, FW., Aßmann, U., Schlegel, T. (2020). Introducing Mobile Device-Based Interactions to Users: An Investigation of Onboarding Tutorials. In: Kurosu, M. (eds) Human-Computer Interaction. Multimodal and Natural Interaction. HCII 2020. Lecture Notes in Computer Science(), vol 12182. Springer, Cham. https://doi.org/10.1007/978-3-030-49062-1_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49062-1_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49061-4

  • Online ISBN: 978-3-030-49062-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation