Skip to main content
SpringerLink
Log in

Augmented reality situated visualization in decision-making

  • 1198: Advances in Multimedia Interaction and Visualization
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Decision-making processes and decision support systems (DSS) have been improved by a variety of methods originated from several scientific fields, such as information science and artificial intelligence (AI). Situated visualization (SV) allows presenting visual data representations in context and may support better DSS. Its main characteristic is to display data representations near the data referent. As augmented reality (AR) is becoming more mature, affordable, and widespread, using it as a tool for SV becomes viable in several situations. Moreover, it may provide a positive contribution to more effective and efficient decision-making, as the users have contextual, relevant, and appropriate information that fosters more informed choices. As new challenges and opportunities arise, it is important to understand the relevance of intertwining these fields. Based on literature analysis, this paper introduces the main concepts involved, and, through practical examples, addresses and discusses current areas of application, benefits, challenges, and opportunities of using SV through AR to visualize data in context to support better decision-making processes. In the end, a set of guidelines for the design and implementation of DSS based on situated augmented reality are proposed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. http://www.heritagemalta.org/ray-ban-virtual-mirror-app.html

References

  1. Alter S (1980) Decision support systems: current practice and continuing challenges (No. 04; HD30. 23, A5.)

  2. Arth C, Grasset R, Gruber L, Langlotz T, Mulloni R, Schmalstieg D, Wagner D (2015) The history of mobile augmented reality developments in mobile ar over the last almost 50 years. arXiv:1505.01319

  3. Azuma RT (1997) A survey of augmented reality. Presence: Teleoperators Virtual Environ 6(4):355–385

    Article  Google Scholar 

  4. Azuma RT (2017) Making augmented reality a reality

  5. Azuma R, Baillot Y, Behringer R, Feiner S, Julier S, MacIntyre B (2001) Recent advances in augmented reality. IEEE Comput Graphics Appl 21 (6):34–47

    Article  Google Scholar 

  6. Bach R, Sicat H, Pfister H, Quigley A (2017) Drawing into the AR-Canvas: Designing embedded visualizations for augmented reality. Workshop on Immersive Analytics. IEEE Vis.

  7. Berryman DR (2012) Augmented reality: A review. Med Ref Serv Quart 31(2):212–218

    Article  Google Scholar 

  8. Bohanec M (2003) Decision support. In: Data mining and decision support. Springer, Boston, pp 23–35

  9. Bonczek RH, Holsapple CW, Whinstone AB (1983) The Evolving Roles of Decision support systems: a data-based, model-oriented, user-developed discipline, 343

  10. Bridges SA, Robinson OP, Stewart EW, Kwon D, Mutua K (2020) Augmented reality: Teaching daily living skills to adults with intellectual disabilities. J Special Educ Technol 35(1):3–14

    Article  Google Scholar 

  11. Brito PQ, Stoyanova J, Coelho A (2018) Augmented reality versus conventional interface: is there any difference in effectiveness? Multimed Tools Appl 77 (6):7487–7516

    Article  Google Scholar 

  12. Buchanan L, O Connell A (2006) A brief history of decision-making. Harvard Business Rev 84(1):32

    Google Scholar 

  13. Burstein F, Holsapple C (2008) Handbook on decision support systems, basic themes, vol 1. Springer, New York

    Book  Google Scholar 

  14. Card SK, Mackinlay JD, Shneiderman B (1999) Readings in information visualization: Using vision to think. Morgan Kaufmann Publishers Inc, San Francisco

    Google Scholar 

  15. Caricato P, Colizzi L, Gnoni MG, Grieco A, Guerrieri A, Lanzilotto A (2014) Augmented reality applications in manufacturing: A multi-criteria decision model for performance analysis. IFAC Proceedings Volumes 47(3):754–759

    Article  Google Scholar 

  16. Carmigniani J, Furht B, Anisetti M, Ceravolo P, Damiani E, Ivkovic M (2011) Augmented reality technologies, systems and applications. Multimed Tools Appl 51(1):341–377

    Article  Google Scholar 

  17. Caudell T, Mizell DW (1992) Augmented reality: An application of heads-up display technology to manual manufacturing processes. System Sci 659–669

  18. Chen CT, Chang TW (2006) 1: 1 spatially augmented reality design environment. In: Innovations in design & decision support systems in architecture and urban planning. Springer, Dordrecht, pp 487–499

  19. Choi JH, Ruidan S, Liu S, Cha HJ (2020) Practical augmented reality (AR) technology and its applications. Multimed Tools Appl 79:16349. https://doi.org/10.1007/s11042-020-08939-x

    Article  Google Scholar 

  20. Druzdzel MJ (2002) R.R Flynn decision support systems. In: Kent A (ed) Encyclopedia of library and information science. 2nd edn. Marcel Dekker, Inc., New York

  21. Dwyer T, Marriott K, Isenberg T, Klein K, Riche N, Schreiber F, Thomas BH (2018) Immersive analytics: An introduction. In: Immersive analytics. Springer, Cham, pp 1–23

  22. Dwyer T, Riche NH, Klein K, Stuerzlinger W (2016) Immersive analytics. Report from Dagstuhl Seminar 16231

  23. Eissele M, Kreiser M, Ertl T (2008) Context-controlled flow visualization in augmented reality. In: Graphics Interface, pp 89–96

  24. El Sayed NA, Thomas BH, Marriott K, Piantadosi J, Smith RT (2016) Situated analytics: Demonstrating immersive analytical tools with augmented reality. J Visual Lang Comput (36):13–23

  25. El Sayed NA, Thomas BH, Smith RT, Marriott K, Piantadosi J (2015) Using Augmented Reality to Support Situated Analytics. Virtual Reality (VR), 2015 IEEE. IEEE, Piscataway, pp 175–176

    Book  Google Scholar 

  26. Filip FG, Zamfirescu CB, Ciurea C (2017) Computer-supported collaborative decision-making. Springer International Publishing, Cham

    Book  Google Scholar 

  27. Finlay PN (1994) Introducing decision support systems. Blackwell Pub, Oxford

    Google Scholar 

  28. Fraga-Lamas P, Fernández-Caramés TM, Blanco-Novoa Ó, Vilar-Montesinos MA (2018) A review on industrial augmented reality systems for the industry 4.0 shipyard. Ieee Access 6:13358–13375

    Article  Google Scholar 

  29. Fuhrmann A, Schmalstie D, Löffelmann H (1997) Collaborative augmented reality: Exploring dynamical systems. In: Proc. IEEE Visualization, vol 97, pp 459–462

  30. Gonzalez EA, Gutierrez AS, Benito JL (2013) Augmented Reality System for Training, Assistance and decision-making in Real Time situations in the Embedded Electronic field. In: 5th Joint Virtual Reality Conference JVRC, pp 113–115

  31. Grasset R, Langlotz T, Kalkofen D, Tatzgern M, Schmalstieg D (2012) Image-driven view management for augmented reality browsers. In: 2012 IEEE international symposium on mixed and augmented reality (ISMAR). IEEE, pp 177–186

  32. Grubert J, Langlotz T, Zollmann S, Regenbrecht H (2016) Towards pervasive augmented reality: Context-awareness in augmented reality. IEEE Trans Visual Comput Graphics 23(6):1706–1724

    Article  Google Scholar 

  33. Guarese R, Andreasson P, Nilsson E, Maciel A (2020) Augmented Situated Visualization Methods towards Electromagnetic Compatibility Testing. Computers & Graphics

  34. Holsapple CW (2008) Decisions and knowledge. In: Handbook on decision support systems 1. Springer, Berlin, pp 21–53

  35. Jansen Y, Dragicevic P (2013) An interaction model for visualizations beyond the desktop. IEEE Trans Vis Comput Graph 19(12):2396–2405

    Article  Google Scholar 

  36. Jerald J (2015) The VR book: Human-centered design for virtual reality. Morgan & Claypool, California

    Book  Google Scholar 

  37. Kaklauskas A, Krutinis M, Petkov P, Kovachev L, Bartkiene L (2016) Housing health and safety decision support system with augmented reality. InImpact: The Journal of Innovation Impact 6(1):131

    Google Scholar 

  38. Kalkofen D, Sandor C, White S, Schmalstieg D (2011) Visualization techniques for augmented reality. In: Furht B, Furht B (eds) Handbook of augmented reality. Springer, New York, pp 65–98

  39. Kim K, Billinghurst M, Bruder G, Duh H (2018) Revisiting Trends in Augmented Reality research: A Review of the 2nd Decade of ISMAR (2008-2017). IEEE Trans Visual Comput Graphics 24(11):2947–2962

    Article  Google Scholar 

  40. Kosara R (2007) Visualization criticism - The missing link between information visualization and art. In: Proceedings of the 11th international conference on information visualisation (IV). IEEE, Switzerland, pp 631–636

  41. Krakhofer S, Kaftan M (2015) Augmented reality design decision support engine for the early building design stage. Emerg Exp Past, Present Futur Digit Archit Proc 20th Int Conf Assoc Comput Archit Des Res Asia (CAADRIA 2015:231–240

    Google Scholar 

  42. Lorenz M, Knopp S, Klimant P (2018) Industrial augmented reality: Requirements for an augmented reality maintenance worker support system. In: 2018 IEEE International symposium on mixed and augmented reality adjunct (ISMAR-Adjunct). IEEE, pp 151–153

  43. Marques B, Esteves R, Alves J, Ferreira C, Dias P, Santos BS (2019) Investigating different augmented reality approaches in circuit assembly: A user study. In: Eurographics (Short Papers), pp 45–48

  44. Marques B, Santos BS, Araújo T, Martins NC, Alves J, Dias P (2019) Situated visualization in the decision process through augmented reality. In: 2019 23rd International Conference Information Visualisation (IV). IEEE, pp 13–18

  45. Meiguins BS, do Carmo RC, Gonçalves AS, Godinho PIA, de Brito Garcia M (2006) Using augmented reality for multidimensional data visualization. In: Tenth international conference on information visualisation (IV’06). IEEE, pp 529–534

  46. Mekni M, Lemieux A (2014) Augmented reality: Applications, challenges and future trends. Appl Computat Sci 205–214

  47. Mendez E, Schall G, Havemann S, Fellner D, Schmalstieg D, Junghanns S (2008) Generating semantic 3D models of underground infrastructure. IEEE Comput Graph Appl 28(3):48–57

    Article  Google Scholar 

  48. Merino L, Sotomayor-Gómez B, Yu X, Salgado R, Bergel A, Sedlmair M, Weiskopf D (2020) Toward agile situated visualization: An exploratory user study. arXiv:2002.05963

  49. Milgram P, Kishino F (1994) A taxonomy of mixed reality visual displays. IEICE Trans Inform Syst 77(12):1321–1329

    Google Scholar 

  50. Milovanovic J, Moreau G, Siret D, Miguet F (2017) Virtual and augmented reality in architectural design and education: An Immersive Multimodal Platform to Support Architectural Pedagogy. 17th Int. Conf. CAAD Futur

  51. Morillo P, García-García I, Orduña JM, Fernández M, Juan MC (2019) Comparative study of AR versus video tutorials for minor maintenance operations. Multimed Tools Appl 1–28

  52. Munzner T (2014) Visualization analysis and design. CRC Press, Boca Raton

    Book  Google Scholar 

  53. Nee A, Ong S, Chryssolouris G, Mourtzis D (2012) Augmented reality applications in design and manufacturing. CIRP Ann Manuf Technol 61 (2):657–679

    Article  Google Scholar 

  54. Nizam SM, Abidin RZ, Hashim NC, Lam MC, Arshad H, Majid NA (2018) A review of multimodal interaction technique in augmented reality environment. Int J Adv Sci Eng Inform Technol 8(4-2):1460–1469

    Article  Google Scholar 

  55. Park S, Cha HS, Kwon J, Kim H, Im CH (2020) Development of an online home appliance control system using augmented reality and an SSVEP-based brain-computer interface. In: 2020 8th international winter conference on brain-computer interface (BCI). IEEE, pp 1–2

  56. Power DJ (2003) A Brief History of Decision Support Systems, Decis. Support Syst. - DSSResources

  57. Power DJ (2003) What are the characteristics of a Decision Support System? DSS News 4(7)

  58. Power DJ, Burstein F, Sharda R (2011) Reflections on the past and future of decision support systems: Perspective of eleven pioneers. In: Decision support. Springer, New York, pp 25–48

  59. Power DJ, Sharda R (2007) Model-driven decision support systems: Concepts and research directions. Decis Support Syst 43(3):1044–1061

    Article  Google Scholar 

  60. Robinett W (1992) Synthetic experience: A proposed taxonomy. Presence: Teleoperators Virtual Environ 1(2):229–247

    Article  Google Scholar 

  61. Sauter VL (2010) Decision support systems for business intelligence, 2nd edn. Wiley, Hoboken

    MATH  Google Scholar 

  62. Schall G, Mendez E, Kruijff E, Veas E, Junghanns S, Reitinger B, Schmalstieg D (2009) Handheld augmented reality for underground infrastructure visualization. Personal Ubiquit Comput 13(4):281–291

    Article  Google Scholar 

  63. Schmalstieg D, Hollerer T (2016) Augmented reality: principles and practice. Addison-Wesley Professional, Boston

    Google Scholar 

  64. Sicat R, Li J, Choi JY, Cordeil M, Jeong W, Bach B, Pfister H (2019) DXR?: A toolkit for building immersive data visualizations. IEEE Trans Visual Comput Graphics 25(1):715–725

    Article  Google Scholar 

  65. Sutherland IE (1968) A head-mounted three-dimensional display. In: Proceedings of December 9-11, 1968, fall joint computer conference, part I. ACM Press, New York, pp 757–764

  66. Syberfeldt A, Holm M, Danielsson O, Wang L, Lindgren Brewster R (2016) Support systems on the industrial shop-floors of the future: Operators’ perspective on augmented reality. In: 6th CIRP conference on assembly technologies and systems (CATS), Gothenburg, May 16-18, 2016, vol 44. Elsevier, pp 108–113

  67. Tatzgern M (2015) Situated visualization in augmented reality (Doctoral dissertation, PhD thesis Graz University of Technology), Graz, Austria

  68. Thomas BH, Welch GF, Dragicevic P, Elmqvist N, Irani P, Jansen Y, Willett W et al (2018) Situated analytics. In: Marriott K. (ed) Immersive analytics. Lecture notes in computer science, vol 11190. Springer, Cham

  69. Turban E, Liang TP, Aronson JE (2005) Decision support systems and intelligent systems. (International Edition). Pearson Prentice Hall

  70. Ware C (2019) Information visualization: Perception for design. Morgan Kaufmann, Burlington

    Google Scholar 

  71. White SM, Feiner S (2009) Interaction and presentation techniques for situated visualization. Columbia University, Columbia

    Google Scholar 

  72. White S, Feiner S (2009) Sitelens: Situated visualization techniques for urban site visits. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 1117–1120

  73. White S, Morozov P, Oda O, Feiner S (2008) Progress towards site visits by situated visualization. In: Proceedings of ACM CHI 2008 Workshop: Urban Mixed Reality

  74. Willett W, Jansen Y, Dragicevic P (2017) Embedded data representations. IEEE Trans Vis Comput Graph 23(1):461–470

    Article  Google Scholar 

  75. Zhengmeng C, Haoxiang J (2011) A brief review on Decision Support Systems and it’s applications. In: 2011 IEEE international symposium on it in medicine and Education, vol 2. IEEE, pp 401–405

  76. Zhou F, Duh H, Billinghurst M (2008) Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In: Proceedings of the 7th IEEE/ACM international symposium on mixed and augmented reality. IEEE Computer Society, Cambridge, pp 193–202

  77. Zhu B, Chen H (2008) Information visualization for decision support. In: Handbook on decision support systems 2. Springer, Berlin, pp 699–722

Download references

Acknowledgements

We would like to thank the reviewers for their thoughtful comments and efforts towards improving this manuscript. This study was supported by IEETA - Institute of Electronics and Informatics Engineering of Aveiro, funded by National Funds through the FCT - Foundation for Science and Technology, in the context of the project UID/CEC/00127/2019.

Author information

Authors and Affiliations

  1. IEETA - Universidade de Aveiro, Coimbra Institute of Engineering - Polytechnic Institute of Coimbra, Coimbra, Portugal

    Nuno Cid Martins

  2. IEETA/DETI, Universidade de Aveiro, Aveiro, Portugal

    Bernardo Marques, João Alves, Paulo Dias & Beatriz Sousa Santos

  3. IEETA - Universidade de Aveiro, PPGCC - Universidade Federal do Pará, Belém, Brasil

    Tiago Araújo

Authors
  1. Nuno Cid Martins
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bernardo Marques
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. João Alves
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tiago Araújo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Paulo Dias
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Beatriz Sousa Santos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nuno Cid Martins.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Martins, N.C., Marques, B., Alves, J. et al. Augmented reality situated visualization in decision-making. Multimed Tools Appl 81, 14749–14772 (2022). https://doi.org/10.1007/s11042-021-10971-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10971-4

Keywords

Search

Navigation