Skip to main content
SpringerLink
Log in

Storing user experiences in mixed reality using hypermedia

  • Special Issue Paper
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

This paper describes HyperMem, a system to store and replay user experiences in mixed environments. The experience is stored as a set of hypermedia nodes and links, with the information that was displayed along with the video of the real world that was navigated. It uses a generic hypermedia model, implemented as software components, to handle mixed reality environments. This model includes components for storing and replaying experiences and integrating them in the overall set of hypermedia graphs that can be accessed by a given user. The paper presents the goals of the system, the underlying hypermedia model, the application scenarios, and the architecture and tools for replaying and repurposing stored information.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Azuma, R.: A survey of augmented reality. Presence 6(4), 355–285 (1997)

    Google Scholar 

  2. Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. Appl. 21(6), 34–47 (2001)

    Article  Google Scholar 

  3. Aizawa, K., Hori, T., Kawasaki, S., Ishikawa, T.: Capture and efficient retrieval of life log. In: K. Mase, Y. Sumi, S. Fels (eds.) Pervasive 2004 Workshop on Memory and Sharing of Experiences, Vienna, Austria, pp. 15–20 (2004)

  4. Baus, J., Kruger, A., Wahlster, W.: A resource-adaptive mobile navigation system. In: International Conference on Intelligent User Interfaces, pp. 15–22. ACM, New York (2002)

    Google Scholar 

  5. Billinghurst, M., Hirkazu, K., Poupyrev, I.: The MagicBook: Moving seamlessly between reality and virtuality. IEEE Comput. Graph. Appl. 21(3), 2–4 (2001)

    Google Scholar 

  6. Björk, S., Falk, J., Hanson, R., Ljungstrand, P.: Pirates! Using the physical world as a game board. INTERACT 2001 IFIP TC.13 Conference on Human-Computer Interaction, Tokyo, Japan (2001)

  7. Bushnell, N.: Relationship between fun and the computer business. Commun. ACM 39(8), 31–37 (1996)

    Article  Google Scholar 

  8. Cheverst, K., Mitchell, K., Davies, N.: The role of adaptive hypermedia in a context-aware tourist guide. Commun. ACM 45(5), 47–51 (2002)

    Article  Google Scholar 

  9. De Bra, P., Houben, G., Wu, H.: AHAM: A Dexter-based reference model for adaptive hypermedia. Hypertext 1999 Conference, pp. 147–156, ACM (1999)

  10. Duri, S., Cole, A., Munson, J., Christensen, J.: An approach to providing a seamless end-user experience for location-aware applications. In: Proceedings of the 1st International Workshop on Mobile Commerce (WMC 2001), Rome, Italy, pp. 20–25. ACM, New York, NY, USA (2001)

    Chapter  Google Scholar 

  11. Fitzgibbon, A., Reiter, E.: Memories for life – managing information over a human lifetime. In: Grand Challenges for Computing Research, Sponsored by the UK Computing Research Committee, with support from EPSRC and NeSC, http://www.nesc.ac.uk/esi/events/Grand_Challenges/

  12. Gemmell, J., Bell, G., Lueder, R., Drucker, S., Wong, C.: MyLifeBits: fulfilling the Memex vision. ACM Multimedia 2002, December, Juan-les-Pins, France, pp. 235–238. ACM, New York (2002)

    Google Scholar 

  13. Graham, J., Erol, B., Hull, J., Lee, D.: The video paper multimedia playback system. ACM Multimedia 2003, Berkeley, USA. ACM, New York (2003)

    Google Scholar 

  14. Grønbæk, K., Trigg, R.: Design issues for a Dexter-based hypermedia. In: ECHT Conference Proceedings, pp. 191–200. ACM, New York (1992)

    Google Scholar 

  15. Grønbæk, P., Vestergaard, P., Orbaek, P.: Towards geo-spatial hypermedia: concepts and prototype implementation. In: Hypertext 2002, pp. 117–126. ACM, New York (2002)

    Google Scholar 

  16. Halasz, F., Schwartz, M.: The Dexter hypertext reference model. Commun. ACM 37(2), 30–38 (1994)

    Article  Google Scholar 

  17. Hall, T., Ciolfi, L., Bannon, L., Fraser, M., Benford, S., Bowers, J., Greenhalgh, C., Hellstrom, S., Izadi, S., Schnadelbach, H.: The visitor as virtual archaeologist: explorations in mixed reality technology to enhance educational and social interaction in the museum. In: Conference on Virtual Reality, Archeology, and Cultural Heritage, Glyfada, Greece, pp. 91–96. ACM, New York, NY, USA (2001)

    Chapter  Google Scholar 

  18. Hardman, L., Bulterman, D., Rossum, G.: The Amsterdam hypermedia model: adding time and context to the Dexter model. Commun. ACM 37(2), 50–62 (1995)

    Article  Google Scholar 

  19. Korkeaaho, M.: Context-aware applications survey. Department of Computer Science, Helsinki University of Technology (2000)

  20. Lin, N., Mase, K., Sumi, Y.: An object centric storytelling framework using ubiquitous sensor technology. In: K. Mase, Y. Sumi, S. Fels (eds.) Pervasive 2004 Workshop on Memory and Sharing of Experiences, Vienna, Austria, pp. 31–34 (2004)

  21. Long, S., Kooper, K., Abowd, G., Atkeson, C.: Rapid prototyping of mobile context-aware applications: the cyberguide case study. In: International Conference on Mobile Computing and Networking, pp. 97–107. ACM, New York (1996)

    Google Scholar 

  22. Pea, R., Mills, M., Rosen, J., Dauber, K., Effelsberg, W., Hoffert, E.: The diver project: interactive digital video repurposing. IEEE Multimedia 11(1), 54–61 (2004)

    Article  Google Scholar 

  23. Piekarski, W., Thomas, B.: ARQuake: The outdoor augmented reality gaming system. Commun. ACM 45(1), 36–38 (2002)

    Article  Google Scholar 

  24. Romero, L., Correia, N.: HyperReal: A hypermedia model for Mixed Reality. In: Hypertext 2003 Conference, Nottingham, UK, pp. 2–9. ACM, New York (2003)

    Google Scholar 

  25. Romero, L., Santiago, J., Correia, N.: Contextual information access and storytelling in mixed reality using hypermedia. Comput. Entertain. (CIE) 2(3), 12–12 (2004)

    Article  Google Scholar 

  26. Sawhney, N., Balcom, D., Smith, I.: HyperCafe: Narrative and aesthetic properties of hypervideo. In: Hypertext 1996 Conference, pp. 1–10. ACM, New York (1996)

    Chapter  Google Scholar 

  27. Starner, T., Leibe, B., Singletary, B., Pair, J.: MIND-WARPING: towards creating a compelling collaborative augmented reality game. In: Proceedings of the 5th International Conference on Intelligent User Interfaces (IUI), New Orleans, LA, USA, pp. 256–259. ACM, New York, NY, USA (2000)

    Chapter  Google Scholar 

  28. Szalavári, Z., Eckstein, E., Gervautz, M.: Collaborative gaming in augmented reality. In: ACM Symposium on Virtual Reality Software and Technology, Taipei, Taiwan, pp. 195–204. ACM, New York, NY, USA (1998)

    Google Scholar 

  29. Tamura, H., Yamamoto, H., Katayama, A.: Mixed reality: future dreams seen at the border between real and virtual worlds. IEEE Comput. Graph. Appl. 21(6), 64–70 (2001)

    Article  Google Scholar 

  30. Thomas, B., Close, B., Donoghue, J., Squires, J., De Bondi, P., Morris, M., Piekarski, W.: ARQuake: an outdoor/indoor augmented reality first person application. In: Proceedings of 4th International Symposium on Wearable Computers (ISWC 2000), Atlanta, GA, USA, pp. 139–146. IEEE Computer Society (2000)

  31. Truong, K., Abowd, G., Brotherton, J.: Personalizing the capture of public experiences. In: 12th Annual ACM Symposium on User Interface Software and Technology (UIST’99), Asheville, USA, pp. 121–130. ACM, New York (1999)

    Chapter  Google Scholar 

  32. Weal, M., Michaelides, D., Thompson, M., De Roure, D.: The ambient wood journals – replaying the experience. In: Hypertext 2003 Conference, Nottingham, UK, pp. 20–27. ACM, New York (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Interactive Multimedia Group, CITI/DI, New University of Lisbon, Lisbon, Portugal

    Nuno Correia & Luis Romero

  2. School of Technology and Management, Viana do Castelo Polytechnical Institute, Viana do Castelo, Portugal

    Luis Romero

Authors
  1. Nuno Correia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luis Romero
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nuno Correia.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Correia, N., Romero, L. Storing user experiences in mixed reality using hypermedia. Visual Comput 22, 991–1001 (2006). https://doi.org/10.1007/s00371-006-0039-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-006-0039-x

Keywords

Search

Navigation