skip to main content
10.1145/2671015.2671031acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
research-article

Profiling and benchmarking event- and message-passing-based asynchronous realtime interactive systems

Published:11 November 2014Publication History

ABSTRACT

This article describes a set of metrics for a message-passing-based asynchronous Realtime Interactive System (RIS). Current trends in concurrent RISs are analyzed, several profiling tools are outlined, and common metrics are identified. A set of nine metrics is presented in a unified and formalized way. The implementation of a profiler that measures and calculates these metrics is illustrated. The implementation of an instrumentation and a visualization tool are described. A case study shows how this approach proved beneficial during the optimization of latency of an actual system.

References

  1. Abdelkhalek, A., and Bilas, A. 2004. Parallelization and performance of interactive multiplayer game servers. In Parallel and Distributed Processing Symposium, 2004. Proceedings. 18th International, 72--.Google ScholarGoogle Scholar
  2. Agha, G. 1985. Actors: A Model Of Concurrent Computation In Distributed Systems. PhD thesis, MIT Artificial Intelligence Laboratory. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Allard, J., Gouranton, V., Lecointre, L., Melin, E., and Raffin, B. 2002. Net juggler and softgenlock: Running vr juggler with active stereo and multiple displays on a commodity component cluster. In Proceedings of IEEE Virtaul Reality Conference 2002, 273--274. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Assenmacher, I., and Kuhlen, T. 2008. The vista virtual reality toolkit. In Latoschik et al. {Latoschik et al. 2008}, 23--26.Google ScholarGoogle Scholar
  5. Best, M. J., Fedorova, A., Dickie, R., Tagliasacchi, A., Couture-Beil, A., Mustard, C., Mottishaw, S., Brown, A., Huang, Z. F., Xu, X., Ghazali, N., and Brownsword, A. 2009. Searching for concurrent design patterns in video games. In Proceedings of the 15th International Euro-Par Conference on Parallel Processing, Springer-Verlag, Berlin, Heidelberg, Euro-Par '09, 912--923. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Bierbaum, A. D. 2000. VR Juggler: A Virtual Platform for Virtual Reality Application Developement. PhD thesis, Iowa State University.Google ScholarGoogle Scholar
  7. Bues, M., Gleue, T., and Blach, R. 2008. Lightning: Dataflow in motion. In Latoschik et al. {Latoschik et al. 2008}, 7--11.Google ScholarGoogle Scholar
  8. Deligiannidis, L. 2000. Dlove: a specification paradigm for designing distributed vr applications for single or multiple users. PhD thesis, Tufts University, Medford, MA, USA. AAI9955979. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Futuremark, 2014. http://www.futuremark.com/benchmarks/3dmark.Google ScholarGoogle Scholar
  10. Hewitt, C., Bishop, P., and Steiger, R. 1973. A universal modular ACTOR formalism for artificial intelligence. In IJCAI' 73: Proceedings of the 3rd international joint conference on Artificial intelligence, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 235--245. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Hollingsworth, J. K., Lumpp, J., and Miller, B. P. 1995. Techniques for performance measurement of parallel programs. Parallel Computers: Theory and Practice.Google ScholarGoogle Scholar
  12. Hu, L., and Gorton, I. 1997. Performance evaluation for parallel systems: A survey. Citeseer.Google ScholarGoogle Scholar
  13. Lamport, L. 1978. Time, clocks, and the ordering of events in a distributed system. Commun. ACM 21, 7 (July), 558--565. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Latoschik, M. E., and Tramberend, H. 2011. Simulator X: A Scalable and Concurrent Software Platform for Intelligent Realtime Interactive Systems. In Proceedings of the IEEE VR 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Latoschik, M. E., Reiners, D., Blach, R., Figueroa, P., and Dachselt, R., Eds. 2008. Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), proceedings of the IEEE Virtual Reality 2008 workshop, Shaker Verlag.Google ScholarGoogle Scholar
  16. Lee, E. A. 2006. The problem with threads. Computer 39 (May), 33--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Lesage, J.-D., and Raffin, B. 2008. High performance interactive computing with flowvr. In Latoschik et al. {Latoschik et al. 2008}, 13--16.Google ScholarGoogle Scholar
  18. Margery, D., Arnaldi, B., Chauffaut, A., Donikian, S., and Duval, T. 2002. Openmask: Multi-Threaded---Modular animation and simulation Kernel---Kit: a general introduction. In VRIC 2002 Proceedings, S. Richir, P. Richard, and B. Taravel, Eds., 101--110.Google ScholarGoogle Scholar
  19. Mönkkö Nen, V., 2006. Multithreaded game engine architectures. WWW, Sep.Google ScholarGoogle Scholar
  20. Oculus VR, 2014. https://www.oculusvr.com/order/latency-tester/.Google ScholarGoogle Scholar
  21. Odersky, M., 2011. The scala language specification version 2.9, may.Google ScholarGoogle Scholar
  22. Rohlf, J., and Helman, J. 1994. Iris performer: a high performance multiprocessing toolkit for real-time 3d graphics. In Proceedings of the 21st annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, SIGGRAPH '94, 381--394. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Roscoe, A. W., Hoare, C. A. R., and Bird, R. 1997. The Theory and Practice of Concurrency. Prentice Hall PTR, Upper Saddle River, NJ, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Schröder, D., Wefers, F., Pelzer, S., Rausch, D., Vorländer, M., and Kuhlen, T. 2010. Virtual reality system at rwth aachen university. In Proceedings of the International Symposium on Room Acoustics (ISRA), Melbourne, Australia.Google ScholarGoogle Scholar
  25. Sigitov, A., Roth, T., Mannuss, F., and Hinkenjann, A. 2013. Drive: An example of distributed rendering in virtual environments. In Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), 2013 6th Workshop on, 33--40.Google ScholarGoogle Scholar
  26. Simulator X, 2014. https://github.com/simulator-x.Google ScholarGoogle Scholar
  27. Steed, A. 2008. A simple method for estimating the latency of interactive, real-time graphics simulations. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology, ACM, New York, NY, USA, VRST '08, 123--129. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Steed, A. 2008. Some useful abstractions for re-usable virtual environment platforms. In Latoschik et al. {Latoschik et al. 2008}, 33--36.Google ScholarGoogle Scholar
  29. Sutter, H. 2005. The free lunch is over: A fundamental turn toward concurrency in software. Dr. Dobb's Journal.Google ScholarGoogle Scholar
  30. Tramberend, H. 1999. Avocado: a distributed virtual reality framework. In Virtual Reality, 1999. Proceedings., IEEE, 14--21. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Tramberend, H. 2003. Avocado: a Distributed Virtual Environment framework. PhD thesis, Bielefeld University.Google ScholarGoogle Scholar
  32. Typesafe Inc., 2014. http://doc.akka.io/docs/akka/2.3.2/general/actor-systems.html.Google ScholarGoogle Scholar
  33. ViSTA, 2013. http://sourceforge.net/projects/vistavrtoolkit/.Google ScholarGoogle Scholar
  34. VisualVM, 2014. http://visualvm.java.net/.Google ScholarGoogle Scholar
  35. VTune, 2013. https://software.intel.com/en-us/intel-vtune-amplifier-xe.Google ScholarGoogle Scholar
  36. Waldo, J. 2008. Scaling in games & virtual worlds. Queue 6 (November), 10--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. YourKit, 2014. http://www.yourkit.com/features/.Google ScholarGoogle Scholar

Index Terms

  1. Profiling and benchmarking event- and message-passing-based asynchronous realtime interactive systems

                Recommendations

                Comments

                Login options

                Check if you have access through your login credentials or your institution to get full access on this article.

                Sign in
                • Published in

                  cover image ACM Conferences
                  VRST '14: Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology
                  November 2014
                  238 pages
                  ISBN:9781450332538
                  DOI:10.1145/2671015

                  Copyright © 2014 ACM

                  Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                  Publisher

                  Association for Computing Machinery

                  New York, NY, United States

                  Publication History

                  • Published: 11 November 2014

                  Permissions

                  Request permissions about this article.

                  Request Permissions

                  Check for updates

                  Qualifiers

                  • research-article

                  Acceptance Rates

                  Overall Acceptance Rate66of254submissions,26%

                  Upcoming Conference

                  VRST '24

                PDF Format

                View or Download as a PDF file.

                PDF

                eReader

                View online with eReader.

                eReader