Luigi Gallo
Giuseppe De Pietro
ABSTRACT
Immersive Virtual Reality environments are suitable to support activities related to medicine and medical practice. The immersive visualization of information-rich 3D objects, coming from patient scanned data, provides clinicians with a clear perception of depth and shapes. However, to benefit from immersive visualization in medical imaging, where inspection and manipulation of volumetric data are fundamental tasks, medical experts have to be able to act in the virtual environment by exploiting their real life abilities. In order to reach this goal, it is necessary to take into account user skills and needs so as to design and implement usable and accessible human-computer interaction interfaces. In this paper we present a natural interface for a semi-immersive virtual environment. Such interface is based on an off-the-shelf handheld wireless device and a speech recognition component, and provides clinicians with intuitive interaction modes for inspecting volumetric medical data.
- Salgado, R., Mulkens, T., Bellinck, P. and Termote, J. L., "Volume rendering in clinical practice. A pictorial review", JBR-BTR, 86(4): 215--20 (2003).Google Scholar
- Robb, R. A. "The Biomedical Imaging Resource at Mayo Clinic", IEEE Trans. Med. Imaging, 20(9): 854--867 (2001).Google ScholarCross Ref
- Wu, Y. and Yencharis, L. "Commercial 3-D Imaging Software Migrates to PC Medical Diagnostics", Advanced Imaging Magazine, 16--21 (1998).Google Scholar
- Rosset, A., Spadola, L., Ratib, O. 2004. OsiriX: a new generation of multidimensional DICOM viewer based on new imaging standards. In Proceedings of the 18th International Congress and Exhibition of Computer Assisted Radiology and Surgery (Chicago, USA, June 23--26, 2004). CARS 2004.Google ScholarCross Ref
- Narayan, M., Waugh, L., Zhang, X., Bafna, P. and Bowman, D. 2005. Quantifying the benefits of immersion for collaboration in virtual environments. In Proceedings of the ACM symposium on Virtual reality software and technology (Monterey, California, USA, November 07--09, 2005). VRST 2005. Google ScholarDigital Library
- Bowman, D. A., Chen, J., Wrave, C. A, Lucas, J., Ray, A., Polys, N. F., Li, Q., Haciahmetoglu, Y., Kim, J. S., Kim, S., Boehringer, R. and Ni, T., "New Directions in 3D User Interfaces", The International Journal of Virtual Reality, 5(2): 3--14 (2006).Google ScholarCross Ref
- Nintendo Wii, http://it.wii.com/Google Scholar
- Coronato, A., De Pietro, G., and Marra, I. 2006. An Open-Source Software Architecture for Immersive Medical Imaging. In Proceedings of the IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems (La Coruna, Spain, July 10--12, 2006). VECIMS 2006.Google Scholar
- WiiLi, a GNU/Linux port for the Nintendo Wii, http://www.wiili.orgGoogle Scholar
- WiiBrew Wiki, http://wiibrew.org/index.php?title=WiimoteGoogle Scholar
- Dech, F. and Silverstein, J. C. 2002. Rigorous Exploration of Medical Data in Collaborative Virtual Reality Applications. In Proceedings of the International Conference on Information Visualisation (London, UK, July 10--12, 2002). IV 2002.Google Scholar
- Gallo, L., De Pietro, G. and Marra, I. 2008. 3D Interaction with Volumetric Medical Data: experiencing the Wiimote. To appear in Proceedings of the First International Conference on Ambient Media and Systems (Quebec City, Canada, February 4--7, 2008). Ambi-sys 2008. Google ScholarDigital Library
- Sphinx-III speech recognition system, http://cmusphinx.sourceforge.net/html/cmusphinx.phpGoogle Scholar
Index Terms
- Toward a natural interface to virtual medical imaging environments
Recommendations
3D interaction with volumetric medical data: experiencing the Wiimote
Ambi-Sys '08: Proceedings of the 1st international conference on Ambient media and systemsThree-dimensional virtual environments are becoming more and more important for the inspection of volumetric medical data reconstructed from slices of images coming from Magnetic Resonance Imaging (MRI), Computer Tomography (CT), Positron Emission ...
NextMed, Augmented and Virtual Reality platform for 3D medical imaging visualization: Explanation of the software platform developed for 3D models visualization related with medical images using Augmented and Virtual Reality technology
TEEM'19: Proceedings of the Seventh International Conference on Technological Ecosystems for Enhancing MulticulturalityThe visualization of the radiological results with more advanced techniques than the current ones, such as Augmented Reality and Virtual Reality technologies, represent a great advance for medical professionals, by eliminating their imagination capacity ...
Coordinated 3D interaction in tablet- and HMD-based hybrid virtual environments
SUI '14: Proceedings of the 2nd ACM symposium on Spatial user interactionTraditional 3D User Interfaces (3DUI) in immersive virtual reality can be inefficient in tasks that involve diversities in scale, perspective, reference frame, and dimension. This paper proposes a solution to this problem using a coordinated, tablet- ...
Comments