Roberto Gerson de Albuquerque Azevedo
ABSTRACT
The availability of 3D-enabled displays, both stereoscopic and autostereoscopic ones, is growing in the market. However, most of the current multimedia digital TV standard for describing interactive applications does not take advantage of these technologies. A useful and flexible way to codify 3D-video to work with both stereoscopic and autoestereoscopic displays is using video plus depth-per-pixel information. In order to improve authoring of interactive digital TV applications written in NCL (Nested Context Language), the Latin-American standard for digital TV, this paper proposes some extensions to this language to allow multimedia authors to be aware of depth information. Among the new features provided it is the control and animation of depth information for synthetic and non-synthetic media objects. As it is based on 2D+depth information, the proposed extensions will enable multimedia authors to take advantage of stereo and autostereoscopic displays, and also are compatible with previous versions of NCL players.
- P. Benzie, J. Watson, P. Surman, I. Rakkolainen, K. Hopf, H. Urey e V. a. V. K. C. Sainov, "A Survey of 3dtv Displays: Techniques and Technologies.," IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, nº 11, pp. 1647--1658, 2007. Google Scholar
Digital Library
- K. Muller, P. Merkle e T. Wiegand, "3-D Video Representation Using Depth Maps," Proceedings of the IEEE, vol. 99, nº 4, pp. 643--656, 2011.Google ScholarCross Ref
- M. Halle, "Autostereoscopic Displays and Computer Graphics," ACM SIGGRAPH 2005 Courses, Los Angeles, Californi, 2005. Google ScholarDigital Library
- S.-Y. Kim e Y.-S. Ho, "Mesh-Based Depth Coding for 3D Video using Hierarchical Decomposition of Depth Maps," IEEE International Conference on Image Processing, 2007 (ICIP 2007), 2007.Google Scholar
- A. Vetro, T. Wiegand e G. J. and Sullivan, "Overview of the stereo and multiview video coding extensions of the H.264/AVC standard," Proc. IEEE, Special Issue on 3D Media and Displays, 2011.Google Scholar
- A. Bourge, J. Gobert e F. Bruls, "MPEG-C PART 3: Enabling the Introduction of Video plus Depth Contents," 2006.Google Scholar
- H. a. K. S. Shum, "A Review of Image-based Rendering Techniques," IEEE/SPIE Visual Communications and Image Processing (VCIP) 2000, 2000.Google Scholar
- C. Fehn, "A 3D-TV Approach Using Depth-Image-Based Rendering (DIBR)," Proceedings of Visualization, Imaging, and Image Processing, 2003.Google Scholar
- L. F. G. Soares, R. F. Rodrigues e M. F. Moreno, "Ginga-NCL: the Declarative Environment of the Brazilian Digital TV System," Journal of the Brazilian Computer Society, vol. 12, nº 4, pp. 37--46, Mar 2007.Google ScholarCross Ref
- J. L. Feuvre, "Towards Declarative 3D in Web Architecture," Workshop Proceedings of CEURS (DEC3D), 2012.Google Scholar
- J. L. Feuvre, 2010. {Online}. Available: http://www.svgopen.org/2010/papers/54-SVG_Extensions_for_3D_displays.Google Scholar
- H. S. Prashanth, H. L. Shashidhara e K. N. Balasubramanya Murthy, "Image Scaling Comparison Using Universal Image Quality Index," International Conference on Advances in Computing, Control, Telecommunication Technologies, 2009 (ACT '09), 2009. Google ScholarDigital Library
- R. G. A. Azevedo e L. F. G. Soares, "Embedding 3D Objects into NCL Multimedia Presentations," 17th International Conference on 3D Web Technology, 2012. Google ScholarDigital Library
- F. Sant'Anna, R. Cerqueira e L. F. G. Soares, "NCLua: Objetos Imperativos Lua na Linguagem NCL," 14th Brazilian Symposium on Multimedia and the Web, 2008. Google ScholarDigital Library
- R. G. A. Azevedo, "Suporte ao controle e à apresentação de objetos de mídia tridimensionais em NCL," Rio de Janeiro, 2010.Google Scholar
- M. Kim, S. Wood e L. Cheok, "Extensible MPEG-4 textual format (XMT)," ACM workshops on Multimedia (MULTIMEDIA'00)., New York, NY, 2000. Google ScholarDigital Library
- Web3D, "Extensible 3D (X3D)", ISO/IEC 19776--1.2:2009., 2009.Google Scholar
- Y.-F. Tsai, C.-P. Young e C.-C. Ku, "Design and implementation of a flash player supporting stereoscopic image," Eighth Int. Conf. on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), 2012. Google ScholarDigital Library
- O. Nocent, S. Piotin, A. Benassarou, M. Jaisson, Lucas e L., "Toward an immersion platform for the World Wide Web using autostereoscopic displays and tracking devices," 17th International Conference on 3D Web Technology (WEB3D'12), 2012. Google ScholarDigital Library
Index Terms
- NCL+Depth: extending NCL for stereo/autostereoscopic 3D displays
Recommendations
Extending NCL to Support Multiuser and Multimodal Interactions
Webmedia '16: Proceedings of the 22nd Brazilian Symposium on Multimedia and the WebRecent advances in technologies for speech, touch and gesture recognition have given rise to a new class of user interfaces that does not only explore multiple modalities but also allows for multiple interacting users. Even so, current declarative ...
An Approach to Convert NCL Applications into Stereoscopic 3D
DocEng '15: Proceedings of the 2015 ACM Symposium on Document EngineeringThis paper presents and discusses the internal operation of NCLSC (NCL Stereo Converter): a tool to convert a 2D interactive multimedia application annotated with depth information to a stereoscopic-multimedia application. Stereoscopic-multimedia ...
Specification of Multimodal Interactions in NCL
WebMedia '15: Proceedings of the 21st Brazilian Symposium on Multimedia and the WebThis paper proposes an approach to integrate multimodal events--both user-generated, e.g., audio recognizer, motion sensors; and user-consumed, e.g., speech synthesizer, haptic synthesizer--into programming languages for the declarative specification of ...
Comments