John R. Smith
ABSTRACT
Growing numbers of pervasive devices are gaining access to the Internet and other information sources. However, much of the rich multimedia content cannot be easily handled by the client devices with limited communication, processing, storage and display capabilities. In order to improve access, we are developing a system for scalable delivery of multimedia. The system uses an InfoPyramid for managing and manipulating multimedia content composed of video, images, audio and text. The InfoPyramid manages the different variations of media objects with different fidelities and modalities and generates and selects among the alternatives in order to adapt the delivery to different client devices. We describe a system for scalable multimedia delivery for a variety of client devices, including PDAs, HHCs, smart phones, TV browsers and color PCs.
- 1.T. W. Bickmore and B. N. Schlit. Digestor: Deviceindependent access to the World-Wide Web. Proc. 6th Int. WWW Conf, 1997. Google Scholar
Digital Library
- 2.G. C. Vanderheiden. Anywhere, anytime (~anyone) access to the next-generation WWW. Proc. 6th Int. WWW Conf, 1997. Google ScholarDigital Library
- 3.H. Bharadvaj, A. Joshi, and S. Auephanwiriyakul. An active transcoding proxy to support mobile Web access. Proc. 17th {EEE Syrup. Reliable Distributed Syst., October 1998. Google ScholarDigital Library
- 4.A. Fox, S. D. Gribble, Y. Chawathe, and E. A. Brewer. Adapting to network and client variation using active proxies: Lessions and perspectives, iEEE Personal Comrnun., 40, 1998.Google Scholar
- 5.A. Fox, S. D. Gribble, E. A. Brewer, and E. Amir. Adapting to network and client variability via ondemand dynamic distillation. In ASPLOS-VII, Cambridge, MA, October 1996. Google ScholarDigital Library
- 6.A. Ortega, F. Carignano, S. Ayer, and M. Vetterli. Soft caching: Web cache management techniques for images. In Workshop on Multimedia Signal Processing, pages 475- 480, Princeton, NJ, June 1997. IEEE.Google ScholarCross Ref
- 7.J. R. Smith, R. Mohan, and C.-S. Li. Content-based transcoding of images in the Internet. In {EEE Proc. Int. Conf. Image Processing (ICIP), Chicago, I1, October 1998.Google Scholar
- 8.J. R. Smith, R. Mohan, and C.-S. Li. Transcoding Internet content for heterogenous client devices. In Proc. IEEE Inter. Syrup. on Circuits and Syst. ({SEAS), June 1998. Special session on Next Generation Internet.Google Scholar
- 9.Intel Quick Web. http://www.intel.com/quickweb.Google Scholar
- 10.Spyglass-Prism. http://www.spyglass/products/prism.Google Scholar
- 11.Unwired Planet. Handheld device markup language specification. Technical Report Version 2.0, Unwired Planet, Inc., April 1997.Google Scholar
- 12.L. Bouthillier. Synchronized multimedia on the Web. Web Techniques Magazine, 3(9), September 1998.Google Scholar
- 13.O. Avaro, P. Chou, A. Eleftheriadis, C. Herpel, and C. Reader. The MPEG-4 systems and description languages- A way ahead in audio visual information representation. Signal Processing: Image Communication, Special Issue on MPEG-4, 4(9):385-431, May 1997.Google Scholar
- 14.K. S. Candan, B. Prabhakaran, and V. S. Subrahmartian. CHIMP: A framework for supporting distributed multimedia document authoring and presentation. In Proc. A CM Intern. Conf. Multimedia (A CMMM), pages 329 - 339, Boston, MA, November 1996. Google ScholarDigital Library
- 15.A. Vogel, B. Kerherve, G. yon Bockmarm, and J. Gecsei. Distributed multimedia and QOS: A survey. IEEE Multimedia Mag., 2(2):10- 18, Summer 1994. Google ScholarDigital Library
- 16.R. Mohan, J. R. Smith, and C.-S. Li. Adapting multimedia internet content for universal access, iEEE Trans. Multimedia, 1(1):104 - 114, March 1999. Google ScholarDigital Library
- 17.L. Weitzman and K. Wittenburg. Automatic presentation of multimedia documents using relational grammars. In Proc. A CM Intern. Conf. Multimedia (ACMMM), pages 443- 451, San Francisco, CA, November 1994. Google ScholarDigital Library
- 18.J. R. Smith. Digital video libraries and the Internet. IEEE Communications Mag., 37(1):92 - 99, January 1999. Special issue on the Next Generation }nternet. Google ScholarDigital Library
- 19.R. Kling and M. Elliott. Digital library design for usability. In Proc. Conf. Theory and Practice of Digital Libraries, College Station, TX, June 1994.Google Scholar
- 20.J. R. Smith, C.-S. Li, and R. Mohan. Infopyramid description scheme for multimedia content. In MPEG-7 proposal, number MPEG99/P473 in ISO/IEC JTC1/SC29/WG11, Lancaster, UK, February 1999.Google Scholar
- 21.C. Christopoulos, T. Ebrahimi, V.V. Vinod, J. R. Smith, R. Mohan, and C.-S. Li. Universal access and media conversion. In MPEG-7 applications proposal, number MPEG99/M4433 in ISO/iEC JTC1/SC29/WG11, Seoul, Korea, March 1999.Google Scholar
- 22.J. R. Smith, C.-S. Li, R. Mohan, A. Puri, C. Christopoulos, A. B. Benitez, P. Bocheck, S.-F. Chang, T. Ebrahimi, and V. V. Vinod. MPEG-7 content description scheme for universal multimedia access. In MPEG. 7 proposal, number MPEG99/M4949 in ISO/IEC JTC1/SC29/WGll, Vancouver, BC, July 1999.Google Scholar
- 23.C.-S. Li, R. Mohan, and J. R. Smith. Multimedia content description in the InfoPyramid. In IEEE Proc. Int. Conf. Acoust., Speech, Signal Processing ({CASSP), Seattle, WA, May 1998. Special session on Signal Processing in Modem Multimedia Standards.Google Scholar
- 24.Y. Shoham and A. Gersho. Efficient bit allocation for an arbitrary set of quantizers. IEEE Trans. Acoust., Speech, Signal Processing, 36(9), September 1988.Google ScholarCross Ref
- 25.S. Paek and J. Ft. Smith. Detecting image purpose in World-Wide Web documents. In ISSIT/SPIE Symposium on Electronic Imaging: Science and Technology- Document Recognition, San Jose, CA, January 1998.Google Scholar
- 26.N. C. Rowe and B. Frew. Finding photograph captions multimodally on the World Wide Web. Technical Report Code CS/Rp, Dept. of Computer Science, Naval Postgraduate School, 1997.Google Scholar
- 27.J. R. Smith and S.~F. Chang. Visually searching the Web for content. IEEE Multimedia Mag., 4(3):12 - 20, July-September 1997. Google ScholarDigital Library
- 28.F. Reynolds, J. Hjelm, S. Dawkins, and S. Singhal. A user side framework for content negotiation: Composite capability/preference profiles (CC/PP). Technical Report http://www.w3.org/TR/NOTE-CCPP, W3C, November 1998.Google Scholar
- 29.M. Hori, R. Mohan, H. Maruyama, and S. Singhal. Annotation of web content for transcoding. Technical Report NOTE-annot-19990524, W3C, July 1999.Google Scholar
Index Terms
- Scalable multimedia delivery for pervasive computing
Recommendations
Scalable multimedia delivery with QoS management in pervasive computing environment
People are increasingly demanding rich-media and bundled services. However, the diverse terminals, heterogeneous networks as well as various user requirements constrain the multimedia access to low quality in the pervasive computing environment. In ...
Multimedia technology for pervasive computing environment
With the emerging multimedia techniques which can be used for various pervasive and ubiquitous applications such as healthcare, environmental monitoring, security and surveillance, there are a number of important challenges that arise when multimedia ...
Intelligent and Pervasive Multimedia Systems
Recent advances in pervasive computing and the proliferation of multimedia-capable devices have stimulated the development of intelligent and pervasive multimedia applications. This special issue provides excellent coverage of this area, including ...
Comments