Skip to main content
SpringerLink
Log in

Format-independent and metadata-driven media resource adaptation using semantic web technologies

  • Original Research Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Adaptation of media resources is an emerging field due to the growing amount of multimedia content on the one hand and an increasing diversity in usage environments on the other hand. Furthermore, to deal with a plethora of coding and metadata formats, format-independent adaptation systems are important. In this paper, we present a new format-independent adaptation system. The proposed adaptation system relies on a model that takes into account the structural metadata, semantic metadata, and scalability information of media bitstreams. The model is implemented using the web ontology language. Existing coding formats are mapped to the structural part of the model, while existing metadata standards can be linked to the semantic part of the model. Our new adaptation technique, which is called RDF-driven content adaptation, is based on executing SPARQL Protocol and RDF Query Language queries over instances of the model for media bitstreams. Using different criteria, RDF-driven content adaptation is compared to other adaptation techniques. Next to real-time execution times, RDF-driven content adaptation provides a high abstraction level for the definition of adaptations and allows a seamless integration with existing semantic metadata standards.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Listing 1
Listing 2
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

Notes

  1. http://xmlns.com/foaf/spec/.

  2. http://www.w3.org/2005/Incubator/mmsem/XGR-vocabularies/#formal-DIG35.

  3. http://www.w3.org/2005/Incubator/mmsem/XGR-vocabularies/#formal-Exif.

  4. The amount of RDF triples to represent the scalability information and semantic metadata is in this case negligible in comparison with the amount of triples needed for the structural metadata. Note that in our configuration, one triple took approximately 90 bytes of disk usage.

  5. Version 1.3.1 of the BSDL reference software and version 2008-03-09 of the STX engine Joost were used.

  6. A Bitstream Syntax Schema describes the high-level structure of a specific coding format.

  7. Version 2.0.1 of Sesame was used.

  8. In our case, a simple soccer ontology was used, including concepts such as SoccerMatch and SoccerScene, as well as properties such as levelOfImportance.

References

  1. Amielh, M., Devillers, S.: Multimedia content adaptation with XML. In: Proceedings of 8th International Conference on Multimedia Modeling, pp. 127–145. Amsterdam, The Netherlands (2001)

  2. Arndt, R., Troncy, R., Staab, S., Hardman, L., Vacura, M.: COMM: Designing a Well-Founded Multimedia Ontology for the Web. In: 6th International Semantic Web Conference (ISWC 2007). Busan, Korea (2007)

  3. Bulterman, D., Grassel, G., Jansen, J., Koivisto, A., Layaïda, N., Michel, T., Mullender, S., Zucker, D. (eds.): Synchronized Multimedia Integration Language (SMIL 2.1). W3C Recommendation. World Wide Web Consortium (2005). http://www.w3.org/TR/SMIL2/

  4. Burnett, I., Pereira, F., Van de Walle, R., Koenen, R. (eds.): The MPEG-21 Book. Wiley, NY (2006)

    Google Scholar 

  5. Cimprich, P., et al.: Streaming Transformations for XML (2004). Available on http://stx.sourceforge.net/documents/spec-stx-20040701.html

  6. De Bruyne, S., De Schrijver, D., De Neve, W., Van Deursen, D., Van de Walle, R.: Enhanced shot-based video adaptation using MPEG-21 generic bitstream syntax schema. In: Proceedings of the 2007 IEEE Symposium Series on Computational Intelligence, 6 pp on CD–rom. Honolulu, Hawai (2007)

  7. De Neve, W., Van Deursen, D., De Schrijver, D., De Wolf, K., Lerouge, S., Van de Walle, R.: BFlavor: a harmonized approach to media resource adaptation, inspired by MPEG-21 BSDL and XFlavor. Signal Process. Image Commun. 21(10), 862–889 (2006)

    Article  Google Scholar 

  8. De Neve, W., Van Deursen, D., De Schrijver, D., De Wolf, K., Van de Walle, R.: Using Bitstream Structure Descriptions for the Exploitation of Multi-layered Temporal Scalability in H.264/MPEG-4 AVC’s Base Specification. Lecture Notes in Computer Science, Advances in Multimedia Information Processing, vol. 3767, pp. 641–652 (2005)

  9. Decker, S., Melnik, S., van Harmelen, F., Fensel, D., Klein, M.C.A., Broekstra, J., Erdmann, M., Horrocks, I.: The semantic web: the roles of XML and RDF. IEEE Internet Comput 4(5), 63–74 (2000)

    Article  Google Scholar 

  10. Devillers, S., Timmerer, C., Heuer, J., Hellwagner, H.: Bitstream Syntax Description-Based Adaptation in Streaming and Constrained Environments. IEEE Trans. Multimedia 7(3), 463–470 (2005)

    Article  Google Scholar 

  11. Hannuksela, M.M., Wang, Y.K., Gabbouj, M.: Isolated regions in video coding. IEEE Trans. Multimedia 6, 259–267 (2004)

    Article  Google Scholar 

  12. Hong, D., Eleftheriadis, A.: XFlavor: bridging bits and objects in media representation. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 4 on CD–rom. Lausanne, Switzerland (2002)

  13. Hunter, J.: Adding multimedia to the semantic web—building an MPEG-7 ontology. In: First Semantic Web Working Symposium (SWWS), Proceedings, pp. 261–281. Stanford, USA (2001)

  14. ISO/IEC: 21000-7:2004 Information Technology—Multimedia Framework (MPEG-21)—Part 7: Digital Item Adaptation (2004)

  15. Kay, M.: XSLT Programmers’s Reference, 2nd edn. Wrox Press Ltd., Birmingham (2001)

    Google Scholar 

  16. Klyne, G., Carroll, J.J. (eds.): Resource Description Framework (RDF): Concepts and Abstract Syntax. W3C Recommendation. World Wide Web Consortium (2004). http://www.w3.org/TR/rdf-concepts/

  17. Lerouge, S., Lambert, P., Van de Walle, R.: Multi-criteria Optimization for Scalable Bitstreams. Lecture Notes in Computer Science, Visual Content Processing and Representation, vol. 2849, pp. 122–130 (2003)

  18. Magalhães, J., Pereira, F.: Using MPEG standards for multimedia customization. Signal Process. Image Commun. 19(5), 437–456 (2004)

    Article  Google Scholar 

  19. McGuinness, D., van Harmelen, F. (eds.): OWL Web Ontology Language: Overview. W3C Recommendation. World Wide Web Consortium (2004). http://www.w3.org/TR/owl-features/

  20. Mukherjee, D., Delfosse, E., Kim, J.G., Wang, Y.: Optimal adaptation decision-taking for terminal and network quality of service. IEEE Trans. Multimedia 7(3), 454–462 (2005)

    Article  Google Scholar 

  21. Mukherjee, D., Said, A.: Structured scalable meta-formats (SSM) for digital Item adaptation. In: Internet Imaging IV, Proceedings of SPIE, vol. 5018 (2003)

  22. Ohm, J.R.: Advances in scalable video coding. Proc. IEEE 93(1), 42–56 (2005)

    Article  Google Scholar 

  23. Palmer, S.B.: Pondering RDF Path (2003). http://infomesh.net/2003/rdfpath

  24. Prud’hommeaux, E., Seaborne, A. (eds.): SPARQL Query Language for RDF. W3C Recommendation. World Wide Web Consortium (2007). http://www.w3.org/TR/rdf-sparql-query/

  25. Seaborne, A., Manjunath, G.: SPARQL/Update: A Language for Updating RDF Graphs (2008). http://jena.hpl.hp.com/~afs/SPARQL-Update.html

  26. Souzis, A.: RxPath: a mapping of RDF to the XPath Data Model. In: Extreme Markup Language 2006. Montreal, Canada (2006)

  27. Thomas-Kerr, J., Burnett, I., Ritz, C.: Format-independent multimedia streaming. In: Proceedings of 2006 IEEE International Conference on Multimedia and Expo (ICME), pp. 1509–1512 (2006)

  28. Timmerer, C., Frank, T., Hellwagner, H.: Efficient processing of MPEG-21 metadata in the binary domain. In: Proceedings of SPIE International Symposium ITCom 2005 on Multimedia Systems and Applications VIII. Boston, Massachusetts (2005)

  29. Timmerer, C., Panis, G., Kosch, H., Heuer, J., Hellwagner, H., Hutter, A.: Coding format independent multimedia content adaptation using XML. In: Proceedings of SPIE International Symposium ITCom 2003 on Internet Multimedia Management Systems IV, vol. 5242, pp. 92–103. Orlando (2003)

  30. Van Deursen, D., De Schrijver, D., De Bruyne, S., Van de Walle, R.: Fully format agnostic media resource adaptation using an abstract model for scalable bitstreams. In: Proceedings of the 2007 IEEE International conference on Multimedia and Expo, pp. 240–243. Beijing (2007)

  31. Van Lancker, W., De Sutter, R., De Schrijver, D., Van de Walle, R.: A Framework for transformations of XML within the binary domain. In: Proceedings of the IASTED international conference on Internet and Multimedia Systems and Applications, pp. 29–34 on CD–rom. Innsbruck, Austria (2006)

  32. Vetro, A., Christopoulos, C., Ebrahimi, T.: Universal multimedia access. IEEE Signal Process. Mag. 20(2), 16 (2003)

    Article  Google Scholar 

  33. W3C Multimedia Semantics Incubator Group: Available on http://www.w3.org/2005/Incubator/mmsem/

  34. Walsh, N.: RDF Twig: accessing RDF graphs in XSLT. In: Extreme Markup Language 2003. Montreal, Canada (2003)

Download references

Acknowledgments

The research activities that have been described in this paper were funded by Ghent University, the Interdisciplinary Institute for Broadband Technology (IBBT), the Institute for the Promotion of Innovation by Science and Technology in Flanders (IWT-Flanders), the Fund for Scientific Research-Flanders (FWO-Flanders), and the European Union.

Author information

Authors and Affiliations

  1. Multimedia Lab, Department of Electronics and Information Systems, Ghent University-IBBT, Belgium Gaston Crommenlaan 8, Bus 201, 9050, Ledeberg-Ghent, Belgium

    Davy Van Deursen, Wim Van Lancker, Sarah De Bruyne, Wesley De Neve, Erik Mannens & Rik Van de Walle

Authors
  1. Davy Van Deursen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wim Van Lancker
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sarah De Bruyne
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wesley De Neve
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Erik Mannens
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Rik Van de Walle
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Davy Van Deursen.

Additional information

Communicated by Dick Bulterman.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Van Deursen, D., Van Lancker, W., De Bruyne, S. et al. Format-independent and metadata-driven media resource adaptation using semantic web technologies. Multimedia Systems 16, 85–104 (2010). https://doi.org/10.1007/s00530-009-0178-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-009-0178-9

Keywords

Search

Navigation