Skip to main content
Log in

An MPEG-7 query language and a user preference model that allow semantic retrieval and filtering of multimedia content

Multimedia Systems Aims and scope Submit manuscript

Abstract

We present in this paper the MPEG-7 Query Language (MP7QL), a powerful query language that we have developed for querying MPEG-7 descriptions, as well as its compatible Filtering and Search Preferences (FASP) model. The MP7QL has the MPEG-7 as data model and allows for querying every aspect of an MPEG-7 multimedia content description. It allows the users to express the conditions that should hold for the multimedia content returned to them regarding semantics, low-level visual and audio features and media-related aspects. The MP7QL queries may utilize the users’ FASP and Usage History as context, thus allowing for personalized multimedia content retrieval. The FASP model supported is compatible with the MP7QL and has the model of the standard MPEG-7 FASPs as a special case. The proposed FASPs essentially are MP7QL queries. Both the MP7QL and its compatible FASP model allow for the exploitation of domain knowledge encoded using pure MPEG-7 constructs. In addition, they allow the explicit specification of boolean operators and/or preference values in order to allow both the combination of the query conditions according to the user intentions and the expression of the importance of the individual conditions for the users. The MP7QL query results are represented as MPEG-7 documents, guaranteeing the closure of the results within the MPEG-7 space. The MP7QL and the FASP model have been expressed using both XML Schema and OWL syntax. An implementation of the MP7QL, on top of an XML Native Database is currently in progress. A real world-world evaluation study on the expressive power of the MP7QL shows that it covers both general purpose and domain specific requirements in multimedia content retrieval.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Agius, H., Angelides, M.: Modelling and filtering of MPEG-7-compliant meta-data for digital video. In: Proceedings of the ACM SAC, 2004, pp. 1248–1252 (2004)

  2. Agius, H., Angelides, M.: Enriching MPEG-7 user models with content metadata. In: Proceedings of SMAP 2006, pp. 151–156 (2006)

  3. Akrivas, G., Ioannou, S., Karakoulakis, E., Karpouzis, K., Avrithis, Y., Delopoulos, A., Kollias, S., Varlamis, I., Vaziriannis, M.: An intelligent system for retrieval and mining of audiovisual material based on the MPEG-7 description schemes. In: Proceedings of the Eunite 2001, Tenerife, Spain (2001)

  4. Bertini, M., Del Bimbo, A., Nunziati, W.: Video clip matching using MPEG-7 descriptors and edit distance. In: Proceedings of the CIVR 2006, pp. 133–142 (2006)

  5. Date C.J. (1995). An introduction to database systems. Addison-Wesley, New York

    MATH  Google Scholar 

  6. Eidenberger H. and Breiteneder C. (2003). VizIR: a framework for visual information retrieval. J. Vis. Lang. Comput. 14(5): 443–469

    Article  Google Scholar 

  7. Fallside, D., Walmsley, P. (eds.): XML Schema Part 0: Primer. W3C Recommendation. http://www.w3.org/TR/xmlschema-0/ (2001)

  8. Graves, A., Lalmas, M.: Video retrieval using an MPEG-7 based inference network. In: Proceedings of the ACM SIGIR 2002, pp. 339–346 (2002)

  9. Hammiche, S., Lopez, B., Benbernou, S., Hacid, M.S., Vakali, A.: Domain knowledge based queries for multimedia data retrieval. In: Proceedings of the Workshop on Multimedia Semantics 2006 (WMS 2006), pp. 94–103, 19–21 June 2006, Chania, Crete (2006)

  10. Hunter, J.: Adding multimedia to the semantic Web—building an MPEG-7 ontology. In: Proceedings of the International Semantic Web Working Symposium (SWWS) (2001)

  11. ISO/IEC: 15938–3:2001: Information Technology—Multimedia content description interface. Part 3 Visual, Version 1 (2001)

  12. ISO/IEC: 15938–4:2001: Information Technology—Multimedia content description interface. Part 4 Audio, Version 1 (2001)

  13. ISO/IEC: 15938–5:2003: Information Technology—Multimedia content description interface. Part 5: Multimedia description schemes, 1st edn (2003)

  14. ISO/IEC 23001–1: Information technology—MPEG system technologies. Part 1: Binary MPEG Format for XML

  15. ISO/IEC JTC1/SC29/WG11. N8219—MPEG-7 Query Format Requirements version 1.1. Klagenfurt, Austria (2006)

  16. ISO/IEC JTC1/SC29/WG11. N6263—Study of MPEG-7 Profiles Part 9 Committee Draft (2003)

  17. Karanastasi, A., Christodoulakis, S.: An ontology-based natural language interface generator for multimedia repositories. DELOS Conference, Tirrenia, Italy, March 2007 (2007)

  18. Kay, M. (ed.): XSL Transformations (XSLT) Version 2.0. W3C Recommendation, 23 January 2007. http://www.w3.org/TR/xslt20/ (2005)

  19. Lee, M.H., Kang, J.H., Myaeng, S.H., Hyun, S.J., Yoo, J.M., Ko, E.J., Jang, J.W., Lim, J.H.: A Multimedia Digital Library System based on MPEG-7 and XQuery. In: Proceedings of the ICADL (2003)

  20. McGuinness, D.L., van Harmelen, F. (eds.): OWL Web Ontology Language: overview. W3C Recommendation. 10 Feb. 2004. http://www.w3.org/TR/owl-features (2004)

  21. Prud’hommeaux, E., Seaborne, A. (eds.): SPARQL Query Language for RDF. W3C Draft, 26 March 2007. http://www.w3.org/TR/rdf-sparql-query/ (2007)

  22. Rogers, D., Hunter, J., Kosovic, D.: The TV-Trawler Project. Special Issue of the International Journal of Imaging Systems and Technology on Multimedia Content Description and Video Compression (2003)

  23. Siméon, J., Chamberlin, D., Fernández, M., Boag, S., Florescu, D., Robie, J. (eds): XQuery 1.0: an XML Query Language. W3C Recommendation, 23 Jan. 2007. http://www.w3.org/TR/xquery/ (2007)

  24. Salembier P. (2001). MPEG-7 Multimedia description schemes. IEEE TA Circuits Syst. Video Technol. 11(6): 748–759

    Article  Google Scholar 

  25. Tseng B., Lin C.Y. and Smith J. (2004). Using MPEG-7 and MPEG-21 for personalizing video. IEEE Multimed. 11(1): 42–52

    Article  Google Scholar 

  26. Tsinaraki, C., Christodoulakis, S.: A Multimedia user preference model that supports semantics and its application to MPEG 7/21. In: Proceedings of the Multimedia Modeling 2006 Conference (MMM 2006), pp. 35–42, January 2006, Beijing, China (2006)

  27. Tsinaraki, C., Fatourou, E., Christodoulakis, S.: An ontology-driven framework for the management of semantic metadata describing audiovisual information. In: Proceedings of the Conference of Advanced Information Systems Engineering (CaiSE), Velden, Austria, 2003, pp. 340–356 (2003)

  28. Tsinaraki, C., Polydoros, P., Christodoulakis, S.: Interoperability support between MPEG-7/21 and OWL in DS-MIRF. Transactions on Knowledge and Data Engineering (TKDE), Special Issue on the Semantic Web Era, 2007, pp. 219–232 (2007)

  29. Vallet, D., Fernandez, M., Castellis, P., Mylonas, P., Avrithis, Y.: A contextual personalization approach based on ontological knowledge. In: Proceedings the IJCAI 2006 (2006)

  30. Wang, Q., Balke, W.T., Kiessling, W., Huhn, A.: P-News: Deeply Personalized News Dissemination for MPEG-7 based Digital Libraries. In: Proceedings of ECDL 2004 (2004)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chrisa Tsinaraki.

Additional information

The work presented in this paper, originally presented in SMAP 2006, was partially funded in the scope of the DELOS II Network of Excellence in Digital Libraries (IST—Project Record N° 507618)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tsinaraki, C., Christodoulakis, S. An MPEG-7 query language and a user preference model that allow semantic retrieval and filtering of multimedia content. Multimedia Systems 13, 131–153 (2007). https://doi.org/10.1007/s00530-007-0091-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-007-0091-z

Keywords

Navigation