Skip to main content
SpringerLink
Log in

A novel multi-resolution video representation scheme based on kernel PCA

  • Special Issue
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Content-based video analysis calls for efficient and flexible video representation. In this paper, a novel multi-resolution video representation (MRVR) scheme is proposed and realized by performing the kernel principal component analysis (KPCA) on the low-level visual features extracted from a video sequence. By simply changing the kernel parameters or the dimensionality of the subspace, this scheme can represent video content from coarser to finer levels in the subspace, according to its intrinsic structure. An application of keyframe extraction is investigated to show the advantages of this representation scheme. Furthermore, based on this scheme, a two-level video summarization approach is proposed to represent long video sequences. The experimental results of both short and long video sequences have demonstrated the effectiveness and flexibility of the proposed video representation scheme.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Aigrain, P.: Content-based representation and retrieval of visual media: a state-of-the-art review. Multimed. Tools Appl. 3(3), 179–202 (1996)

    Article  Google Scholar 

  2. Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)

    MATH  Google Scholar 

  3. Chang, H.S., Sull, S.S., Lee, S.U.: Efficient video indexing scheme for content-based retrieval. IEEE Trans. Circ. Syst. Video 9(8), 1269–1279 (1999)

    Article  Google Scholar 

  4. Chapelle, O., Vapnik, V., Bousquet, O., Mukherjee, S.: Choosing multiple parameters for support vector machines. Mach. Learn. 46(1–3), 131–159 (2002)

    Article  MATH  Google Scholar 

  5. Cristianini, N., Campbell, C., Shawe-Taylor, J.: Dynamically adapting kernels in support vector machines. Adv. Neural Inform. Proc. Syst. 11, 204–210 (1999)

    Google Scholar 

  6. Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and other kernel-base learning methods. Cambridge University Press, Cambridge, UK (2000)

    Google Scholar 

  7. Day, Y.F., Khokhar, A., Dagtas, S., Ghafoor, A.: A multi-level abstraction and modeling in video databases. Multimedia Syst. 7, 409–423 (1999)

    Article  Google Scholar 

  8. Gong, Y., Liu, X.: Video summarization using singular value decomposition. Proceedings of International Conference on Computer Vision and Pattern Recogn. 2, 2179–2186 (2000)

    Google Scholar 

  9. Hanjalic, A., Zhang, H.J.: An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis. IEEE Trans. Circ. Syst. Video 9(8), 1280–1289 (1999)

    Article  Google Scholar 

  10. Jain, A.K.: Algorithms for Clustering Data. Prentice Hall, Englewood Cliffs, NJ (1988)

    MATH  Google Scholar 

  11. Kim, K.I., Jung, K., Kim, H.J.: Face recognition using kernel principal component analysis. IEEE Signal Proc. Let. 9(2), 40–42 (2002)

    Article  Google Scholar 

  12. Kobla, V., Doermann, D., Faloutsos, C.: Developing high-level representations of video clips using videotrails. Proceedings of the SPIE Conference on Storage and Retrieval for Still Image and Video Databases VI 3312, 81–92 (1998)

    Google Scholar 

  13. Ngo, C.W., Pong, T.C., Zhang, H.J.: On clustering and retrieval of video shots through temporal slices analysis. IEEE Trans. Circ. Syst. Video Tech. 4(4), 446–458 (2002)

    Google Scholar 

  14. Sahouria, E., Zakhor, A.: Content analysis of video using principal components. IEEE Trans. Circ. Syst. Video 9(8), 1290–1298 (1999)

    Article  Google Scholar 

  15. Schölkopf, B., Smola, A.J., Muller, K.R.: Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10, 1299–1319 (1998)

    Article  Google Scholar 

  16. Schölkopf, B., Smola, A.: Learning with Kernels Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge, MA (2002)

    Google Scholar 

  17. Uchihashi, S., Foote, J., Girgensohn, A., Boreczky, J.: Video manga: generating semantically meaningful video summaries. Proceedings of ACM Multimedia, pp. 383–392 (1999)

  18. Yeo, B.L.: On Fast microscopic browsing of MPEG-compressed video. Multimedia Syst. 7, 269–281 (1999)

    Article  Google Scholar 

  19. Zabih, R., Miller, J., Mai, K.: A feature-based algorithm for detecting and classifying scene breaks. Proceedings of ACM Multimedia, pp. 189–200 (1995)

  20. Zhao, L., Qi, W., Li, S.Z., Yang, S.Q., Zhang, H.J.: Keyframe extraction and shot retrieval using nearest feature line. Proceedings of the 2000 ACM Workshops on Multimedia, Los Angeles, CA, USA, pp. 217–220. ACM Press, New York, NY (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore, Singapore

    Xiao-Dong Yu, Lei Wang & Ping Xue

  2. Institute for Infocomm Research, Agency for Science, Technology and Research, Singapore, Singapore

    Qi Tian

Authors
  1. Xiao-Dong Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qi Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ping Xue
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiao-Dong Yu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yu, XD., Wang, L., Tian, Q. et al. A novel multi-resolution video representation scheme based on kernel PCA. Visual Comput 22, 357–370 (2006). https://doi.org/10.1007/s00371-006-0013-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-006-0013-7

Keywords

Search

Navigation