Skip to main content
SpringerLink
Log in

Storyboard-based accurate automatic summary video editing system

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The recent popularity of smart mobile devices has led to a significant increase in the needs of multimedia services. Finding new more efficient methods for automatic classification and retrieval of a large number of multimedia files will significantly reduce manpower costs. However, most current video content analysis methods adopt low-level features to analyze video frame by frame, and need to improve high-level semantic analysis on a number of issues. Hence, this study presents a storyboard-based accurate automatic summary video editing system that uses storyboard information, such as character dialogue, narration, caption, background music and shot changes, to enable accurate video content retrieval and automatic render summary videos. The proposed system can be applied to the course video trailer and the commercial video trailer for quick preview video content or suitable viewing configuration for smart mobile devices. Consequently, the audience can quickly understand the whole video story and the video editors can substantially reduce the time taken to publish videos.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Ansari A, Mohammed MH (2015) Content based video retrieval systems - methods, techniques. Trends Chall Int J Comput Appl 112(7):13–22

    Google Scholar 

  2. Bastan M, Cam H, Gudukbay U, Ulusoy O (2010) BilVideo-7: an MPEG-7-compatible video indexing and retrieval system. IEEE Multimed 17(3):62–73

    Article  Google Scholar 

  3. Belongie S, Carson C, Greenspan H, Malik J (1998) Color- and texture-based image segmentation using EM and its application to content-based image retrieval. In: Sixth International Conference on Computer Vision, pp. 675–682

  4. Bhat SA, Sardessai OV, Kunde PP, Shirodkar SS (2014) Overview of existing content based video retrieval systems. Int J Adv Eng Global Technol 2(2):476–483

    Google Scholar 

  5. Bregler C (1997) Learning and recognizing human dynamics in video sequences. In: IEEE International Conference on Computer Vision and Pattern Recognition, pp. 568–574

  6. Bruno E, Marchand-Maillet S (2003) Nonlinear temporal modeling for motion-based video overviewing. In: Third International Workshop on Content-Based Multimedia Indexing

  7. Chen LH, Chin KH, Liao HY (2008) An integrated approach to video retrieval. In: Nineteenth Conference on Australasian Database 75: 49–55

  8. Deng Y, Manjunath BS (1997) content-based search of video using color, texture, and motion. In: IEEE International Conference on Image Processing 2: 534–537

  9. Djerba C (2002) Content-based multimedia indexing and retrieval. IEEE Multimed 9(2):18–22

    Article  Google Scholar 

  10. Elgmagarmid AK, Jiang H, Helal AA, Joshi A, Admed M (1997) Video database systems: issues, products, and applications. Kluwer Academic Publishers

  11. Hussain M, Chen D, Cheng A, Wei H, Stanley D (2013) Change detection from remotely sensed images: from pixel-based to object-based approaches. ISPRS J Photogramm Remote Sens 80:91–106

    Article  Google Scholar 

  12. Ianeva T, Vries AP de, Westerveld T (2004) A dynamic probabilistic retrieval model. In: IEEE International Conference on Multimedia and Expo, pp. 1607–1610

  13. Jawahar CV, Chennupati B, Paluri B, Jammalamadaka N (2005) Video retrieval based on textual queries. In: Thirteenth International Conference on Advanced Computing and Communications

  14. Lu GJ (1999) Multimedia Database Management Systems. Artech House

  15. Money AG, Agius H (2008) Video summarisation: a conceptual framework and survey of the state of the art. J Vis Commun Image Represent 19:121–143

    Article  Google Scholar 

  16. Po LM, Ma WC (1996) A novel four-step search algorithm for fast block motion estimation. IEEE Trans Circuits Syst Video Technol 6(3):313–317

    Article  Google Scholar 

  17. Sebe N, Lew MS, Smeulders AWM (2003) Video retrieval and summarization. Comput Vis Image Underst 92(2–3):141–146

    Article  Google Scholar 

  18. Shen HT, Zhou X, Huang Z, Shao J, Zhou X (2007) UQLIPS: a real-time near-duplicate video clip detection system. In: Thirty-Third International Conference on Very Large Data Bases pp. 1374–1377

  19. Scriptwriting and Storyboards (2016) http://generator.acmi.net.au/resources/scriptwriting-and-storyboards

  20. Su JH, Hsu YT, Yeh HH, Tseng VS (2010) Retrieval using pattern indexing and matching techniques. Expert Syst Appl 37(7):5068–5085

    Article  Google Scholar 

  21. Truong BT, Venkatesh S (2007) Video abstraction: a systematic review and classification. ACM Trans Multimed Comput Commun Appl 3(1):1–37

    Article  Google Scholar 

  22. Tusch R, Kosch H, Böszörményi L (2000) VIDEX: An integrated generic video indexing approach. In: Eighth ACM International Conference on Multimedia, pp. 448–451

  23. Understanding Presentation Graphics (2016) http://www.talmanassociates.com/upg2/ch04/ch04home.cfm

  24. Yang CW (2012) Investigation on the methods of educational films editing via semantic network concepts. National Hsinchu University of Education

Download references

Acknowledgments

The author would like to thank the Ministry of Science and Technology of the Republic of China, Taiwan, for financially supporting this research under Contract No. MOST 103-2221-E-468-029.

Author information

Authors and Affiliations

  1. Department of Information Communication, Asia University, Taichung, Taiwan, Republic of China

    Shih-Nung Chen

Authors
  1. Shih-Nung Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shih-Nung Chen.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, SN. Storyboard-based accurate automatic summary video editing system. Multimed Tools Appl 76, 18409–18423 (2017). https://doi.org/10.1007/s11042-016-4160-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-4160-1

Keywords

Search

Navigation