Abstract
In this paper, we present a complete set of procedures to automatically extract a music snippet, defined as the most representative or the highlighted excerpt of a music clip. We first generate a modified and compact similarity matrix based on selected features and distance metrics, and then several improved techniques for music repeated pattern discovery are utilized because a music snippet is usually a part of the repeated melody, main theme or chorus. During the process, redundant and wrongly detected patterns are discarded, boundaries are corrected using beat information, and final clusters are also further sorted according to the occurrence frequency and energy information. Subsequently, following our methods, we designed a music snippet extraction system which allows users to detect snippets. Experiments performed on the system show the superiority of our proposed approach.
References
Lu L, Zhang H. Automated extraction of music snippets. In: Proc. of ACM Multimedia, Berkeley, USA, 2003
Burns G. A typology of ‘hooks’ in popular records. Popular Music, 1987, 6(1): 1–20
Cooper R, Foote J. Automatic music summarization via similarity analysis. In: Proc. of the International Symposium on Music Information Retrieval, Paris, France, 2002
Foot J, Cooper M, Girgensohn A. Creating music video using automatic media analysis. In: Proc. of ACM Multimedia, Juan-les-Pins, France, 2002
Bartsch M A, Wakefield G H. To catch a chorus: Using chroma-based representations for audio thumbnailing. In: Proc. of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, New York, USA, 2001
Chai W. Automated analysis of music structure, PhD thesis. Massachusetts Institute of Technology, USA, 2005
Maddage C N, Xu C S, Kankanhalli S M, et al. Content-based music structure analysis with applications to music semantics understanding. In: Proc. of ACM Multimedia, New York, USA, 2004
Dannenberg R B, Hu N. Pattern discovery techniques for music audio. In: Proc. of the International Symposium on Music Information Retrieval, Paris, France, 2002
Xu C, Zhu Y, Tian Q. Automatic music summarization based on temporal, spectral and cepstral features. In: Proc. of IEEE International Conference on Multimedia and Expo, Lausanne, Switzerland, 2002
Shiu Y, Jeong H, Jay Kuo C C. Similarity matrix processing for music structure analysis. In: Proc. of ACM Multimedia, California, USA, 2006
Ellis D. Chroma features analysis and synthesis. http://www.ee.columbia.edu/ dpwe/resources/matlab
Ellis D, Poliner G. Identifying cover songs with chroma features and dynamic programming beat tracking. In: Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing, Honolulu, Hawaii, USA, 2007
McKinney M F, Breebaart J. Features for audio and music classification. In: Proc. of the International Symposium on Music Information Retrieval, Maryland, USA, 2003
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by the National Natural Science Foundation of China (Grant No. 60873098)
Rights and permissions
About this article
Cite this article
Xu, J., Zhao, Y., Chen, Z. et al. Music snippet extraction via melody-based repeated pattern discovery. Sci. China Ser. F-Inf. Sci. 52, 804–812 (2009). https://doi.org/10.1007/s11432-009-0092-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11432-009-0092-y