Scott Beveridge
ABSTRACT
Expectation is an important mechanism in shaping the affective experience of music. Central to this process is the concept of musical tension. The temporal evolution of tension during a piece of music is not only responsible for eliciting emotions but may form the basis for novel time-aware search queries in music information retrieval. This paper introduces a method of modelling musical tension based on automatically computed measures of musical complexity, psychoacoustics and musical structure. The approach involves examining time-continuous annotations of tension and constructing models with a number of regression algorithms. Highest performing models when evaluated with the R2 statistic reached 0.68 with Multiple Linear Regression in a 5 dimension feature space. When independently evaluated on unseen music data the system produced an R2 of 0.64.
- H. Abdi. Partial least square regression PLS-regression. In Encyclopedia of Measurement and Statistics, volume 1. 2007.Google Scholar
- E. Bigand, S. Filipic, and P. Lalitte. The time course of emotional responses to music. Annals of the New York Academy of Sciences, 1060(1):429--437, 2005.Google ScholarCross Ref
- G. E. P. Box and D. R. Cox. An analysis of transformations. Journal of the Royal Statistical Society. Series B (Methodological), 26(2):211--252, 1964.Google ScholarCross Ref
- V. Burnsed and J. Sochinski. The relationship between dynamics and tension in haydn's symphony 104: A developmental study. Psychomusicology: Music, Mind and Brain, 17(1--2):19--35, 2001.Google Scholar
- D. Cabrera. PSYSOUND: A computer program for psychoacoustical analysis. In Proceedings of the Australian Acoustical Society Conference, volume 24, pages 47--54, 1999.Google Scholar
- M. Chion. Audio-vision: sound on screen. Columbia University Press, 1994.Google Scholar
- E. Coutinho and A. Cangelosi. Musical emotions: Predicting second-by-second subjective feelings of emotion from low-level psychoacoustic features and physiological measurements. Emotion, 11(4):921, 2011.Google ScholarCross Ref
- V. Dhandhania, J. Abeßer, A. Kruspe, and H. Großman. Automatic and manual annotation of time-varying perceptual properties in movie soundtracks. In Proceedings of the 9th Sound and Music Computing (SMC) Conference, Denmark, 2012.Google Scholar
- T. Eerola, O. Lartillot, and P. Toiviainen. Prediction of multidimensional emotional ratings in music from audio using multivariate regression models. In Proceedings of the 10th International Society for Music Information Retrieval (ISMIR) Conference, pages 621--626, 2009.Google Scholar
- T. Eerola and A. C. North. Expectancy-based model of melodic complexity. In Proceedings of the Sixth International Conference on Music Perception and Cognition. Keele, Staffordshire, UK, 2000.Google Scholar
- M. Farbood. A quantitative, parametric model of musical tension. PhD thesis, Massachusetts Institute of Technology, 2006.Google Scholar
- L. Finnäs. How can musical preferences be modified? a research review. Bulletin of the Council for Research in Music Education, pages 1--58, 1989.Google Scholar
- A. Gabrielsson and E. Lindstrom. The influence of musical structure on emotional expression. In Music and Emotion: Theory and Research, chapter 10, pages 223--248. Oxford University Press, 2001.Google Scholar
- M. Gruhne and C. Dittmar. Comparison of harmonic mid-level representations for genre recognition. In Proc. of the 3rd Workshop on Learning the Semantics of Audio Signals (LSAS), Graz, Austria, pages 91--102, 2009.Google Scholar
- P. W. Holland and R. E. Welsch. Robust regression using iteratively reweighted least-squares. Communications in Statistics - Theory and Methods, 6(9):813--827, 1977.Google Scholar
- D. Huron. Sweet anticipation: Music and the psychology of expectation. MIT Press, 2006.Google Scholar
- Y. E. Kim, D. S. Williamson, and S. Pilli. Towards quantifying the album effect in artist identification. Poster at the International Conference on Music Information Retrieval (ISMIR 2006), Canada, 2006.Google Scholar
- C. L. Krumhansl. A perceptual analysis of mozart's piano sonata k. 282: Segmentation, tension, and musical ideas. Music Perception, 13(3):401--432, 1996.Google ScholarCross Ref
- C. L. Krumhansl. Music: A link between cognition and emotion. Current Directions in Psychological Science, 11(2):45--50, 2002.Google ScholarCross Ref
- C. L. Krumhansl and E. J. Kessler. Tracing the dynamic changes in perceived tonal organization in a spatial representation of musical keys. Psychological Review, 89(4):334--368, 1982.Google ScholarCross Ref
- O. Lartillot and P. Toiviainen. MIR in matlab (II): A toolbox for musical feature extraction from audio. In Proceedings of the 8th International Conference on Music Information Retrieval, pages 237--244, 2007.Google Scholar
- K. Lee. Automatic chord recognition from audio using enhanced pitch class profile. In Proceedings of the International Computer Music Conference (ICMC), New Orleans, USA, 2006.Google Scholar
- F. Lerdahl and C. Krumhansl. Modeling tonal tension. Music Perception, 24(4):329--366, 2007.Google ScholarCross Ref
- L. B. Meyer. Emotion and meaning in music. The University of Chicago Press, 1961.Google ScholarCross Ref
- E. Narmour. The analysis and cognition of basic melodic structures: The implication-realization model. University of Chicago Press, 1990.Google Scholar
- E. Narmour. The top-down and bottom-up systems of musical implication: Building on meyer's theory of emotional syntax. Music Perception, 9(1):1--26, 1991.Google ScholarCross Ref
- R. Panda and R. P. Pavia. Using support vector machines for automatic mood tracking in audio music. In 130th Convention of the Audio Engineering Society, 13--16 May 2011, London, UK, 2011.Google Scholar
- R. Parncutt. Harmony: A psychoacoustical approach. Springer-Verlag Publishing, 1989.Google Scholar
- D. Pressnitzer, S. McAdams, S. Winsberg, and J. Fineberg. Perception of musical tension for nontonal orchestral timbres and its relation to psychoacoustic roughness. Attention, Perception, & Psychophysics, 62(1):66--80, 2000.Google Scholar
- J. Russell. A circumplex model of emotions. The Journal of Personality and Social Psychology, 39(6):1161--1178, 1980.Google ScholarCross Ref
- S. Streich. Music complexity: a multi-faceted description of audio content. PhD thesis, Universitat Pompeu Fabra, 2006.Google Scholar
- F. Winckel and T. Binkley. Music, sound and sensation: A modern exposition. Dover Publications, 1967.Google Scholar
- Y. H. Yang, Y. C. Lin, Y. F. Su, and H. H. Chen. A regression approach to music emotion recognition. IEEE Transactions on Audio, Speech, and Language Processing, 16(2):448--457, 2008. Google ScholarDigital Library
Index Terms
- A novel approach for time-continuous tension prediction in film soundtracks
Recommendations
Adaptive Musical Soundtracks: from in-game to on the street
AM '19: Proceedings of the 14th International Audio Mostly Conference: A Journey in SoundWe describe the challenges of creating location-based adaptive musical soundtracks, which we try to address via the iterative development of daoplayer, a tool to create such media experiences. Daoplayer is broadly modelled on the functionality of ...
An innovative method of algorithmic composition using musical tension
AbstractAccording to narratology or narrative theory, a piece of artwork should tell a story based on its various tensions. In this study, an automated music composition algorithm using musical tension energy was proposed; this algorithm can generate a ...
Automated Composition of Picture-Synched Music Soundtracks for Movies
CVMP '19: Proceedings of the 16th ACM SIGGRAPH European Conference on Visual Media ProductionWe describe the implementation of and early results from a system that automatically composes picture-synched musical soundtracks for videos and movies. We use the phrase picture-synched to mean that the structure of the automatically composed music is ...
Comments