Peter Knees
Markus Schedl
Tim Pohle
Gerhard Widmer
ABSTRACT
We present a novel, innovative user interface to music repositories. Given an arbitrary collection of digital music files, our system creates a virtual landscape which allows the user to freely navigate in this collection. This is accomplished by automatically extracting features from the audio signal and training a Self-Organizing Map (SOM) on them to form clusters of similar sounding pieces of music. Subsequently, a Smoothed Data Histogram (SDH) is calculated on the SOM and interpreted as a three-dimensional height profile. This height profile is visualized as a three-dimensional island landscape containing the pieces of music. While moving through the terrain, the closest sounds with respect to the listener's current position can be heard. This is realized by anisotropic auralization using a 5.1 surround sound model. Additionally, we incorporate knowledge extracted automatically from the web to enrich the landscape with semantic information. More precisely, we display words and related images that describe the heard music on the landscape to support the exploration.
- M. Allen, J. Gluck, K. MacLean, and E. Tang. An initial usability assessment for symbolic haptic rendering of music parameters. In ICMI '05: Proc. of the 7th international conference on Multimodal interfaces, New York, NY, USA, 2005. ACM Press. Google Scholar
Digital Library
- J.-J. Aucouturier, F. Pachet, and M. Sandler. "The Way It Sounds": Timbre Models for Analysis and Retrieval of Music Signals. IEEE Transactions on Multimedia, 7(6):1028--1035, December 2005. Google ScholarDigital Library
- E. Brazil and M. Fernström. Audio information browsing with the sonic browser. In Coordinated and Multiple Views In Exploratory Visualization (CMV03), London, UK, 2003. Google ScholarDigital Library
- P. Cano, M. Kaltenbrunner, F. Gouyon, and E. Batlle. On the Use of Fastmap for Audio Retrieval and Browsing. In Proc. of the International Conference on Music Information Retrieval (ISMIR'02), Paris, France, 2002.Google Scholar
- M. Goto and T. Goto. Musicream: New Music Playback Interface for Streaming, Sticking, and Recalling Musical Pieces. In Proc. of the 6th International Conference on Music Information Retrieval (ISMIR'05), London, UK, 2005.Google Scholar
- P. Knees, E. Pampalk, and G. Widmer. Artist Classification with Web-based Data. In Proc. of 5th International Conference on Music Information Retrieval (ISMIR'04), Barcelona, Spain, October 2004.Google Scholar
- T. Kohonen. Self-Organizing Maps, volume 30 of Springer Series in Information Sciences. Springer, Berlin, 3rd edition, 2001. Google ScholarDigital Library
- K. Lagus and S. Kaski. Keyword selection method for characterizing text document maps. In Proc. of 9th International Conference on Artificial Neural Networks (ICANN'99), volume 1, London, 1999. IEEE.Google ScholarCross Ref
- D. Lübbers. Sonixplorer: Combining Visualization and Auralization for Content-based Exploration of Music Collections. In Proc. of the 6th International Conference on Music Information Retrieval (ISMIR'05), London, UK, 2005.Google Scholar
- M. Mandel and D. Ellis. Song-Level Features and Support Vector Machines for Music Classification. In Proc. of the 6th International Conference on Music Information Retrieval (ISMIR'05), London, UK, 2005.Google Scholar
- F. Mörchen, A. Ultsch, M. Nöcker, and C. Stamm. Databionic visualization of music collections according to perceptual distance. In Proc. of the 6th International Conference on Music Information Retrieval (ISMIR'05), London, UK, 2005.Google Scholar
- R. Neumayer, M. Dittenbach, and A. Rauber. PlaySOM and PocketSOMPlayer, Alternative Interfaces to Large Music Collections. In Proc. of the 6th International Conference on Music Information Retrieval (ISMIR'05), London, UK, 2005.Google Scholar
- E. Pampalk. Islands of Music: Analysis, Organization, and Visualization of Music Archives. Master's thesis, Vienna University of Technology, 2001.Google Scholar
- E. Pampalk, S. Dixon, and G. Widmer. Exploring music collections by browsing different views. Computer Music Journal, 28(2):49--62, 2004. Google ScholarDigital Library
- E. Pampalk, A. Flexer, and G. Widmer. Hierarchical organization and description of music collections at the artist level. In Proc. of the 9th European Conference on Research and Advanced Technology for Digital Libraries (ECDL'05), Vienna, Austria, 2005. Google ScholarDigital Library
- E. Pampalk, A. Rauber, and D. Merkl. Content-based organization and visualization of music archives. In Proc. of the ACM Multimedia, Juan les Pins, France, December 1-6 2002. ACM. Google ScholarDigital Library
- E. Pampalk, A. Rauber, and D. Merkl. Using smoothed data histograms for cluster visualization in self-organizing maps. In Proc. of the International Conference on Artifical Neural Networks (ICANN'02), Madrid, Spain, 2002. Google ScholarDigital Library
- S. Pauws, D. Bouwhuis, and B. Eggen. Programming and enjoying music with your eyes closed. In CHI '00: Proc. of the SIGCHI conference on Human factors in computing systems, New York, NY, USA, 2000. ACM Press. Google ScholarDigital Library
- M. Schedl. An explorative, hierarchical user interface to structured music repositories. Master's thesis, Vienna University of Technology, December 2003.Google Scholar
- I. Stavness, J. Gluck, L. Vilhan, and S. Fels. The MUSICtable: A Map-Based Ubiquitous System for Social Interaction with a Digital Music Collection. In Proc. of the 4th International Conference on Entertainment Computing (ICEC 2005), Sanda, Japan, 2005. Google ScholarDigital Library
- M. Torrens, P. Hertzog, and J.-L. Arcos. Visualizing and Exploring Personal Music Libraries. In Proc. of 5th International Conference on Music Information Retrieval (ISMIR'04), Barcelona, Spain, 2004.Google Scholar
- G. Tzanetakis and P. Cook. Marsyas3D: A Prototype Audio Browser-Editor Using a Large Scale Immersive Visual Audio Display. In Proc. of the International Conference on Auditory Display, 2001.Google Scholar
- R. van Gulik, F. Vignoli, and H. van de Wetering. Mapping music in the palm of your hand, explore and discover your collection. In Proc. of 5th International Conference on Music Information Retrieval (ISMIR'04), Barcelona, Spain, 2004.Google Scholar
- B. Whitman and S. Lawrence. Inferring descriptions and similarity for music from community metadata. In Proc. of the 2002 International Computer Music Conference, Goteborg, Sweden, September 2002.Google Scholar
- J. A. Wise, J. J. Thomas, K. Pennock, D. Lantrip, M. Pottier, A. Schur, and V. Crow. Visualizing the Non-Visual: Spatial analysis and interaction with information from text documents. In Proc. of the 1995 IEEE Symposium on Information Visualization (INFOVIS'95), Atlanta, Georgia, 1995. Google ScholarDigital Library
- Y. Yang and J. O. Pedersen. A comparative study on feature selection in text categorization. In D. H. Fisher, editor, Proc. of ICML-97, 14th International Conference on Machine Learning, Nashville, US, 1997. Google ScholarDigital Library
Index Terms
- An innovative three-dimensional user interface for exploring music collections enriched
Recommendations
A survey of music similarity and recommendation from music context data
In this survey article, we give an overview of methods for music similarity estimation and music recommendation based on music context data. Unlike approaches that rely on music content and have been researched for almost two decades, music-context-...
Exploring Music Collections in Virtual Landscapes
A user interface to music repositories called nepTune creates a virtual landscape for an arbitrary collection of digital music files, letting users freely navigate the collection. Automatically extracting features from the audio signal and clustering ...
Music similarity and retrieval
SIGIR '13: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrievalThis tutorial serves as an introductory course to the field of and state-of-the-art in music information retrieval (MIR) and in particular to music similarity estimation which is an essential component of music retrieval. Apart from explaining ...
Comments