Mihir Sarkar
ABSTRACT
Playing music over the Internet, whether for real-time jamming, network performance or distance education, is constrained by the speed of light which introduces, over long distances, time delays unsuitable for musical applications. Current musical collaboration systems generally transmit compressed audio streams over low-latency and high-bandwidth networks to optimize musician synchronization. This paper proposes an alternative approach based on pattern recognition and music prediction. Trained for a particular type of music, here the Indian tabla drum, the system called TablaNet identifies rhythmic patterns by recognizing individual strokes played by a musician and mapping them dynamically to known musical constructs. Symbols representing these musical structures are sent over the network to a corresponding computer system. The computer at the receiving end anticipates incoming events by analyzing previous phrases and synthesizes an estimated audio output. Although such a system may introduce variants due to prediction approximations, resulting in a slightly different musical experience at both ends, we find that it demonstrates a high level of playability with an immediacy not present in other systems, and functions well as an educational tool.
- R. Bargar, S. Church, A. Fukuda, J. Grunke, D. Keislar, B. Moses, B. Novak, B. Pennycook, Z. Settel, J. Strawn, et al. AES white paper: Networking audio and music using Internet2 and next-generation Internet capabilities. Technical report, AES: Audio Engineering Society, 1998.Google Scholar
- J. C. Brown. Calculation of a Constant Q Spectral Transform. Vision and Modeling Group, Media Laboratory, Massachusetts Institute of Technology, 1990.Google Scholar
- C. Chafe. Distributed Internet Reverberation for Audio Collaboration. In AES (Audio Engineering Society) 24th Int'l Conf. on Multichannel Audio, 2003.Google Scholar
- C. Chafe, M. Gurevich, G. Leslie, and S. Tyan. Effect of Time Delay on Ensemble Accuracy. In Proceedings of the International Symposium on Musical Acoustics, 2004.Google Scholar
- A. Chatwani and A. Koren. Optimization of Audio Streaming for Wireless Networks. Technical report, Princeton University, 2004.Google Scholar
- A. A. Chatwani. Real-Time Recognition of Tabla Bols. Princeton University, Senior Thesis, May 2003.Google Scholar
- E. Chew, R. Zimmermann, A. A. Sawchuk, C. Kyriakakis, C. Papadopoulos, ARJ François, G. Kim, A. Rizzo, and A. Volk. Musical Interaction at a Distance: Distributed Immersive Performance. In Proceedings of the MusicNetwork Fourth Open Workshop on Integration of Music in Multimedia Applications, September, pages 15--16, 2004.Google Scholar
- P. Chordia. Segmentation and Recognition of Tabla Strokes. In Proc. of ISMIR (International Conference on Music Information Retrieval), 2005.Google Scholar
- J. R. Cooperstock and S. P. Spackman. The Recording Studio that Spanned a Continent. In Proc. of IEEE International Conference on Web Delivering of Delivering of Music (WEDELMUSIC), 2001. Google ScholarDigital Library
- O. K. Gillet and G. Richard. Automatic Labelling of Tabla Signals. In Proc. of the 4th ISMIR Conf., 2003.Google Scholar
- M. Goto, R. Neyama, and Y. Muraoka. RMCP: Remote Music Control Protocol---Design and Applications---. Proc. International Computer Music Conference, pages 446--449, 1997.Google Scholar
- X. Gu, M. Dick, U. Noyer, and L. Wolf. NMP-a new networked music performance system. In Global Telecommunications Conference Workshops, IEEE, pages 176--185, 2004.Google Scholar
- J. Hun Roh and L. Wilcox. Exploring Tabla Drumming Using Rhythmic Input. In CHI'95 proceedings, 1995. Google ScholarDigital Library
- A. Kapur, P. Davidson, P. R. Cook, P. Driessen, and A. Schloss. Digitizing North Indian Performance. In Proceedings of the International Computer Music Conference, 2004.Google Scholar
- A. Kapur, G. Essl, P. Davidson, and P. R. Cook. The Electronic Tabla Controller. Journal of New Music Research, 32(4):351--359, 2003.Google ScholarCross Ref
- A. Kapur, G. Wang, P. Davidson, PR Cook, D. Trueman, TH Park, and M. Bhargava. The Gigapop Ritual: A Live Networked Performance Piece for Two Electronic Dholaks, Digital Spoon, DigitalDoo, 6 String Electric Violin, Rbow, Sitar, Table, and Bass Guitar. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), Montreal, 2003.Google Scholar
- A. Kapur, G. E. Wang, P. Davidson, and P. R. Cook. Interactive Network Performance: a dream worth dreaming? Organised Sound, 10(03):209--219, 2005. Google ScholarDigital Library
- J. Kippen and B. Bel. Computers, Composition and the Challenge of "New Music" in Modern India. Leonardo Music Journal, 4:79--84, 1994.Google ScholarCross Ref
- J. Lazzaro and J. Wawrzynek. A case for network musical performance. In Proceedings of the 11th international workshop on Network and operating systems support for digital audio and video, pages 157--166. ACM Press New York, NY, USA, 2001. Google ScholarDigital Library
- T. Mäki-Patola. Musical Effects of Latency. Suomen Musiikintutkijoiden, 9:82--85, 2005.Google Scholar
- K. Samudravijaya, S. Shah, and P. Pandya. Computer Recognition of Tabla Bols. Technical report, Tata Institute of Fundamental Research, 2004.Google Scholar
- B. Vercoe. Erasing the Digital Divide: Putting your Best Idea on the $100 Laptop. Keynote lecture, WORLDCOMP'06, Las Vegas, June 2006.Google Scholar
- G. Weinberg. Interconnected Musical Networks: Toward a Theoretical Framework. Computer Music Journal, 29(2):23--39, 2005. Google ScholarDigital Library
- G. Weinberg. Local Performance Networks: musical interdependency through gestures and controllers. Organised Sound, 10(03):255--265, 2005. Google ScholarDigital Library
- Recognition and prediction in a network music performance system for Indian percussion
Recommendations
Pitch detection enhancement employing music prediction
Special issue: Intelligent multimedia applicationsPitch detection methods are widely used for extracting musical data from digital signals. A review of those methods is presented in the paper. Since musical signals may contain noise and distortion, detection results can be erroneous. In this paper a ...
Real-time Melodic Accompaniment System for Indian Music Using TMS320C6713
VLSID '12: Proceedings of the 2012 25th International Conference on VLSI DesignAn instrumental accompaniment system for Indian classical vocal music is designed and implemented on a Texas Instruments Digital Signal Processor TMS320C6713. This will act as a virtual accompanist following the main artist, possibly a vocalist. The ...
Music/lyrics composition system considering user's image and music genre
SMC'09: Proceedings of the 2009 IEEE international conference on Systems, Man and CyberneticsThis paper proposes a music/lyrics composition system consisting of two sections, a lyric composing section and a music composing section, which considers user's image of a song and music genre. First of all, a user has an image of music/lyrics to ...
Comments