Junko Ichino
Hayato Nao
ABSTRACT
We explore a bodily interaction as a creative experience to support musical expression. This paper discusses an interactive system---Playing the Body---that supports the creative activity of composing music by incorporating large body movements in space. In order to encourage the user to form an overall image of the melody in the early stages of composition, the proposed system supports interaction using the whole body to generate a melody. Then, after going through a trial-and-error stage, it provides a refinement stage that encourages introspection, refining the melody to make the sound more consistent with the ideal image. This is done by supporting interaction using the hands and arms, which have a greater degree of freedom. In a pilot study, positive responses were obtained regarding the creation of a melody using the whole body. Future work includes improving the use of the hands and arms to refine the melody.
- A. Black. 1990. Visible Planning on paper and on screen: The impact of working medium on decision-making by novice graphic designers, Behaviour and Information Technology, 9, 4, 283--296.Google Scholar
Cross Ref
- S. Tano. 1999. Analysis of Obstruction and Promotion of Human Creative Work by Information Systems, Proc. Human Interface Symposium '99, Human Interface Society, 791--796.Google Scholar
- D. England, M. Randles, et al. 2009. Towards an Advanced Framework for Whole Body Interaction. Virtual and Mixed Reality, 5622, 32--40. Google ScholarDigital Library
- H. Lohner. 1986. The UPIC System: A User's Report, Computer Music J., 10, 4, 42--49.Google ScholarCross Ref
- M. M. Farbood, E. Pazstor, and K. Jennings. 2004. Hyperscore: A Graphical Sketchpad for Novice Composers, J. of IEEE Computer Graphics and Applications, 24, 1, 50--54. Google ScholarDigital Library
- M. Subotnick. Making Music. http://www.creatingmusic.com/.Google Scholar
- intel Dragencer. http://www.intel.com/jp/consumer/Inside/gassaku/tools/matsuo.htm.Google Scholar
- E. Rosenbaum and J. Silver. 2010. Singing Fingers: fingerpaint with sound, Proc. IDC '10, ACM, New York, NY, 308--310. Google ScholarDigital Library
- J. Garcia, L. Bigo, A. Spicher, W. E. Mackay. 2013. PaperTonnetz: Supporting Music Composition with Interactive Paper, CHI EA '13, ACM, New York, NY, 3051--3054. Google ScholarDigital Library
- Anoto Pen. http://www.anoto.com/creative/technology/the-digital-pen/Google Scholar
- J. Ichino, A. Pon, E. Sharlin, D. Eagle, and S. Carpendale. 2014. Vuzik: the Effect of Large Gesture Interaction on Children's Creative Musical Expression, Proc. OzCHI '14, ACM, New York, NY, 240--249. Google ScholarDigital Library
- H.H.S. Ip, B. Kwong, K.C.K. Law. 2005. BodyMusic: A Novel Framework Design for Body-driven Music Composition, Proc. ACE '05, ACM, New York, NY, 326--329. Google ScholarDigital Library
- S. Nakamura. 2014. KAGURA, 2014 International CES.Google Scholar
- Leap Motion. https://www.leapmotion.com/Google Scholar
- J. Zigelbaum, A. Millner, B. Desai, and H. Ishii. 2006. BodyBeats: whole-body, musical interfaces for children, CHI Ext. Abstracts '06, ACM, New York, NY, 1595--1600. Google ScholarDigital Library
- M. Halpern, J. Tholander, et al. 2011. MoBoogie: Creative Expression Through Whole Body Musical Interaction, Proc. CHI '11, ACM, New York, NY, 557--560. Google ScholarDigital Library
- Body Music - Biennale OFF de Rennes 2014 - Le Triangle, Cité de la danse, https://www.youtube.com/watch?v=2NDEDwyQ2m8.Google Scholar
- J. Dewey. 1910. How We Think, D.C.Heath.Google Scholar
- D. A. Schön. 1984. The Reflective Practitioner: How Professionals Think in Action, Basic Books.Google Scholar
- F. Birren. 2013. Color Psychology and Color Therapy: A Factual Study of the Influence of Color on Human Life, Martino Fine Books.Google Scholar
- K. Akiyama. 2014. Textbook of music theory, Yamaha Music. (in Japanese)Google Scholar
Index Terms
- Playing the Body: Making Music through Various Body Movements
Recommendations
Vuzik: the effect of large gesture interaction on children's creative musical expression
OzCHI '14: Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of DesignBringing the body more fully into interaction has attracted attention as research now looks to combines body, mind, cognition and emotion when people interact with a digital environment. This paper describes a user study comparing Vuzik -- an ...
The acoustic, the digital and the body: a survey on musical instruments
NIME '07: Proceedings of the 7th international conference on New interfaces for musical expressionThis paper reports on a survey conducted in the autumn of 2006 with the objective to understand people's relationship to their musical tools. The survey focused on the question of embodiment and its different modalities in the fields of acoustic and ...
Running up Blueberry Hill: prototyping whole body interaction in harmony space
TEI '09: Proceedings of the 3rd International Conference on Tangible and Embedded InteractionMusical harmony is considered to be one of the most abstract and technically difficult parts of music. It is generally taught formally via abstract, domain-specific concepts, principles, rules and heuristics. By contrast, when harmony is represented ...
Comments