Hayes Raffle
Cati Vaucelle
Hiroshi Ishii
ABSTRACT
We introduce Jabberstamp, the first tool that allows children to synthesize their drawings and voices. To use Jabberstamp, children create drawings, collages or paintings on normal paper. They press a special rubber stamp onto the page to record sounds into their drawings. When children touch the marks of the stamp with a small trumpet, they can hear the sounds playback, retelling the stories they created.
We describe our design process and analyze the mechanism between the act of drawing and the one of telling, defining interdependencies between the two activities. In a series of studies, children ages 4--8 use Jabberstamp to convey meaning in their drawings. The system allows collaboration among peers at different developmental levels. Jabberstamp compositions reveal children's narrative styles and their planning strategies. In guided activities, children develop stories by situating sound recording in their drawing, which suggests future opportunities for hybrid voice-visual tools to support children's emergent literacy.
- Ananny, M (2002). Supporting children's collaborative authoring: practicing written literacy while composing oral texts. Proceedings of the Conference on Computer Support for Collaborative Learning, Boulder, CO. Google Scholar
Digital Library
- Bruner, J. (2004) Towards a Theory of Instruction. Belknap Press.Google Scholar
- Cassell, J. and Ryokai, K. (2001) Making space for voice: Technologies to support children's fantasy and storytelling. Personal technologies 5(3): 203--224. Google ScholarDigital Library
- Cole, M. & Cole, S. (2000). The Development of Children, 4th ed. New York: Worth Publishers.Google Scholar
- Graves, M. F., Juel, C. and Graves, B. B. (2004). Teaching Reading in the 21st Century. Boston: Pearson Education, Inc. Google ScholarDigital Library
- Goodman, Holmquist, LE, M Helander, S Dixon, "Every Object Talls a Story: Physical Interfaces for Digital Storytelling." Proceedings of NordiCHI 2000, 2000.Google Scholar
- Hourcade, J. P., Bederson, B. B, Druin, A., and Taxen, G. (2002). KidPad: Collaborative Storytelling for Children. CHI '02 extended abstracts on Human factors in computing systems. Google ScholarDigital Library
- Interactive Pencil Drawings: http://www.pienetwork.org/a2z/p/pencil_drawing/ --- accessed 29th September 2006.Google Scholar
- Kay, Alan. A Personal Computer for Children of All Ages. Proceedings of ACM National Conference: ACM Press. Boston. August, 1972.Google Scholar
- LeapPad. LeapFrog Toys. http://www.leapfrog.com.Google Scholar
- Montessori M. (1982) The Secret of Childhood. Ballantine Books; Reissue edition.Google Scholar
- Piaget, J. (1976). The grasp of consciousness. Cambridge: Harvard University Press.Google Scholar
- Ryokai, K., Marti, S., Ishii, H. (2004) I/O Brush: Drawing with Everyday Objects as Ink, in Proceedings of Conference on Human Factors in Computing Systems (CHI '04). Google ScholarDigital Library
- Singer, Jerome L. (1998). Imaginative play in early childhood: A foundation for adaptive emotional and cognitive development. International Medical Journal. 1998 Jun; Vol 5(2): 93--100.Google Scholar
- Snow, C. E. (1983). Literacy and language: Relationships during the preschool years. Harvard Educational Review, 53, 165--189.Google ScholarCross Ref
- Snow, C, Burns, M & Griffin, P, Eds. (1998) Preventing Reading Difficulties in Young Children. Washington, D.C.: National Academy Press.Google Scholar
- Stifelman, L. J. Augmenting Real-World Objects: A Paper-Based Audio Notebook. Proceedings of CHI '96, ACM SIGCHI. Vancouver, Canada. Google ScholarDigital Library
- Sulzby, E. & Teale, W. (1996). Emergent literacy. In R Barr, M. Kamil, P. B. Mosenthal, & P. D. Pearson (Eds.), Handbook of reading research (vol. 2, pp. 727--758). New York: Longman.Google Scholar
- Talking Picture Book. http://store.cranium.com --- last accessed January 2007.Google Scholar
- Vaucelle, C., and Jehan, T. (2002). Dolltalk: A computational toy to enhance children's creativity, In Proceedings of Conference on Human Factors in Computing Systems CHI '02, ACM Press. Google ScholarDigital Library
- Vygotsky, L. S. (1978). Mind in Society. Cambridge: Harvard University Press.Google Scholar
Index Terms
- Jabberstamp: embedding sound and voice in traditional drawings
Recommendations
Dolltalk: a computational toy to enhance children's creativity
CHI EA '02: CHI '02 Extended Abstracts on Human Factors in Computing SystemsThis paper presents a novel approach and interface for encouraging children to tell and act out original stories. Dolltalk is a toy that simulates speech recognition by capturing the gestures and speech of a child. The toy then plays back a child's ...
The use of mobile phones to support children's literacy learning
PERSUASIVE'07: Proceedings of the 2nd international conference on Persuasive technologyThe goal of this study was to develop a mobile-phone based intervention that would encourage parents to engage their children in daily literacy-learning activities. The intervention content included text messages for parents, audio messages for parents ...
Juno: An Interactive Storytelling Robot for Early Constructive Childhood Intervention
HRI '20: Companion of the 2020 ACM/IEEE International Conference on Human-Robot InteractionEarly life adversity is a major risk factor for the development of psychological and behavioral problems in adult life. Traumatic experiences in childhood are linked to higher rates of depression, anxiety disorders and a range of mental health issues.[4]...
Comments