Urvish Trivedi
ABSTRACT
Music is a multi-dimensional entity and can be experienced in different forms, such as sound, vibrations or visual displays. This experience is typically confined to people without hearing impairments, but for people with hearing impairments, it can be difficult or impossible to enjoy and experience this form of art. Recent technological advancement offers some opportunities through which attempts can be made to provide musical experience to people with hearing impairment. The purpose of this research is to develop an affordable wearable haptic device for people with hearing disabilities to experience music. This device can be helpful for people with reduced hearing as well as with complete deafness. In this project, we adopt a design development strategy which is based on testing different assistive technologies and to check their efficacy to transmit musical notes into other human sensory inputs.
The final prototype consists of Vibrotactile sleeves with bone conduction speakers. These sleeves provide sensory input of vibrations via bone conduction speakers. The prototype is developed based on subjects' surveys and feedback on different assistive technologies. To test our prototype, we developed a visualization system which gives visual clues that represent the given musical notes. A formal user testing with five participants suggests that this system can be used to provide the musical experience to people with hearing impairments.
- Mazzoni, A., & Bryan-Kinns, N. (2015, June). How does it feel like? An exploratory study of a prototype system to convey emotion through haptic wearable devices. In Intelligent Technologies for Interactive Entertainment (INTETAIN), 2015 7th International Conference on (pp. 64--68). IEEE. Google Scholar
Digital Library
- Branje, C., Maksimouski, M., Karam, M., Fels, D. I., & Russo, F. (2010, February). Vibrotactile display of music on the human back. In 2010 Third International Conference on Advances in Computer-Human Interactions (pp. 154--159). IEEE. Google ScholarDigital Library
- Cholewiak, R. W., & McGrath, C. (2006, March). Vibrotactile targeting in multimodal systems: Accuracy and interaction. In Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2006 14th Symposium on (pp. 413--420). IEEE. Google ScholarDigital Library
- Matthews, T., Fong, J., & Mankoff, J. (2005, October). Visualizing non-speech sounds for the deaf. In Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility (pp. 52--59). ACM. Google ScholarDigital Library
- Kirman, J. H. (1986). Vibrotactile frequency recognition: Forward and backward masking effects. The Journal of general psychology, 113(2), 147--158.Google ScholarCross Ref
- Karam, M., Russo, F. A., & Fels, D. I. (2009). Designing the model human cochlea: An ambient crossmodal audio-tactile display. IEEE Transactions on Haptics, 2(3), 160--169. Google ScholarDigital Library
- Bigand, E., Vieillard, S., Madurell, F., Marozeau, J., & Dacquet, A. (2005). Multidimensional scaling of emotional responses to music: The effect of musical expertise and of the duration of the excerpts. Cognition & Emotion, 19(8), 1113--1139.Google ScholarCross Ref
- Nanayakkara, S., Taylor, E., Wyse, L., & Ong, S. H. (2009, April). An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 337--346). ACM. Google ScholarDigital Library
- Jones, R., & Nevile, B. (2005). Creating visual music in jitter: Approaches and techniques. Computer Music Journal, 29(4), 55--70. Google ScholarCross Ref
- Rusconi, E., Kwan, B., Giordano, B. L., Umilta, C., & Butterworth, B. (2006). Spatial representation of pitch height: the SMARC effect. Cognition, 99(2), 113--129.Google ScholarCross Ref
- LabVIEW (Version 2018) {Computer software}. (n.d.). Retrieved January 23, 2019, from http://www.ni.com/en-us/shop/labview.htmlGoogle Scholar
- FL Studio (Version 20.1.1.795) {Computer software}. (n.d.). Retrieved January 2019, from https://www.image-line.com/flstudio/Google Scholar
- Unity3D (Version 2018.3) {Computer software}. (n.d.). Retrieved January 23, 2019, from https://unity3d.comGoogle Scholar
Index Terms
- Wearable musical haptic sleeves for people with hearing impairment
Recommendations
Designing a Haptic Feedback System for Hearing-Impaired to Experience Tap Dance
UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and TechnologyIn this study, we have designed a system to enable hearing-impaired to enjoy the performance of tap dancers. This system transfers the haptic sensation of tap dancing from the stage to the audience and helps hearing-impaired people enjoy the vibration ...
Impact of web accessibility barriers on users with hearing impairment
Interacción '14: Proceedings of the XV International Conference on Human Computer InteractionSeveral users tests were carried out with people with a hearing impairment to evaluate the impact of different web accessibility barriers on two similar web sites, one accessible and the other not accessible. The tests focus was to analyze user's mood ...
Alert systems to hearing-impaired people: a systematic review
AbstractIn recent years there has been a growing concern about the inclusion of people with disabilities in society. Many research in assistive technologies have been carried out, but with a significant disparity between support for the visually impaired ...
Comments