Smartphone Drum

2021. 10. 29

Smartphone Drum: Gesture-based Digital Musical Instruments Application for Deaf and Hard of Hearing People

Smartphone applications that allow users to enjoy playing musical instruments have emerged, opening up numerous related opportunities. However, it is difficult for deaf and hard of hearing (DHH) people to use these apps because of limited access to auditory information. When using real instruments, DHH people typically feel the music from the vibrations transmitted by the instruments or the movements of the body, which is not possible when playing with these apps. We introduce “smartphone drum,” a smartphone application that presents a drum-like vibrotactile sensation when the user makes a drumming motion in the air with their smartphone like a drumstick. We implemented an early prototype and received feedback from six DHH participants. We discuss the technical implementation and the future of new instruments of vibration.

Project Members: Ryo Iijima, Akihisa Shitara, Sayan Sarcar, Yoichi Ochiai


プロジェクトメンバー: 飯嶋稜、設楽明寿、Sarcar Sayan、落合陽一

Contact / 連絡先:飯嶋稜(ryoiijima -at-

▼ Download from the App Store