Transformed Human Presence for Puppetry

2016. 01. 01

We propose a system for transmitting a human performer’s body and facial movements to a puppet with audiovisual feedback to the performer. The system consists of a head-mounted display (HMD) that shows the performer the video recording of the puppet’s view, a microphone for voice capture, and photoreflectors for detecting the mouth movements of the human performer. In conventional puppetry, there is also the need for practice in the manipulation of the puppets to achieve good performance. The proposed telepresence system addresses these issues by enabling the human performer to manipulate the puppet through their own body and facial movements. The proposed system is expected to contribute to the development of new applications of puppetry and expand the interactivity of puppetry and the scope of entertainment.

Keisuke Kawahara, Mose Sakashita*,  Amy Koike, Ippei Suzuki, Kenta Suzuki, Yoichi Ochiai (* Joint first authorship)
University of Tsukuba

SIGGRAPH 2016 One-Page Abstract (Author Preprint) : PDF (Lowres, 231KB)
ACE 2016 Extended Abstract (Author Preprint) : PDF (3.1MB)

All visual and video documents are available for the media and press
under the Creative Commons Attribution-Share Alike 3.0 Unported license.
Images are taken by Amy Koike, Ippei Suzuki / University of Tsukuba (小池栄美, 鈴木一平/筑波大学)
Pictures are drawn by Ryo Sejiri / University of Tsukuba (瀬尻瞭/筑波大学)