StreamSpace: Pervasive Mobile Mixed Reality Framework for Remote Assistance, Collaboration, and Entertainment

2018. 11. 21

This study investigates how pervasive mobile mixed reality telepresence can assist users in collaborative tasks, entertainment, and navigation, by expanding their visible and interactive space within a shared mixed reality environment. To address this issue, this work proposes and discusses the Spatial Livestream Composition (SLC) method that combines both directionalized live media streams and photospherical imagery in a single collaborative multiuser environment. The proposed method was implemented in three proof-of-concept applications, and two of them were validated in user studies. The preliminary results have shown decrease in mental workload, increase in spatial and situational awareness, as well as increase in user engagement in comparison with similar applications with regular, non mixed reality, interfaces. We see our application being used in various use-cases, including telemedicine, remote assistance, collaboration, and entertainment.

Bektur Ryskeldiev, Yoichi Ochiai, Michael Cohen, and Jens Herder. 2018. Distributed Metaverse: Creating Decentralized Blockchain-based Model for Peer-to-peer Sharing of Virtual Spaces for Mixed Reality Applications. In Proceedings of the 9th Augmented Human International Conference (AH ’18). ACM, New York, NY, USA, Article 39, 3 pages. DOI: https://doi.org/10.1145/3174910.3174952

Bektur Ryskeldiev, Michael Cohen, Jens Herder, and Yoichi Ochiai. Reactspace: Spatial-aware user interactions for collocated social livestreaming experiences. In IEEE Int. Conf. On Systems, Man, and Cybernetics (SMC), 2018, pp. 724-728 Miyazaki, Japan. https: //doi.org/10.1109/SMC.2018.00132

Bektur Ryskeldiev, Toshiharu Igarashi, Junjian Zhang, Yoichi Ochiai, Michael Cohen, and Jens Herder. Spotility: Crowdsourced telepresence for social and collaborative experiences in mobile mixed reality. In ACM CSCW, 2018, pp. 373-376. New York, USA. https://doi.org/10.1145/3272973.3274100