GravField
2024 | by Botao Amber Hu, Yuemin Huang, Mingze Chai, Yilan Tao, and Xiaobo Aaron Hu
In this research, I contributed substantially to the experimental design, data collection, and data analysis, and provided key intellectual insights during brainstorming sessions.
2024, at Reality Design Lab
Author / Botao Amber Hu, Yuemin Huang, Mingze Chai, Yilan Tao, and Xiaobo Aaron Hu
Keywords / Mixed Reality, Speculative Design, Intercoporeal
Contribution / Project management, empirical study, research and academic writing
Overview
We present "Gravitational Field" (GravField) an experimental and participatory live performance set in a co-located mixed reality environment. Participants wearing AR headsets are invited to join and collectively create real-time music through their collaborative body movements, guided by the programmed settings from live-coders. This innovative experiment harnesses intercorporeal signals derived from participants' body movements, including factors like distance, area formation, relative height differences, and head motion synchronization. Live-coders dynamically map these signals into metaphorical audiovisual patterns in augmented reality, providing participants with cues about the relationships between players. The live-coded patterns shape and influence participants' improvisation of body movements, while adjustments in live coding dynamically alter how these movements generate sound, influencing the overall improvisational experience. In addition, spectators outside the live performance area can enjoy the mixed reality performance through projection screens and TVs, enhancing audience engagement. GravField aims to explore the vast potential of intercorporeal signals, creating a communicative, playful, and co-creative space where players' interconnected bodies become the instruments of expression.
Publications
Botao Amber Hu*, Yuemin Huang, Mingze Chai, Xiaobo Aaron Hu, Yilan Elan Tao, and Rem RunGu Lin. 2024. "GravField: Live-Coding Bodies through Mixed Reality". In Adjunct Proceeding of SIGGRAPH Asia 2024 (SA '24). XR. [→]
Botao Amber Hu, Yuemin Huang, Mingze Chai, Xiaobo Aaron Hu, and Yilan Elan Tao. 2024. "GravField: Towards Designing an Inter-bodily Live-Coding Performance System within Collocated Mixed Reality Field". In Companion Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY Companion '24). Work-in-Progress. [→]
Botao Hu*, Yuemin Huang, Mingze Chai, Yilan Tao and Xiaobo Hu. 2024. "GravField: A Participatory Performance Exploring Intercorporeality as Live-Coding Instruments within a Co-located Mixed Reality". In Proceedings of the 2024 International Conference on Live Coding (ICLC ‘24). Live Performance. [→]
Exhibitions
SIGGRAPH Asia 2024 XR. "GravField". Tokyo, Japan.
The International Conference on Live Coding 2024 Live Performance. "GravField". Shanghai, China.
Credits
Concept Designer: Botao Amber Hu, Yuemin Huang
Interaction Designer: Botao Amber Hu
Sound Designer: Mingze Chai
Technical Artist: Xiaobo Aaron Hu
Project Manager & Research Assistant: Yilan Tao