Augmented Reality offers great potential to support musicians in collaborating remotely. We are building an application to enable drummers to play together in a drum circle using physical electronic drum pads and augmented reality technology. Unlike previous remote jamming applications, musicians who use this application will see AR avatars of each of the other drummers they are playing with (up to two other drummers) which they can place in their own environment via AR fiducial markers. Audio will be captured via the MIDI output from the electronic drum pads and sent to each musician in the circle, where it will be synthesized into spatial audio based on the placement of the avatars. Combining the MIDI output with hand tracking, we will enable players to communicate through body movement with their avatars, a core component of music collaboration.
See the communication techniques commonly used in a drum circle in this .
Publications
-
Hopkins Torin, Weng Suibi Che Chuan, Vanukuru Rishi, Wenzel Emma A., Banic Amy, Gross Mark D., Do Ellen Yi-Luen (2022), AR Drum Circle: Real-Time Collaborative Drumming in AR, , Frontiers in Virtual Reality, Vol. 3, Article 847284 听(11 pages), online Aug 19, 2022, URL=, DOI=10.3389/frvir.2022.847284
-
T. Hopkins,听S. C. -C. Weng,听R. Vanukuru,听E. Wenzel,听A. Banic听补苍诲听E. Y. -L. Do, "How Late is Too Late? Effects of Network Latency on Audio-Visual Perception During AR Remote Musical Collaboration,"听2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2022, pp. 686-687, doi: . (Christchurch, New Zealand鈥擬arch12-16, 2022).
听
听
Ericsson Research Project Collaborators:
Amir Gomroki, head for 5G, North America;听H茅ctor Caltenco,听senior researcher;听Per-Erik Brodin, research engineer;听听Ali El Essaili, senior research engineer; Chris Phillips, master researcher;听Alvin Jude Hari Haran, senior researcher;听Per Karlsson, director, media technology research at Ericsson and听head of Ericsson Research in Silicon Valley.
听
Associated Researchers
