Conducting A Realistic Electronic Orchestra

Jan O. Borchers               Wolfgang Samminger               Max Mühlhäuser
Computer Science Department Telecooperation Research Group Telecooperation Group
Stanford University University of Linz Darmstadt University of Technology
Stanford, CA 94305-9020, USA 4040 Linz, Austria 64283 Darmstadt, Germany
borchers@stanford.edu sam@tk.uni-linz.ac.at max@informatik.tu-darmstadt.de

ABSTRACT

Personal Orchestra is the first system to let users conduct an actual audio and video recording of an orchestra, using an infrared baton to control tempo, volume, and instrument sections. A gesture recognition algorithm interprets user input, and a novel high-fidelity playback algorithm renders audio and video data at variable speed without time-stretching artifacts. The system is installed as a public exhibit in the HOUSE OF MUSIC VIENNA.

KEYWORDS: Conducting, orchestra, exhibit, gestures, time-stretching


This is the abstract of a paper to appear in the Proceedings of the UIST 2001 14th Annual ACM Symposium on User Interface Software and Technology (Orlando, Florida, November 11–14, 2001). See the conference web site at http://www.acm.org/uist/, and contact the primary author for more information, or to request a preprint of this paper.

Jan Borchers <borchers@stanford.edu> • Last modified Aug 17, 2001 5:15 PM