The 2003 International Symposium on Collaborative Technologies and Systems (CTS’03)
Blending the Real, Virtual and Imagined
Charles E. Hughes
Mixed Reality (MR) refers to experiences that lie strictly between the purely virtual and the unaltered real world. Experiences centered in the real world, with virtual augmentation, are referred to as Augmented Realities (AR). Those on the opposite extreme are referred to as Augmented Virtualities (AV). Both extremes will be covered in this presentation, with the added twist of considering the role of imagination as central to MR experiences.
MR environments commonly use see-through Head Mounted Displays (HMDs) to alter the user’s visual experience. Such HMD’s can be optical see-through (the real world is seen directly with synthetic overlays) or video see-through (the real world is captured by cameras on the front side of the HMD, altered to add effects including synthetic imagery and then sent back to displays on the back side of the HMD). In addition to HMD’s, MR environments require tracking technologies to determine the position and orientation of users (and other real objects), registration algorithms to determine the relative positions of real and virtual objects, and rendering algorithms to manage such issues as mutual occlusion and proper illumination. Additionally, MR environments often include spatial sound and show effects devices. Spatial sound provides a richer immersive experience and is critical to training scenarios. Show effects devices, commonly used in theatrical productions, allow virtual objects to affect the behaviors of real objects (real affecting virtual is much easier).
presentation will discuss MR technologies and research problems, focusing on applications
ranging from military training to entertainment. Specific examples of technologies will include
the Canon COASTAR video see-through HMD, an optical see-through HMD developed
Scientists, engineers and practitioners interested in state of the art in mixed and augmented realities and their applications to collaborative systems.
Basic science and engineering, programming and/or modeling and simulation.
METHOD OF PRESENTATION:
Power Point using LCD projector. Tutorial notes will be made available.
Charles E. Hughes is
Professor of Computer Science in the