A Video-based Virtual Reality System

Haruo Takeda, Masami Yamasaki, Toshio Moriya,
Tsuyoshi Minakawa, Fumiko Beniyama, Takafumi Koike

Hitachi, Ltd., Japan
1099 Ohzenji,
Asao-ku,
Kawasaki, 215-0013,
Japan

We introduce a new environment to make and play interactive contents with more than video game quality. The system consists of a projector array (PA), a video/CG player for the PA and an editor for the video/CG data. The PA projects multiple digital images seamlessly both in time and space. The video/CG player features a function to composite passive video and interactive CG in real time. The editor is a high-end non-linear editing system combined with some new plug-in software featuring pre-computation of the information necessary for real-time compositing. A new method of digital image recognition assisted by a human operator is used in the plug-in.