Merging Virtual and Real Worlds into a New Reality

Mixed Reality Technology

Mixed Reality (MR) refers to imaging technologies that seamlessly integrate the real and virtual worlds in real time. Canon has been working on developing MR technology for practical use through the company's head-mounted display (HMD) and registration technologies. MR technology enables design engineers to view virtual three-dimensional images to perform a variety of simulations even in the initial design stages. Exploring industrial applications for this technology is expected to yield such benefits as shorter development times and fewer prototype cycles.

Head-mounted display (HMD)

As a key MR technology device, Canon is developing a unique video see-through HMD that incorporates two compact built-in cameras. The HMD eliminates the parallax that would occur between the lines of sight of the observer and the camera for each eye. When wearing the HMD, computer-generated (CG) virtual objects appear to exist in real space, enabling users to easily grasp the scale of the virtual objects within realworld surroundings.

Overview of MR technology

Overview of MR technology

Registration technology

The key to enabling the practical use of MR technology is eliminating discrepancies in alignment, timing and image quality when merging the real and virtual worlds. Canon has started developing the technology to combine the HMD's built-in cameras, independent cameras located in the real world, and the gyro sensor on the HMD.

By increasing the effective operating range, Canon aims to develop this technology for use in a broad range of applications.

Registration Combining Image Processing and Gyrosensor

Registration Combining Image Processing and Gyrosensor

MR image

MR image

Real image

Real image

Example of an MR Technology Application