Image processing method and image processing apparatus
First Claim
1. An image processing method for generating a mixed reality image by compositing an image of a virtual object having position and orientation information to a real space image and displaying the mixed reality image on an image plane of a display unit, comprising the steps of:
- acquiring, by a microprocessor, viewpoint position and orientation information of a user;
detecting, by the microprocessor, position and orientation information of a predetermined real object;
detecting, by the microprocessor, a positional relationship between the virtual object and the predetermined real object;
generating, by the microprocessor, a first image by rendering the virtual object as a translucent object and the predetermined real object according to the positional relationship;
generating, by the microprocessor, a second image by superimposing the first image on the real space image on the basis of the viewpoint position and orientation information;
generating, by the microprocessor, a third image by rendering the predetermined real object as a transparent object which is positioned in front of the virtual object and is not intersecting with the virtual object and rendering the virtual object as an opaque object according to the positional relationship; and
generating, by the microprocessor, the mixed reality image by superimposing the third image on the second image;
wherein in the step of generating the first image, if the predetermined real object intersects with the virtual object, the microprocessor renders the intersecting part of the predetermined real object as the virtual object.
1 Assignment
0 Petitions
Accused Products
Abstract
A virtual object and stylus model as images to be composited to a real space image are rendered by changing background transparencies according to a mutual positional relationship. When the virtual object image is composited to the real space image, the image of the stylus included in the real space image is observed while reflecting the positional relationship with the virtual object. In this way, in an MR image, the depth ordering between real and virtual objects can be correctly and easily expressed.
-
Citations
4 Claims
-
1. An image processing method for generating a mixed reality image by compositing an image of a virtual object having position and orientation information to a real space image and displaying the mixed reality image on an image plane of a display unit, comprising the steps of:
-
acquiring, by a microprocessor, viewpoint position and orientation information of a user; detecting, by the microprocessor, position and orientation information of a predetermined real object; detecting, by the microprocessor, a positional relationship between the virtual object and the predetermined real object; generating, by the microprocessor, a first image by rendering the virtual object as a translucent object and the predetermined real object according to the positional relationship; generating, by the microprocessor, a second image by superimposing the first image on the real space image on the basis of the viewpoint position and orientation information; generating, by the microprocessor, a third image by rendering the predetermined real object as a transparent object which is positioned in front of the virtual object and is not intersecting with the virtual object and rendering the virtual object as an opaque object according to the positional relationship; and generating, by the microprocessor, the mixed reality image by superimposing the third image on the second image; wherein in the step of generating the first image, if the predetermined real object intersects with the virtual object, the microprocessor renders the intersecting part of the predetermined real object as the virtual object. - View Dependent Claims (2, 4)
-
-
3. An image processing apparatus for generating a mixed reality image by compositing an image of a virtual object having position and orientation information to a real space image and displaying the mixed reality image on an image plane of a display unit, comprising:
-
a user position and orientation information acquisition unit adapted to acquire viewpoint position and orientation information of a user; a real object position and orientation information acquisition unit adapted to detect position and orientation information of a predetermined real object; a positional relationship acquisition unit adapted to detect a positional relationship between the virtual object and the predetermined real object; and a microprocessor adapted, (i) to generate a first image by rendering the the virtual object as a translucent object and the predetermined real object according to the positional relationship, (ii) to generate a second image by superimposing the first image on the real space image on the basis of the viewpoint position and orientation information, (iii) to generate a third image by rendering the predetermined real object as a transparent object which is positioned in front of the virtual object and is not intersecting with the virtual object and rendering the virtual object as an opaque object according to the positional relationship, and (iv) to generate the mixed reality image by superimposing the third image on the second image; wherein, when generating the first image, if the predetermined real object intersects with the virtual object, the microprocessor renders the intersecting part of the predetermined real object as the virtual object.
-
Specification