Image processing method and image processing apparatus
First Claim
1. An image processing method for generating a mixed reality image by compositing an image of a virtual object having position and orientation information to a real space image, comprising:
- a user position and orientation information acquisition step of acquiring viewpoint position and orientation information of a user;
a real object position and orientation information acquisition step of detecting position and orientation information of a predetermined real object;
a positional relationship acquisition step of detecting a positional relationship between the virtual object and a model on the basis of the viewpoint position and orientation information, information of the model of the predetermined real object, the position and orientation information of the real object, and position and orientation information of the virtual object;
a rendering step of rendering an image of the virtual object and the model of the predetermined real object using transparencies according to the positional relationship; and
a composition step of compositing the real space image and the image generated in the rendering step.
1 Assignment
0 Petitions
Accused Products
Abstract
A virtual object (402) and stylus model (403) as images to be composited to a real space image are rendered by changing background transparencies according to a mutual positional relationship. When the virtual object image is composited to the real space image, the image of the stylus included in the real space image is observed while reflecting the positional relationship with the virtual object. In this way, in an MR image, the depth ordering between real and virtual objects can be correctly and easily expressed.
137 Citations
11 Claims
-
1. An image processing method for generating a mixed reality image by compositing an image of a virtual object having position and orientation information to a real space image, comprising:
-
a user position and orientation information acquisition step of acquiring viewpoint position and orientation information of a user;
a real object position and orientation information acquisition step of detecting position and orientation information of a predetermined real object;
a positional relationship acquisition step of detecting a positional relationship between the virtual object and a model on the basis of the viewpoint position and orientation information, information of the model of the predetermined real object, the position and orientation information of the real object, and position and orientation information of the virtual object;
a rendering step of rendering an image of the virtual object and the model of the predetermined real object using transparencies according to the positional relationship; and
a composition step of compositing the real space image and the image generated in the rendering step. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 10, 11)
-
-
9. An image processing apparatus for generating a mixed reality image by compositing an image of a virtual object having position and orientation information to a real space image, comprising:
-
user position and orientation information acquisition unit adapted to acquire viewpoint position and orientation information of a user;
real object position and orientation information acquisition unit adapted to detect position and orientation information of a predetermined real object;
positional relationship acquisition unit adapted to detect a positional relationship between the virtual object and a model on the basis of the viewpoint position and orientation information, information of the model of the predetermined real object, the position and orientation information of the real object, and position and orientation information of the virtual object;
rendering unit adapted to render an image of the virtual object and the model of the predetermined real object using transparencies according to the positional relationship; and
composition unit adapted to composite the real space image and the image generated by said rendering unit.
-
Specification