Information processing method and apparatus
First Claim
1. An information processing method for enabling a further user to share a mixed reality space image including a virtual object superimposed in a space where a first user exists, comprising:
- a first image acquiring step of obtaining a first stereo image based on stereo video data from a first stereo capturing section mounted on the first user and a virtual object image created based on the position and orientation of the first stereo capturing section;
a second image acquiring step of obtaining a second stereo image based on stereo video data from a second stereo capturing section provided in the space where the first user exists and a virtual object image created based on the position and orientation of the second stereo capturing section;
a selecting step of selecting an image from the first stereo image and the second stereo image according to an instruction of the further user;
a displaying step of displaying the selected image to the further user;
a manipulation object position acquiring step of obtaining the position of a manipulation object manipulated by the further user;
a further user position and orientation acquiring step of obtaining the position and orientation of the further user;
a relative position information acquiring step of obtaining relative position information representing the position of the manipulation object relative to the position and orientation of the further user;
a producing step of producing a manipulation object virtual image based on the position and orientation of the first stereo capturing section, with reference to the relative position information of the manipulation object and the position and orientation of one of the first and second stereo capturing sections corresponding to the selected image;
a combining step of combining the manipulation object virtual image with the first stereo image to create a composite image; and
a displaying step of displaying the composite image to the first user.
1 Assignment
0 Petitions
Accused Products
Abstract
An information processing method and apparatus enables one or more further users to share a mixed reality space image including a virtual object superimposed in a space where a first user exists. A first stereo image is acquired based on a stereo video captured by a first stereo capturing section mounted on the first user and a virtual object image created based on the position and orientation of the first stereo capturing section. A second stereo image is acquired based on a stereo video captured by a second stereo capturing section provided in the space where the first user exists and a virtual object image created based on the position and orientation of the second stereo capturing section. An image is selected from the first stereo image and the second stereo image according to an instruction of the further user. The selected image is presented to the further user.
52 Citations
5 Claims
-
1. An information processing method for enabling a further user to share a mixed reality space image including a virtual object superimposed in a space where a first user exists, comprising:
-
a first image acquiring step of obtaining a first stereo image based on stereo video data from a first stereo capturing section mounted on the first user and a virtual object image created based on the position and orientation of the first stereo capturing section; a second image acquiring step of obtaining a second stereo image based on stereo video data from a second stereo capturing section provided in the space where the first user exists and a virtual object image created based on the position and orientation of the second stereo capturing section; a selecting step of selecting an image from the first stereo image and the second stereo image according to an instruction of the further user; a displaying step of displaying the selected image to the further user; a manipulation object position acquiring step of obtaining the position of a manipulation object manipulated by the further user; a further user position and orientation acquiring step of obtaining the position and orientation of the further user; a relative position information acquiring step of obtaining relative position information representing the position of the manipulation object relative to the position and orientation of the further user; a producing step of producing a manipulation object virtual image based on the position and orientation of the first stereo capturing section, with reference to the relative position information of the manipulation object and the position and orientation of one of the first and second stereo capturing sections corresponding to the selected image; a combining step of combining the manipulation object virtual image with the first stereo image to create a composite image; and a displaying step of displaying the composite image to the first user. - View Dependent Claims (5)
-
-
2. An information processing method for enabling a further user to share a mixed reality space image including a virtual object superimposed in a space where a first user exists, comprising:
-
a first image acquiring step of obtaining a first stereo image based on stereo video data from a first stereo capturing section mounted on the first user and a virtual object image created based on the position and orientation of the first stereo capturing section; a second image acquiring step of obtaining a second stereo image based on stereo video data from a second stereo capturing section provided in the space where the first user exists and a virtual object image created based on the position and orientation of the second stereo capturing section; a selecting step of selecting an image from the first stereo image and the second stereo image according to an instruction of the further user; a displaying step of displaying the selected image to the further user; a manipulation object position acquiring step of obtaining the position of a manipulation object manipulated by the further user; a further user position and orientation acquiring step of obtaining the position and orientation of the further user; a relative position information acquiring step of obtaining relative position information representing the position of the manipulation object relative to the position and orientation of the further users; an identification image producing step of producing an identification image representing the selected image; an identification image combining step of combining the identification image with the first stereo image to create a composite image; and a displaying step of displaying the composite image created in the identification image combining step to the first user. - View Dependent Claims (3)
-
-
4. An information processing apparatus that enables a further user to share a mixed reality space image including a virtual object superimposed in a space where a first user exists, comprising:
-
a first image acquiring unit configured to obtain a first stereo image based on stereo video data from a first stereo capturing section mounted on the first user and a virtual object image created based on the position and orientation of the first stereo capturing section; a second image acquiring unit configured to obtain a second stereo image based on stereo video data from a second stereo capturing section provided in the space where the first user exists and a virtual object image created based on the position and orientation of the second stereo capturing section; a selecting unit configured to select an image from the first stereo image and the second stereo image according to an instruction of the further user; a display unit configured to display the selected image to the further user; a manipulation object position acquiring unit configured to obtain the position of a manipulation object manipulated by the further user; a further user position and orientation acquiring unit configured to obtain the position and orientation of the further user; a relative position information acquiring unit configured to obtain relative position information representing the position of the manipulation object relative to the position and orientation of the further user; a producing unit configured to produce a manipulation object virtual image based on the position and orientation of the first stereo capturing section, with reference to the relative position information of the manipulation object and the position and orientation of one of the first and second stereo capturing sections corresponding to the selected image; a combining unit configured to combine the manipulation object virtual image with the first stereo image to create a composite image; and a displaying unit configured to display the composite image to the first user.
-
Specification