Game apparatus for mixed reality space, image processing method thereof, and program storage medium
First Claim
1. A simulator apparatus with which an operator plays a simulation in mixed reality space including a virtual space and real space in which a real object(s) is placed, said simulator comprising:
- a viewpoint detection unit adapted to detect the position/orientation of a viewpoint of the operator;
an inputting unit adapted to input a real space image corresponding to the position/orientation of the viewpoint of the operator;
a geometric information acquisition unit adapted to acquire geometric information of the real object(s) placed in the real space;
a rule memory adapted to store rules for controlling the action patterns of virtual object(s);
a status memory adapted to store a simulation progress status;
a computation unit adapted to determine the next action pattern of the virtual object(s) as if a virtual object had its own will based on a command input by the operator, the simulation progress status, the rules and the geometric information of the real object(s);
a virtual space generation unit adapted to generate a virtual space image on the basis of a next position/orientation of the virtual object(s) according to the determined action pattern and the position/orientation of the viewpoint of the operator; and
a mixed reality image generation unit adapted to generate a mixed reality space image by superimposing or overlaying the virtual space image on the real space image, wherein the next position/orientation of the virtual object(s) is determined based on a location relationship among the position/orientation of the viewpoint of the operator, position(s) of the virtual object(s) and the geometric information of the real object(s).
2 Assignments
0 Petitions
Accused Products
Abstract
A game apparatus allows a virtual object to act in a mixed reality space as if it had its own will. A player can play a game with the virtual object. Rules for controlling the action patterns of the virtual object on the basis of the objective of the game, and the relative positional relationship between the virtual object and the real object is pre-stored. The next action pattern of the virtual object is determined based on an operator command, the stored rule(s), a simulation progress status, and geometric information of a real object(s).
198 Citations
19 Claims
-
1. A simulator apparatus with which an operator plays a simulation in mixed reality space including a virtual space and real space in which a real object(s) is placed, said simulator comprising:
-
a viewpoint detection unit adapted to detect the position/orientation of a viewpoint of the operator;
an inputting unit adapted to input a real space image corresponding to the position/orientation of the viewpoint of the operator;
a geometric information acquisition unit adapted to acquire geometric information of the real object(s) placed in the real space;
a rule memory adapted to store rules for controlling the action patterns of virtual object(s);
a status memory adapted to store a simulation progress status;
a computation unit adapted to determine the next action pattern of the virtual object(s) as if a virtual object had its own will based on a command input by the operator, the simulation progress status, the rules and the geometric information of the real object(s);
a virtual space generation unit adapted to generate a virtual space image on the basis of a next position/orientation of the virtual object(s) according to the determined action pattern and the position/orientation of the viewpoint of the operator; and
a mixed reality image generation unit adapted to generate a mixed reality space image by superimposing or overlaying the virtual space image on the real space image, wherein the next position/orientation of the virtual object(s) is determined based on a location relationship among the position/orientation of the viewpoint of the operator, position(s) of the virtual object(s) and the geometric information of the real object(s). - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. An image processing method for a simulator apparatus with which an operator plays a game in a mixed reality space in which a real object(s) is placed, comprising:
-
a viewpoint detection step for detecting the position/orientation of a viewpoint of the operator;
an inputting step for inputting a real space image corresponding to the position/orientation of the viewpoint of the operator;
a geometric information acquisition step for acquiring geometric information of the real object(s) placed in the real space;
a computation step for determining the next action pattern of virtual object(s) as if a virtual object had its own will based on a command input by the operator, a simulation progress status stored in a status memory, rules stored in a rule memory for controlling the action patterns of the virtual object(s) and the geometric information of the real object(s);
a virtual space generation step for generating a virtual space image on the basis of a next position/orientation of the virtual object(s) according to the determined action pattern and the position/orientation of the viewpoint of the operator; and
a mixed reality image generation step for generating a mixed reality space image by superimposing or overlaying the virtual space image on the real space image, wherein the next position/orientation of the virtual object(s) is determined based on a location relationship among the position/orientation of the viewpoint of the operator, position(s) of the virtual object(s) and the geometric information of the real object(s). - View Dependent Claims (11, 13, 14, 15, 16, 17, 18)
-
-
12. The method according claim to 10, wherein the operator wears an optical see-through type display and the virtual space image is displayed on the display.
-
19. A storage medium which stores a program of an image processing method for a simulator apparatus with which an operator plays a simulation in a mixed reality space including a virtual space and real space in which a real object(s) is placed, comprising:
-
a viewpoint detection program step for detecting the position/orientation of a viewpoint of the operator;
an inputting program step for inputting a real space image corresponding to the position/orientation of the viewpoint of the operator;
a geometric information acquisition program step for acquiring geometric information of the real object(s) placed in the real space;
a computation program step for determining the next action pattern of virtual object(s) as if a virtual object had its own will based on a command input by the operator, a simulation progress status stored in a status memory, rules stored in a rule memory for controlling the action patterns of the virtual object(s), and the geometric information of the real object(s);
a virtual space generation program step for generating a virtual space image on the basis of a next position/orientation of the virtual object(s) according to the action pattern and the position/orientation of the viewpoint of the operator; and
a mixed reality image generation program step for generating a mixed reality space image by superimposing or overlaying the virtual space image on the real space image, wherein the next position/orientation of the virtual object(s) is determined based on a location relationship among the position/orientation of the viewpoint of the operator, position(s) of the virtual object(s) and the geometric information of the real object(s).
-
Specification