SYSTEM FOR DISPLAYING AND CONTROLLING ELECTRONIC OBJECTS
First Claim
1. A computer-readable storage medium storing a video game program to be executed by a computer of a video game device for obtaining control data from a control device including image capturing means for capturing an image of a marker object, the control data being captured image data obtained by the image capturing means or data obtained by performing a predetermined operation on the captured image data, and for displaying a game image on a display device, the game image being an image of a virtual game space in which a controlled object is moved by a game process using the control data, the video game program instructing the computer to perform:
- a reference image display step of displaying a reference image at a predetermined position on a screen of the display device;
a pointer image display step of displaying a pointer image at a position on the screen pointed at by the control device; and
an object control step of controlling the controlled object to act according to a position of the marker object in the captured image based on the control data, after the pointer image reaches inside a predetermined area including at least a portion of the reference image.
2 Assignments
0 Petitions
Accused Products
Abstract
The present invention is directed toward a system and process that controls a group of networked electronic components using a multimodal integration scheme in which inputs from a speech recognition subsystem, gesture recognition subsystem employing a wireless pointing device and pointing analysis subsystem also employing the pointing device, are combined to determine what component a user wants to control and what control action is desired. In this multimodal integration scheme, the desired action concerning an electronic component is decomposed into a command and a referent pair. The referent can be identified using the pointing device to identify the component by pointing at the component or an object associated with it, by using speech recognition, or both. The command may be specified by pressing a button on the pointing device, by a gesture performed with the pointing device, by a speech recognition event, or by any combination of these inputs.
-
Citations
35 Claims
-
1. A computer-readable storage medium storing a video game program to be executed by a computer of a video game device for obtaining control data from a control device including image capturing means for capturing an image of a marker object, the control data being captured image data obtained by the image capturing means or data obtained by performing a predetermined operation on the captured image data, and for displaying a game image on a display device, the game image being an image of a virtual game space in which a controlled object is moved by a game process using the control data, the video game program instructing the computer to perform:
-
a reference image display step of displaying a reference image at a predetermined position on a screen of the display device; a pointer image display step of displaying a pointer image at a position on the screen pointed at by the control device; and an object control step of controlling the controlled object to act according to a position of the marker object in the captured image based on the control data, after the pointer image reaches inside a predetermined area including at least a portion of the reference image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A video game system including a control device including image capturing means for capturing an image of a marker object, and a video game device for displaying a game image on a display device, the game image being an image of a virtual game space in which a controlled object is moved by a game process using control data, the control data being captured image data obtained by the image capturing means or data obtained by performing a predetermined operation on the captured image data, the video game system comprising:
-
reference image display control means for displaying a reference image at a predetermined position on a screen of the display device; pointer image display means for displaying a pointer image at a position on the screen pointed at by the control device; image erasing means for erasing the pointer image when the pointer image reaches inside a predetermined area defined based on a position of the reference image; and object control means for controlling the controlled object to act according to a position of the marker object in the captured image based on the control data, after the pointer image reaches inside a predetermined area defined based on a position of the reference image.
-
-
12. A computer-implemented method for controlling an electronic object, comprising:
-
capturing feature data indicating position of a control device; displaying an image of a representation of an object to be controlled at a predetermined position on a screen of a display device; displaying a cursor at a position on the screen pointed at by the control device; and controlling the controlled object to act according to the captured feature data, after the cursor is displayed near a portion of the object image. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A video game system comprising:
-
feature data capture means for capturing feature data indicating position of a control device; reference image display control means for displaying an image representative of an object to be controlled at a predetermined position on a screen of a display device; cursor display means for displaying a cursor at a position on the screen pointed at by the control device; image erasing means for erasing the cursor when the cursor reaches inside a predetermined area defined based on a position of the object representation image; and object control means for controlling the controlled object to act according to the captured feature data, after the cursor is displayed near a portion of the object image.
-
-
23. A storage medium storing a virtual position determining program for instructing a computer to perform a process on a virtual space based on input information obtained from an input device, the input information including target data that changes according to a change in a position of a predetermined target in a real space, the program instructing the computer to perform:
-
an actual position data calculation step of calculating actual position data representing a position of the target in the real space by using the target data; an effective range defining step of defining an effective range as a range extending from a first boundary to a second boundary, wherein the first boundary is represented by first position data and the second boundary is represented by second position data; an effective range position data calculation step of calculating effective range position data representing a position of a value of the actual position data in the effective range; a position determining step of determining a position of a controlled object in the virtual space through an operation based on a value of the effective range position data; and a display process step of displaying the virtual space on a display device. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31)
-
-
32. A storage medium storing a virtual position determining program for, based on data from an input device including position information of a target in a real space, calculating a position of the target obtained when representing the real space in a predetermined coordinate system, and calculating a virtual position of a virtual object in a virtual space based on the calculated position, the virtual position determining program instructs a computer to function as:
-
effective range defining means for defining an effective range, which is defined by at least a first position and a second position in a predetermined coordinate system of the real space; normalization means for, when the position of the target is included in the effective range, normalizing the effective range and calculating a value corresponding to the position of the target obtained when the normalization is performed; and calculation means for calculating the virtual position based on the value calculated by the normalization means. - View Dependent Claims (33)
-
-
34. A computer-implemented method for displaying a controlled object, comprising:
-
capturing feature data indicating position of a control device in real space; calculating actual position data representing a position of the control device in real space by using the captured feature data; defining an effective range as a range extending from a first boundary to a second boundary, wherein the first boundary is represented by first position data and the second boundary is represented by second position data; calculating effective range position data representing a position of a value of the actual position data in the effective range; determining a position of a controlled object in virtual space through an operation based on a value of the effective range position data; and displaying the virtual space on a display device.
-
-
35. A computer-implemented system for calculating a position of an object in virtual space, comprising:
-
effective range defining means for defining an effective range, which is defined by at least a first position and a second position in a predetermined coordinate system of a real space; normalization means for, when the position of a control device is included in the effective range, normalizing the effective range and calculating a value corresponding to the position of the control device obtained when the normalization is performed; and calculation means for calculating a virtual position based on the value calculated by the normalization means.
-
Specification