Information processing apparatus and method

• US 7,610,558 B2
• Filed: 01/30/2003
• Issued: 10/27/2009
• Est. Priority Date: 02/18/2002
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Morita, Kenji
• Primary Examiner(s): Lo; Weilun
• Assistant Examiner(s): Theriault; Steven B
• Application Number:
  US10/354,006
• Publication Number:
  US 20030156144A1
• Time in Patent Office: 2,462 Days
• Field of Search: 715/848, 348/8
• US Class Current: 715/757
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

An information processing apparatus generates and displays a mixed reality image in which a plurality of subjects have virtual objects by their hands. The apparatus includes a unit for measuring a position of the hand of the subject, a unit for measuring a view position and a view direction of the subject, and a unit for generating the virtual object and synthesizing the virtual object with the real space image. Also included is an upcast action detecting unit for calculating a shifting speed of the hand in an upward direction and for detecting an upcast action, a unit for judging that the hand is stopped and a determining unit for determining a partner subject to whom the virtual object is upcast.

Claims

1. An information processing apparatus for generating and displaying a mixed reality image of a mixed reality space in which a plurality of players have virtual objects by their hands respectively, by combining a real space image and a virtual space image representing a virtual object, comprising:

a first measuring unit adapted to measure a position of the hand of the player;

a second measuring unit adapted to measure a view position and a view direction of a head mount display of the player, said second measuring unit being disposed on the head mount display;

a management unit adapted to manage a stage of a virtual space based on the measured position of the hand of the player;

a generation unit adapted to generate the virtual space image based on the state of the virtual space, the measured view position and the view direction of the player;

a combining unit adapted to combine the virtual space image and the real space image, with the head mount display adapted to display the combined image;

an upcast action detecting unit adapted to detect an upcast action based on a shifting speed of the hand in an upward direction;

a first judging unit adapted to judge that the hand is stopped if the shifting speed of the hand in the upward direction becomes smaller than a predetermined value after the upcast action was detected by said upcast action detecting unit;

a determining unit adapted to determine from other players a partner player to whom the virtual object is upcast, on the basis of the view position and the view direction of the player and view positions of other players when it is judged that the hand is stopped; and

a control unit adapted to control the state of the virtual space so that in the virtual space a position of the virtual object corresponding to the hand of which the upcast action was detected is changed toward the partner player, according to the detected result of the upcast action.

2. An information processing apparatus according to claim 1, further comprising a second judging unit adapted to judge whether or not the partner player is effecting the upcast action when the upcast action to the determined partner player is decided;

a third measuring unit adapted to measure the view direction of the partner player; and

a timing control unit adapted to control a timing of processing for mutually casting and receiving the virtual object between the player and the partner player in accordance with a judged result of said second judging unit and a measured result of said third measuring unit.

3. An information processing method in which a position of a hand of a player is measured, a view position and a view direction of the player are measured by a measuring unit, a virtual space image is generated in accordance with the view position, the view direction and the position of the hand, and a mixed reality image is generated by combining the virtual space image with a real space image, said method comprising the steps of:

detecting an upcast action based on a shifting speed of the hand in an upward direction;

determining that the hand is stopped if the shifting speed in the upward direction becomes smaller than a predetermined value after the upcast action is detected;

determining a partner player to whom the virtual object is upcast, on the basis of the view position and the view direction of a head mount display of the player, the measuring unit being disposed on the head mount display. and view positions of other players when it is judged that the hand is stopped; and

moving the state of the virtual space so that in the virtual space a position of the virtual object corresponding to the hand of which the upcast action was detected is changed toward the partner player, according to the detected result of the upcast action.

4. An information processing method according to claim 3, wherein, if a condition that a shifting speed of a hand of another player is not less than a predetermined value continues when the shifting speed of the hand becomes smaller than a predetermined value after a condition that the shifting speed of the hand is not less than the predetermined value continues for the time not less than the predetermined time, the respective virtual space images are moved each other simultaneously between the player and the another player.

5. A computer-readable storage medium encoded with a computer program realizing an information processing method in which a position of a hand of a player is measured, a view position and a view direction of the player are measured by a measuring unit, a virtual space image is generated in accordance with the view position, the view direction and the position of the hand, and a mixed reality image is generated by combining the virtual space image with a real space image, said computer program causing execution of the steps of:

detecting an upcast action based on a shifting speed of the hand in an upward direction;

determining that the hand is stopped if the shifting speed in the upward direction becomes smaller than a predetermined value after the upcast action is detected;

determining a partner player to whom the virtual object is upcast, on the basis of the view position and the view direction of a head mount display of the player, the measuring unit being disposed on the head mount display, and view positions of other players when it is judged that the hand is stopped; and

moving the state of the virtual space so that in the virtual space a position of the virtual object corresponding to the hand of which the upcast action was detected is changed toward the partner player, according to the detected result of the upcast action.