Information-processing apparatus and information-processing method

• US 8,553,049 B2
• Filed: 09/09/2008
• Issued: 10/08/2013
• Est. Priority Date: 09/10/2007
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Nogami, Atsushi, Nishimura, Naoki
• Primary Examiner(s): HARRISON, CHANTE E
• Application Number:
  US12/207,322
• Publication Number:
  US 20090066725A1
• Time in Patent Office: 1,855 Days
• Field of Search: 345/419, 345632-633, 345/156, 345 7- 9, 345/629, 345/420, 345/173
• US Class Current: 345/632
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/40 Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

An information-processing apparatus determines whether a stimulation generation unit and a background virtual object contact each other based on position and orientation information about the stimulation generation unit and position and orientation information about the background virtual object. If it is determined that the stimulation generation unit and the background virtual object contact each other, the information-processing apparatus determines whether the stimulation generation unit is included within an attention range. The information-processing apparatus generates operation setting information for controlling an operation of the stimulation generation unit according to a result of the determination and outputs the generated operation setting information to the stimulation generation unit.

Claims

1. An information-processing apparatus comprising:

an acquisition unit configured to acquire positional information of a stimulation generation unit, the stimulation generation unit being arranged so as to be capable of applying stimulation to a body part of a user;

a first determination unit configured to determine whether the virtual object and the stimulation generation unit contact each other based on position and orientation information of the virtual object and the positional information of the stimulation generation unit;

a second determination unit configured to determine whether or not a position where the virtual object and the stimulation generation unit contact each other is located within a view volume representing a view range of the user in a case where it is determined that the virtual object and the stimulation generation unit contact each other; and

an output unit configured to generate a first stimulation by controlling an operation of the stimulation generation unit in a case where it is determined that the position is located within the view volume, and to generate a second stimulation which is stronger than the first stimulation by controlling the stimulation unit in a case where it is determined that the position is not located within the view volume.

2. The information-processing apparatus according to claim 1, further comprising:

a unit configured to acquire an image in a real space as viewed from the viewpoint; and

a unit configured to output a combined image generated by combining the image in the real space and the image in the virtual space to a display apparatus.

3. The information-processing apparatus according to claim 2, wherein the second determination unit is configured to determine whether the stimulation generation unit is included within or located outside the view volume by determining whether the stimulation generation unit is included within or located outside the image in the real space.

4. The information-processing apparatus according to claim 1, wherein the second determination unit includes:

a unit configured to acquire viewpoint information about the viewpoint including the position and orientation information about the viewpoint; and

a unit configured to generate information indicating the view volume based on the viewpoint information.

5. The information-processing apparatus according to claim 1, wherein, if it is determined by the second determination unit that the stimulation generation unit is included within the view volume, the output unit is configured to generate operation setting information for causing the stimulation generation unit to generate a first stimulation,

wherein, if it is determined by the second determination unit that the stimulation generation unit is located outside the view volume, the output unit is configured to generate operation setting information for causing the stimulation generation unit to generate a second stimulation, and

wherein the first stimulation and the second stimulation differ from each other.

6. The information-processing apparatus according to claim 5, wherein the operation setting information for causing the stimulation generation unit to generate the second stimulation includes operation setting information for causing the stimulation generation unit to generate the second stimulation only within a predetermined length of time.

8. The information-processing apparatus according to claim 1, wherein the stimulation generated by the stimulation generation unit includes a cutaneous sense stimulation and a sound stimulation.

7. An information-processing apparatus comprising:

a unit configured to acquire positional information of a stimulation generation unit, the stimulation generation unit being arranged so as to be capable of applying stimulation to a body part of a user;

a determination unit configured to determine whether a virtual object and the stimulation generation unit contact each other;

a unit configured to, according to a result of determination by the determination unit, control processing for determining whether a position where the virtual object and the stimulation generation unit contact each other is within a view volume representing a view range of the user based on position and orientation information of the virtual object and the positional information of the stimulation generation unit; and

an output unit configured to generate a first stimulation by controlling an operation of the stimulation generation unit in a case where it is determined that the position is located within the view volume, and to generate a second stimulation which is stronger than the first stimulation by controlling the stimulation unit in a case where it is determined that the position is not located within the view volume.

9. A method comprising:

acquiring positional information of a stimulation generation unit arranged so as to be capable of applying stimulation to a body part of a user;

determining whether a virtual object and the stimulation generation unit contact each other based on position and orientation information of the virtual object and the positional information of the stimulation generation unit;

determining whether or not a position where the virtual object and the stimulation generation unit contact each other is located within a view volume representing a view range of the user in a case where it is determined that the virtual object and the stimulation generation unit contact each other; and

generating a first stimulation by controlling an operation of the stimulation generation unit in a case where it is determined that the position is located within the view volume, and generating a second stimulation which is stronger than the first stimulation by controlling the stimulation generation unit in a case where it is determined that the position is not located within the view volume.

10. A method comprising:

acquiring positional information of a stimulation generation unit arranged so as to be capable of applying stimulation to a body part of a user;

determining whether or not the stimulation generation unit is located within a view volume representing a view range of the user;

according to a result of determination obtained at the determining step, controlling processing for determining whether a position where a virtual object and the stimulation generation unit contact each other is located within the view volume based on position and orientation information of the virtual object and the positional information of the stimulation generation unit; and

generating a first stimulation by controlling an operation of the stimulation generation unit in case where it is determined that the position is located within the view volume, and generating a second stimulation which is stronger than the first stimulation by controlling the stimulation generation unit in a case where it is determined that the position is not located within the view volume.

11. An information-processing apparatus configured to provide a virtual space including a virtual object to a user and to control a stimulation generation unit configured to apply stimulation to a body part of the user indicating contact between the user and the virtual object, the information-processing apparatus comprising:

a contact determination unit configured to determine a state of contact between the virtual object and the user;

an attention determination unit configured to determine whether a position where the virtual object and the user contact each other is located within a view volume representing a view range of the user, using positional information of the virtual object and viewpoint information of a viewpoint of the user; and

a control unit configured to control the stimulation generation unit to generate a first stimulation in a case where it is determined that the position is located within the view volume, and to generate a second stimulation stronger that the first stimulation in a case where it is determined that the position is not within the view volume.

12. A method for controlling an information-processing apparatus configured to provide a virtual space including a virtual object to a user and to control a stimulation generation unit configured to apply stimulation to a body part of the user indicating contact between the user and the virtual object, the method comprising:

determining a state of contact between the virtual object and the user;

determining whether a position where the virtual object and the user contact each other is located within a view volume representing a view range of the user, using positional information of the virtual object and viewpoint information a viewpoint of the user; and

controlling the stimulation generation unit to generate a first stimulation in a case where it is determined that the position is located within the view volume, and to generate a second stimulation stronger that the first stimulation in a case where it is determined that the position is not within the view volume.

13. A computer-readable medium storing a computer program for causing a computer to perform a method comprising:

acquiring positional information of a stimulation generation unit arranged so as to be capable of applying stimulation to a body part of a user;

determining whether a virtual object and the stimulation generation unit contact each other based on position and orientation information of the virtual object and the positional information of the stimulation generation unit;

determining whether a position where the virtual object and the stimulation generation unit contact each other is located within a view volume representing a view range of the user in a case where it is determined that the virtual object and the stimulation generation unit contact each other; and

controlling an operation of the stimulation generation unit to generate a first stimulation in a case where it is determined that the position is located within the view volume, and to generate a second stimulation stronger that the first stimulation in a case where it is determined that the position is not within the view volume.

14. A computer-readable medium storing a computer program for causing a computer to perform a method comprising:

acquiring positional information of a stimulation generation unit arranged so as to be capable of applying stimulation to a body part of a user;

determining whether or not the stimulation generation unit is located within a view volume representing a view range of the user;

according to a result of determination by the determining step, controlling processing for determining whether a position where a virtual object and the stimulation generation unit contact each other is within the view volume based on position and orientation information of the virtual object and the positional information of the stimulation generation unit; and

controlling an operation of the stimulation generation unit to generate a first stimulation in a case where it is determined that the position is located within the view volume, and to generate a second stimulation stronger that the first stimulation in a case where it is determined that the position is not within the view volume.

15. A computer-readable medium storing a computer program for causing a computer to perform a method comprising:

determining a state of contact between a virtual object and body part of a user;

determining whether a position where the virtual object contacts the body part of the user is located within a view volume representing a view range of the user, using positional information of the virtual object and viewpoint information of a viewpoint of the user; and

controlling a stimulation generation unit to generate a first stimulation in a case where it is determined that the position is located within the view volume, and to generate a second stimulation stronger that the first stimulation in a case where it is determined that the position is not located within the view volume.

16. An information-processing apparatus configured to provide a virtual space including a virtual object to a user and to control a stimulation generation unit configured to generate a stimulation to a body part of the user indicating contact between the user and the virtual object, the information-processing apparatus comprising:

a contact determination means for determining a state of contact between the virtual object and the user;

an attention determination means for determining whether a position where the user contacts the virtual object is located within a view volume representing a view range of the user, using positional information of the virtual object and viewpoint information of a viewpoint of the user; and

a control means for controlling the stimulation generation unit to generate a first stimulation in a case where it is determined that the position is located within the view volume, and to generate a second stimulation stronger that the first stimulation in a case where it is determined that the position is not within the view volume.