Virtual body control device

• US 6,285,379 B1
• Filed: 12/04/1996
• Issued: 09/04/2001
• Est. Priority Date: 12/07/1995
• Status: Expired due to Term

• Current Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Original Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Inventors: Gallery, Richard D.
• Primary Examiner(s): Vo, Cliff N.
• Application Number:
  US08/764,701
• Time in Patent Office: 1,735 Days
• Field of Search: 345/473, 345/419, 345/433, 345/474
• US Class Current: 345/473
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user

Abstract

A virtual body modelling apparatus and method models a users body in a virtual environment and animated to follow physical movements of the user. Stores (30,32) hold data defining the virtual environment as well as features of the virtual body representation, including sequences of virtual body motions (for example a walking sequence for the legs of the virtual body) which sequences are initiated in response to one or more predetermined physical movements by the user, and animated by a display generator (28) providing images of the virtual environment to the user. Various forms of feedback to the user are provided, including force feedback where the users physical movements are constrained in dependence on conditions within the virtual environment, visual feedback where the users viewpoint of the virtual world is modified as a sequence of body motions is executed, and audio feedback (62) such as the sound of footsteps triggered at predetermined points in the sequence of motions.

Claims

1. Virtual body modeling apparatus operable to generate and animate under user direction a representation of a body in a virtual environment, said apparatus comprising:

a first data store, holding data defining the virtual environment;

a second data store, holding data related to features of a virtual body representation;

user motion detector to detect user body motion; and

a processor arranged to generate a representation of the virtual environment based on data from the first data store, to generate the virtual body representation within the virtual environment based on data from the second data store, and to periodically modify the generated virtual body representation in response to the detected user body motion,

said second data store holding sequence data defining at least one sequence of virtual body motions; and

said processor being arranged to call said sequence data and translate the detected user body motion using said sequence data, wherein the generated virtual body representation is modified to follow the detected user body motion.

2. Apparatus as claimed in claim 1, further comprising means operable to generate feedback to the user, said feedback being generated in relation to a sequence of virtual body motions, and at one or more predetermined points in the sequence.

3. Apparatus as claimed in claim 2, further comprising force feedback means arranged to provide controllably variable resistance to movement of the users physical body.

4. Apparatus as claimed in claim 2, including audio signal generation means, wherein the feedback is an audio sequence generated at a predetermined point or points during the sequence of virtual body motions.

5. Apparatus as claimed in claim 1, wherein the user is presented with the image of the virtual environment from a first viewpoint, said generated representation of the virtual environment being modified to change the viewpoint in synchronism with the following of the sequence of virtual body motions.

6. Apparatus as claimed in claim 1, wherein the motion detector comprising a restraint coupled to a rotatable shaft and attachable to a users limb, wherein movement of the restraint by the user produces rotation of the shaft and the detection of the user motion is derived from the angular deflection of the shaft.

7. Apparatus as claimed in claim 6, further comprising force feedback operable to generate a torque opposing rotation of the shaft.

8. Apparatus as claimed in claim 1, wherein:

the second data store holds data defining a plurality of sequences of virtual body motions in respective areas of a look-up table;

the processor is configured to derive a speed value from the input from the user motion detector;

said speed value is used to index the look-up table, wherein the speed of the virtual body motion follows the derived speed value.

9. A method for user-directed animation of a computer-generated representation of a body in a virtual environment, comprising the steps of:

determining an initial position for the virtual body within the environment, rendering an image of the body within the environment, and presenting the image to a user;

monitoring movement of the user in a physical environment and translating said movement into movement of the virtual body relative to the virtual environment; and

periodically updating the rendered and presented image,

at least one pre-stored sequence of virtual body motions being provided, and

the generated body representation being modified using the pre-stored sequence of virtual body motions wherein motion of a particular user body portion results in motion of a corresponding virtual body portion.

10. A method as claimed in claim 9, wherein a rate of movement of the generated virtual body representation is determined by a filtered value for a determined speed of user movement.

11. A virtual body modeling apparatus for generating and animating in response to user movement a representation of a body in a virtual environment, said apparatus comprising:

a first data store configured to hold data defining the virtual environment;

a second data store configured to hold sequence data defining at least one sequence of virtual body motions;

a user motion detector configured to detect user body motion corresponding to movement of a particular user body portion; and

a processor configured to generate a representation of the virtual environment based on data from the first data store, to generate the virtual body representation within the virtual environment based on data from the second data store, and to call said sequence data and translate the detected user body motion using said sequence data, wherein the movement of the particular user body portion produces movement of a corresponding body portion of the generated virtual body representation.

12. The apparatus of claim 11, wherein said motion detector is configured to detect the speed of user body motion and said processor is configured to translate the detected speed of user body motion into a corresponding speed of motion of the corresponding body portion of the generated virtual body representation.

13. The apparatus of claim 12, wherein the second data store is configured as a look-up table to hold a plurality of sequences of virtual body motions that correspond to a plurality of speeds of motion of virtual body portions, and wherein said processor is configured to use the detected speed of the user body portion as an index for retrieving a particular one of the plurality of sequences of virtual body motions.

14. The apparatus of claim 11, further comprising a force feedback generator configured to provide force feedback to the user in response to the generated virtual environment.

15. The apparatus of claim 14, wherein the motion detector comprises the force feedback generator.

16. The apparatus of claim 15, wherein:

the motion detector comprises a restraint coupled to a rotatable shaft, attachable to the user'"'"'s body portion, and configured to translate movement of the restraint by the user into rotation of the shaft;

the processor is configured to detect the user body motion by detecting the degree of rotation of the shaft; and

the force feedback generator configured to generate a torque opposing rotation of the shaft.

17. The apparatus of claim 11, wherein:

the motion detector comprises a restraint coupled to a rotatable shaft, attachable to the user'"'"'s body portion, and configured to translate movement of the restraint by the user into rotation of the shaft; and

the processor is configured to detect the user body motion by detecting the degree of rotation of the shaft.