Virtual reality exercise machine and computer controlled video system

• US 5,577,981 A
• Filed: 08/04/1995
• Issued: 11/26/1996
• Est. Priority Date: 01/19/1994
• Status: Expired due to Term

• Current Assignee: M.D. Robert Jarvik
• Original Assignee: M.D. Robert Jarvik
• Inventors: Jarvik, Robert
• Primary Examiner(s): CHENG, JOE H
• Application Number:
  US08/513,671
• Time in Patent Office: 480 Days
• Field of Search: 482/1-9, 482/52, 482/54, 482/55, 482/57, 482/71, 482/72, 482/900-903, 434/267, 73/379.01, 395/152-154, 345/106, 345/156, 364/410, 273/438
• US Class Current: 482/4
• CPC Class Codes: A63B 2071/0641 with a marker advancing in function of the exercise
• CPC Class Codes: A63B 2071/0644 with display speed of moving landscape controlled by the user's performance
• CPC Class Codes: A63B 2071/0666 worn on the head or face, e.g. combined with goggles or glasses
• CPC Class Codes: A63B 21/154 using special pulley-assemblies
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 24/00 Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
• CPC Class Codes: A63B 71/0622 Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: G06F 2203/012 Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: Y10S 482/902 Employing specific graphic or video display

Abstract

This invention relates to computer controlled exercise machines and provides the user with a wide variety of interactive exercise options controlled by software. A virtual reality hybrid of virtual and real environments is provided which permits the user to perform significant physical exertion by applying forces to the machine while viewing images on a head mounted display. The invention permits the user to view his own hands and body superimposed over a computer generated image of objects that are not actually present while maintaining parts of the exercise machine that the user physically contacts, such as a handle, superimposed over the computer generated image. As the user exerts forces against the machine (such as the handle) he perceives that he is exerting forces against the objects the images represent. The invention includes a video camera and computer adapted to record images from the real world which may be combined with computer generated images while retaining the proper spacial orientation to produce a composite virtual reality environment. Virtual reality exercise regimens adapted to the user'"'"'s individual capabilities, virtual reality exercise games, virtual reality competitive sports, and virtual reality team sports are disclosed.

Claims

1. An interactive computer controlled exercise system adapted to apply multiple forces with motion to the body of the user corresponding with the computer generated visual images of an environment presented on a display, said system comprising:

a movable powered structure means having movable components connected to a fixed support frame means adapted to apply forces to the body of the user in conjunction with forces applied by the user to the movable components of said movable powered structure means, so as to provide health benefit to the user during exercise with said movable components of said movable powered structure means;

means for sensing the force and position of said movable components of said movable powered structure means and forces applied thereto by the user and to provide the sensed signals to a computer means;

means for detecting and measuring the position and orientation of the user'"'"'s head and to provide the detected signals to said computer means;

powered actuator means for altering the three dimensional configuration and motion of said movable powered structure means and for applying forces of variable magnitude and direction to the body of the user in conjunction with corresponding forces applied by the user to said movable components of said movable powered structure means;

visual display means for presenting virtual images superimposed over the position of said movable powered structure means in real time maintained in visual perspective from the vantage point of the user when the user moves, said virtual images comprise a pictorial representation of a virtual environment with virtual objects oriented and movable relative to the user such that if real objects existed in place of said virtual environment, contract between said virtual objects and the user would apply forces to the user'"'"'s body similar to the forces applied to the user'"'"'s body by said movable components of said movable powered structure means; and

said computer means, responsive to the sensed signals from said sensing means and the detected signals from said detecting means, for calculating said three dimensional configuration and motion of said movable powered structure means and forces applied thereto by the user and the position of the user'"'"'s head in relation to said fixed support frame means, thereby to control said powered actuator means and said visual display means.

2. The exercise system of claim 1, wherein said computer means comprises memory means and program means, said program means adapted to:

store data for defining said virtual objects in said memory and present said virtual images of said virtual objects on said visual display means;

receive said sensed signals from said sensing means and said detected signals from said detecting means, and compute said three dimensional configuration and motion of said movable powered structure means, the direction and magnitude of forces applied thereto by the user, and the position and orientation of said user'"'"'s head relative to said fixed support frame;

control the motion of said movable powered structure means via said powered actuator means; and

present a virtual image of said virtual objects on said visual display means as seen from said user'"'"'s vantage point superimposed over the position of said movable components of said movable powered structure means, so as to create the realistic illusion that said user is moving said virtual objects when said user applies force to said movable components of said movable powered structure means during exercise.

3. The exercise system of claim 2 further comprises head-mounted video camera means adapted to photograph the hands and body of said user and some movable components of said movable powered structure means which said user may contract;

and said computer means adapted to superimpose the image of said user from said video camera on said virtual images of said virtual environment while at least one of said movable components of the movable powered structure means is moved by said powered actuator means.

4. The exercise system of claim 1, wherein said visual display means comprises a head-mounted partially transparent viewing screen.

5. The exercise system of claim 4 further comprises light source means by which the user'"'"'s arms and hands are preferentially illuminated so as to be more clearly visible than non-illuminated parts of the exercise system that lie within the user'"'"'s visual field.

6. The exercise system of claim 1 further comprises wide-angle video camera means having at least one camera adapted to record an image encompassing a high proportion of the field of view surrounding said camera in all direction;

and sensor and control signal recording means for measuring and recording reference information simultaneously with the recording of the image;

wherein said computer means superimposes said recorded video images from said wide-angle video camera means with said virtual images of said virtual environment presented on said visual display means.