Virtual reality game method and apparatus

• US 5,423,554 A
• Filed: 09/24/1993
• Issued: 06/13/1995
• Est. Priority Date: 09/24/1993
• Status: Expired due to Term

• Current Assignee: Dowtrone Press Kg, LLC
• Original Assignee: Metamedia Ventures, Inc.
• Inventors: Davis, Geoffrey M.
• Primary Examiner(s): HARRISON, JESSICA
• Application Number:
  US08/126,384
• Time in Patent Office: 627 Days
• Field of Search: 273/433, 273/434, 273/435, 273/436, 273/437, 273/438, 273/439, 273/85 G, 273/460, 273/DIG. 28, 434/323, 434/335, 364/410, 364/516, 364/526, 395/100, 395/118, 395/152, 358/105, 345/1, 345/4, 345/6, 345/7, 345/8, 345/10, 345/11, 345/22, 345/113, 345/114, 345/115, 345/122, 345/153
• US Class Current: 463/4
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/8011 Ball
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A one or two player virtual reality game efficiently detects and tracks a distinctively colored glove. According to the preferred basketball embodiment, a single player equipped with the distinctively colored glove is matched up against a virtual opponent. The object of the game is for the real player to put a virtual basketball into a virtual basketball hoop before his/her virtual opponent steals the ball. Initially, the background site is scanned, and then the operator with the glove is scanned. A table of colors is then established which are unique only to the glove. A player is then scanned against the background to identify which color glove will have the least conflict with colors worn by the player. During play, the player is scanned at 30 frames a second and the information is stored in a frame buffer. A prediction is made of the location of the glove in subsequent frames based upon its previously known location and velocity. Therefore, a search for the glove can be made of only a limited portion of the full frame, thereby increasing the speed of acquisition. Gestures made by the player such as a flick shot, a dribble or a roundhouse shot can be distinguished so as to automatically cause the basketball to be released from the player'"'"'s hand. If the velocity and direction of the ball are substantially in the direction of the virtual basketball hoop, then the player will be credited with a score.

Claims

1. A virtual reality game method for use by at least one human player who wears at least one identifiable object having a unique color, said game comprising the steps of:

(a) scanning a background and creating a first color table of background colors;

(b) scanning said identifiable object;

(c) creating a second color table with colors distinctive only to said identifiable object by deleting all colors that said identifiable object has in common with said background;

(d) repeatedly scanning said player wearing said identifiable object against said background and creating frames of pixels in a frame buffer representative of said colors in said scan;

(e) identifying said colors in said frames that are unique to said identifiable objects;

(f) predicting an area, less than a full frame, where said identifiable object will be located in subsequent frames;

(g) scanning said predicted area to locate said identifiable object; and

,

(h) using said identifiable object to manipulate a virtual object toward a virtual goal.

2. The method of claim 1 further comprising the step of:

(i) locating the centroid of said identifiable object in order to establish specific x and y coordinates for said identifiable object.

3. The method of claim 2 further comprising the steps of:

(j) attaching said virtual object to said identifiable object in a display;

(k) detecting the movement of said identifiable object to distinguish between at least two different gestures involving said identifiable object; and

,

(l) propelling said virtual object toward said goal in response to the recognition of one of said at least two gestures made by said identifiable object.

4. The method of claim 3 wherein said identifiable object comprises a glove and said virtual object comprises a ball and wherein said method further comprises the step of:

(m) determining the direction and velocity of said gesture detected in step (k) and crediting the player with a score if said direction and velocity are substantially in the direction of said goal.

5. The method of claim 4 further comprising the steps of:

(n) determining the height of said player by detecting when a scan of said player against said background first comes into contact with a non-background object; and

,

(o) automatically scaling the height of a virtual opponent in proportion to the height of said player.

6. The method of claim 5 further comprising the step of:

(p) performing a coarse-to-fine search by searching only a limited number of lines of said predicted area from step (g) first, and then increasing the number of lines searched until said glove is located.

7. The method of claim 6 further comprising the step of:

(q) increasing the size of said predicted search area to a larger search area if said glove is not located.

8. The method of claim 7 further comprising the step of:

(r) searching the entire frame stored in said frame buffer, beginning with the center thereof, if said glove is not located in said predicted search area determined by step (g) or in said larger search area as determined in step (q).

9. The method of claim 8 further comprising the step of:

(s) increasing the population of identifiable object color specific pixels by merging a first table of possible colors with a second master table of glove colors and then increasing the merged table of glove colors by filling in the voids surrounded by glove colors and by allowing neighboring colors on the edges of said glove colors in the merged table to take on glove specific color values.

10. The method of claim. 9 further comprising the step of:

(t) organizing pixels in said color tables by chroma X, chroma Y and luma, wherein each pixel is formatted initially by two bits of chroma X, followed by two bits of chroma Y, and followed by six bits of luma,

wherein said color values in said color tables are first compared using said above information as a means of rapid comparison of said values.

11. The method of claim 10 further comprising the step of:

(u) determining the width of said player so that said player'"'"'s location can interact with a background.

12. The method of claim 10 further comprising the step of:

(v) determining the outline of said player so that said player can interact with a background.

13. The method of claim 3 wherein said game includes two players each wearing different identifiable object gloves, and wherein said two players play against each other to put said virtual object in said virtual goal.

14. The method of claim 3 wherein predetermined gestures made by said identifiable object cause the image of said player to move with respect to said display,

wherein the movement of said player causes the player to appear as though the player was in an environment having gravity substantially smaller than that of the earth.

15. A virtual reality game apparatus for use by at least one player having on his person an identifiable object having a distinctive color, said apparatus comprising:

scanning means for scanning said player and for storing said information in a frame buffer;

color identifying means for determining which of said colors of said identifiable object is most accurately identifiable and, for locating said identifiable object from the information in said frame buffer based upon its distinctive color when said player is wearing said identifiable object; and

,

display means for displaying said player and said identifiable object having said most accurately identifiable color in a virtual reality setting,

wherein said player is correctly positioned within said virtual reality setting based upon the location of said identifiable object with said most accurately identifiable color.