Platform for immersive gaming

• US 20070132785A1
• Filed: 01/30/2007
• Published: 06/14/2007
• Est. Priority Date: 03/29/2005
• Status: Abandoned Application

• Current Assignee: MetaMersion, LLC
• Original Assignee: MetaMersion, LLC
• Inventors: Ebersole, John, Hobgood, Andrew
• Application Number:
  US11/699,845
• Publication Number:
  US 20070132785A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/53 involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
• CPC Class Codes: A63F 13/837 Shooting of targets
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1031 using a wireless connection, e.g. Bluetooth, infrared connections
• CPC Class Codes: A63F 2300/1062 being specially adapted to a type of game, e.g. steering wheel
• CPC Class Codes: A63F 2300/1081 Input via voice recognition
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/205 for detecting the geographical location of the game platform
• CPC Class Codes: A63F 2300/303 for displaying additional data, e.g. simulating a Head Up Display
• CPC Class Codes: A63F 2300/5573 player location
• CPC Class Codes: A63F 2300/8076 Shooting
• CPC Class Codes: G06F 3/011 : Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 : Head tracking input arrangements

Abstract

An instrumented game controller (such as a firearm simulator), head-mounted display system, with electronic equipment with positional tracking equipment, together with associated software, to create unprecedented immersive virtual reality or augmented reality games, entertainment or “serious” gaming such as training,

Claims

1. A platform for immersive video gaming instrumented with electronic and passive equipment so that an instrumented hand-held controller can be used to play a computer-generated video simulation or game in which the location and orientation of the hand-held controller and the user'"'"'s head is tracked by a tracking system, comprising:

an instrumented hand-held controller to be carried by a user;

tracking equipment coupled to the hand-held controller for use in the tracking system, so that both the location and orientation of the hand-held controller can be determined by the tracking system;

a head mounted display (HMD) to be worn by the user;

tracking equipment coupled to the HMD for use in the tracking system, so that both the location and orientation of the HMD can be determined by the tracking system;

a computer generated video simulation that accurately uses the position and orientation information of the hand-held controller and HMD to provide interactions in the computer generated video simulation or game; and

a video output provided to the user'"'"'s HMD showing the result of the computer generated video simulation.

2. The platform of claim 1 where the hand-held controller is modeled to be a gun that the user can use and move in a natural manner.

3. The platform of claim 1 where the computer generated video simulation is a military style simulation or game in the style of a first person shooter type of game

4. The platform of claim 1 further comprising a wireless backpack system carrying electronic equipment and worn by the user, allowing the user to use the platform wirelessly.

5. The platform of claim 1 where the computer generated video simulation is based on an existing 3D software program that provides content, and then special software modifications are made to adapt the 3D software program to use the hand-held controller and HMD interface.

6. The platform of claim 1 where an augmented reality version of the platform is accomplished by using a camera to capture a view of the real world, and then a computer modifies that captured view of the real world by adding computer generated virtual elements to the scene that the user can see and interact with.

7. The platform of claim 1 where an augmented reality version of the platform is accomplished by using a see-through HMD, and a computer generates virtual elements that are overlaid onto the view of the real world by the HMD.

8. A method for immersive video gaming instrumented using electronic and passive equipment so that an instrumented hand-held controller can be used to play a computer-generated video simulation or game in which the location and orientation of the hand-held controller and the user'"'"'s head is tracked by a tracking system, comprising:

providing an instrumented hand-held controller to be carried by a user;

providing tracking equipment coupled to the hand-held controller for use in the tracking system, so that both the location and orientation of the hand-held controller can be determined by the tracking system;

providing a head mounted display (HMD) to be worn by the user;

providing tracking equipment coupled to the HMD for use in the tracking system, so that both the location and orientation of the HMD can be determined by the tracking system;

providing a computer generated video simulation that accurately uses the position and orientation information of the hand-held controller and HMD to provide interactions in the computer generated video simulation or game; and

providing a video output to the user'"'"'s HMD showing the result of the computer generated video simulation.

9. The method of claim 8 where the hand-held controller is modeled to be a gun that the user can use and move in a natural manner.

10. The method of claim 8 where the computer generated video simulation is a military style simulation or game in the style of a first person shooter type of game

11. The method of claim 8 further comprising a wireless backpack system carrying electronic equipment and worn by the user, allowing the user to use the platform wirelessly.

12. The method of claim 8 where the computer generated video simulation is based on an existing 3D software program that provides content, and then special software modifications are made to adapt the 3D software program to use the hand-held controller and HMD interface.

13. The method of claim 8 where an augmented reality version of the platform is accomplished by using a camera to capture a view of the real world, and then a computer modifies that captured view of the real world by adding computer generated virtual elements to the scene that the user can see and interact with.

14. The method of claim 8 where an augmented reality version of the platform is accomplished by using a see-through HMD, and a computer generates virtual elements that are overlaid onto the view of the real world by the HMD