Dynamic environment and location based augmented reality (AR) systems

• US 9,132,342 B2
• Filed: 03/19/2013
• Issued: 09/15/2015
• Est. Priority Date: 10/31/2012
• Status: Active Grant

• Current Assignee: Sulon Technologies Inc.
• Original Assignee: Sulon Technologies Inc.
• Inventors: Balachandreswaran, Dhanushan, Njenga, Kibaya Mungai
• Primary Examiner(s): MYHR, JUSTIN L
• Application Number:
  US13/847,343
• Publication Number:
  US 20140287806A1
• Time in Patent Office: 910 Days
• Field of Search: 463/1, 463/7, 463 30- 34, 463 40- 42
• US Class Current: 1/1
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/217 using environment-related information, i.e. information generated otherwise than by the player, e.g. ambient temperature or humidity
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/28 responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light controlling the output signals based on the game progress A63F13/50
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/32 using local area network [LAN] connections
• CPC Class Codes: A63F 13/323 between game devices with different hardware characteristics, e.g. hand-held game devices connectable to game consoles or arcade machines
• CPC Class Codes: A63F 13/327 using wireless networks, e.g. Wi-Fi® or piconet
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 13/825 Fostering virtual characters
• CPC Class Codes: A63F 13/837 Shooting of targets
• CPC Class Codes: A63F 2300/8082 : Virtual reality
• CPC Class Codes: G02B 2027/0178 : Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 : characterised by optical features
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A multi dynamic environment and location based active augmented/mixed reality (AR) gaming system having means to utilize its surrounding environment and locations of other systems and devices in conjunction with computer based advanced calculation and graphics to dynamically change the gaming environment to any location and environment of a game play.

Claims

1. A dynamic environment and location based augmented reality (AR) system enabling one or more users to interact in a physical environment and communicate physically and virtually based on augmented reality, said AR system comprising:

a plurality of interactive devices comprising emitters and receivers;

at least one visor, each visor being wearable by one of the users, each visor being in communication with at least a subset of the plurality of interactive devices, each visor comprising;

a range finder scanning system to scan and analyze said physical environment and to develop a map of the physical environment from the perspective of the user;

a local positioning system to identify the location of said user with respect to said physical environment, said user being in the same or different locations as the other of said users, and to identify the location of said emitters and receivers with respect to said physical environment;

a central console in communication with the at least one visor, the central console having a processor configured to;

combine each said map for each said visor and the location of each said users into a computer generated virtual environment;

generate an augmented game play environment by combining portions of said physical environment and said virtual environment;

dynamically collect data from said visors, said data corresponding to;

a dynamic or static map of the physical environment;

locations of all visors, emitters and receivers with respect to the physical environment; and

direction, orientation and speed of all users; and

enable communication between all users and the physical environment in the augmented environment and to dynamically change the game play environment, said AR system providing a substantially real time adaptive game play in changing environments and locations.

2. The system of claim 1, wherein said receiver comprises:

a. a plurality of receiver modules comprising;

i. at least one IR sensor to sense an IR beam emitted from one of said emitters,

ii. at least one IR light source configured to emit a signal when said IR sensors sense said IR beams,

iii. a haptic feedback module configured to provide haptic feedback when said IR sensors sense said IR beams,

iv. at least one biometric sensor to react to physiological changes of the user'"'"'s body, and

v. a microprocessor to process data collected by said receiver modules;

b. a wireless positioning system to enable a corresponding one of said visors to locate said receiver;

c. means to determine direction, orientation and speed of the receiver;

d. a battery management and supply unit to provide power to the receiver; and

e. an IR transceiver to operate when said receiver acts as said emitter.

3. The system of claim 1, wherein said processor of said central console is further configured to identify all users that are in the same physical environment, and to combine the map, location, and speed of each of said users'"'"' corresponding visors and interactive devices, to locate all users in the same augmented environment for said game play.

4. The system of claim 1, wherein said processor of said central console is further configured to superpose graphics, sounds, and haptic feedback to the augmented environment.

5. The system of claim 1, said processor of said central console is configured to adaptively and dynamically learn the physical environment.

6. The system of claim 1, wherein said scanning system comprises means to scan and generate a 2D or 3D virtual environment.

7. The system of claim 1, wherein said central console processes data from said scanning system, creates logical arrangement for said local positioning system, recognizes and produces said game play environment, manages said interactive devices, performs a wide variety of central play calculations, algorithms, game management and generates said augmented environment of said physical environment, whereby said users interact through said central console even if said users are at different locations and having different physical environment, and wherein said individual maps from each user being combined to make a central game environment.

8. The system of claim 1, wherein said game play environment further comprises walls, rooms, doors, trees, hallways, or other physical media in 2D or 3D, obstacles, characters added into the augmented environment, and means to create fog to limit the view of the user to a certain distance.

9. The system of claim 1, wherein said central console comprises means to receive and manage the global position of each user, and solve time, positioning and mapping conflicts that occur between said users and interactive devices.

10. The system of claim 1, wherein said AR system comprises biometric sensors to measure human vitals to be used as inputs for gameplay, whereby said human vitals are used to alter the emitter to mimic a real life situation.

11. The system of claim 1, wherein said game play environment is a laser tag game, said emitters are virtual laser guns, and said receivers are vests worn by the users said emitters and receivers each having a unique ID.

12. The system of claim 11, wherein upon a first of said users virtually firing one of said virtual laser guns at one of said vests worn by a second of said users:

said vest emits its unique ID;

said visor for said first of said users obtains said unique ID of said vest;

said visor projects virtual damage to the vest visible to said first of said users.

13. The system of claim 12, wherein said virtual damage comprises blood, gore, explosions, smoke or other forms of special effects.

14. The system of claim 10, wherein said human vitals comprises a user'"'"'s heart rate and wherein the visor causes at least one of said emitters to vibrate upon sensing an increase in said heart rate.