Interactive virtual reality systems and methods

• US 9,684,369 B2
• Filed: 04/08/2014
• Issued: 06/20/2017
• Est. Priority Date: 04/08/2014
• Status: Active Grant

• Current Assignee: EON Reality, Inc.
• Original Assignee: EON Reality, Inc.
• Inventors: Huang, Yazhou, Li, Erbo, Kjallstrom, Jan, Johansson, Mats
• Primary Examiner(s): Sasinowski, Andrew
• Assistant Examiner(s): WOO, KUO-KONG
• Application Number:
  US14/247,970
• Publication Number:
  US 20150286275A1
• Time in Patent Office: 1,169 Days
• Field of Search: 345156, 434 21, 715752
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/27 characterised by a large display in a public venue, e.g. in a movie theatre, stadium or game arena
• CPC Class Codes: A63F 13/843 involving concurrently two or more players on the same game device, e.g. requiring the use of a plurality of controllers or of a specific view of game data for each player
• CPC Class Codes: A63F 13/847 Cooperative playing, e.g. requiring coordinated actions from several players to achieve a common goal
• CPC Class Codes: F41G 3/2627 Cooperating with a motion picture projector
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials

Abstract

An immersive virtual reality system for larger, theater-sized audiences is disclosed. The system enables multiple users to collaborate or work together as a group, or enable groups to compete. Users interact with the virtual reality system through the manipulation of handheld interactive devices. Each device has multiple lights forming a pattern. Tracking sensors monitor the handheld devices, and the system interprets the motions of the users and dynamically changes the virtual reality environment based on the motions of the users. The system may assign unique roles for users within a group.

Claims

1. A method for providing an immersive virtual reality environment for a plurality of users, the method comprising:

generating a virtual reality environment including a display screen having at least one virtual object and a virtual control console displayed on the display screen, the virtual control console having a plurality of display icons, each display icon in the virtual console representing a different function associated with the virtual object;

providing a handheld interactive devices to each of the users, each handheld interactive device having a plurality of lights emitting a unique light pattern providing identification and tracking information of said each handheld interactive device, said each handheld interactive device having a trigger mechanism configured for communicating an occurrence of a trigger event;

assigning a unique role to said each handheld interactive devices for users forming a single group of users, each role having an associated function for manipulating the virtual object in the virtual reality environment, each role for said each handheld interactive device being identified by a tracking system based on the unique light pattern emitted for said each handheld interactive device;

tracking the plurality of lights of said each interactive device by the tracking system to determine a current status of said each handheld interactive device, the current status comprising a position, orientation, motion, existence of the triggering event, and the identification of said each handheld interactive device;

interpreting the current status of said each handheld interactive device based on the role assigned to said each handheld interactive device;

varying the function associated with the role to manipulate the virtual object based on the interpretation of the current status; and

,

dynamically displaying the manipulated virtual object in the virtual reality environment.

2. The method for providing an immersive virtual reality environment for a plurality of users of claim 1, wherein assigning a unique role to each of the handheld interactive devices further comprises:

enabling all handheld interactive devices to have a role of firing virtual projectiles;

displaying one or more targets in the virtual reality environment;

monitoring the performance of the handheld interactive devices; and

,

assigning roles based on the relative performance of the handheld interactive devices.

3. The method for providing an immersive virtual reality environment for a plurality of users of claim 1, further comprising providing feedback to the users.

4. The method for providing an immersive virtual reality environment for a plurality of users of claim 3, wherein providing feedback to the users comprises one or more of the following:

providing sound effects, enabling motion seats, providing visual effects, or providing visual representation of aiming sights.

5. The method for providing an immersive virtual reality environment for a plurality of users of claim 1, wherein one of the roles includes a leader role, the leader role having a function of firing a virtual projectile within the virtual reality environment.

6. The method for providing an immersive virtual reality environment for a plurality of users of claim 5, wherein interpreting the status of the handheld interactive device having the leader role further comprises:

detecting the existence of the trigger event from the handheld interactive device having the leader role;

determining a trajectory of the virtual projectile based on the position and orientation of the handheld interactive device having the leader role; and

,

determining if the trajectory of the virtual projectile affected one or more virtual objects.

7. The method for providing an immersive virtual reality environment for a plurality of users of claim 1, wherein the roles include a leader role for firing virtual projectiles, a steering role for maneuvering a virtual object, a speed control role for controlling the speed of the virtual object, and a weapon aiming role for aiming the handheld interactive device to a virtual object.

8. A method for providing an immersive virtual reality environment for a plurality of users, the method comprising:

forming a first group of users and a second group of users from a plurality of users;

providing a handheld interactive device to each of the users, each handheld interactive device having a plurality of lights emitting a unique light pattern providing identification and tracking information of said each handheld interactive device, said each handheld interactive device having a trigger mechanism configured for communicating an occurrence of a trigger event;

generating a virtual reality environment including a display screen having at least one virtual object and a first and second virtual control console displayed on the display screen, wherein the first virtual control console is interacted with by the first group of users and the second virtual control console is interacted with by the second group of users, each virtual control console having a plurality of display icons each representing different functions associated with the virtual object accessible through respective first and second virtual control consoles;

assigning a unique role to said each handheld interactive device for users within the first and the second groups of users, each role comprising an associated function for manipulating virtual objects in a virtual environment;

tracking the plurality of lights of said each handheld interactive device to determine a current status of said each handheld interactive device, the current status comprising a position, orientation, motion, existence of the triggering event, and the identification of said each handheld interactive device;

interpreting the current status of said each handheld interactive device based on the role assigned to said each handheld interactive device and the associated group;

manipulating the functions associated with the virtual object to provide an altered virtual object; and

,

dynamically displaying the altered virtual object.

9. The method for providing an immersive virtual reality environment for a plurality of users of claim 8, wherein generating a virtual reality environment further comprises providing a single screen having virtual objects representing the first and second groups.

10. The method for providing an immersive virtual reality environment for a plurality of users of claim 8, wherein generating a virtual reality environment further comprises providing a separate screen section for the first and second groups.

11. The method for providing an immersive virtual reality environment for a plurality of users of claim 8 further comprising forming additional groups of users.

12. The method for providing an immersive virtual reality environment for a plurality of users of claim 8, further comprising providing feedback to the users.

13. The method for providing an immersive virtual reality environment for a plurality of users of claim 8, wherein providing feedback to the users comprises one or more of the following:

providing sound effects, enabling motion seats, providing visual effects, or providing visual representation of aiming sights.

14. The method for providing an immersive virtual reality environment for a plurality of users of claim 8, wherein assigning a unique role to each of the handheld interactive devices further comprises:

for the first and second groups;

enabling all handheld interactive devices to have a role of firing virtual projectiles;

displaying one or more targets in the virtual reality environment;

monitoring the performance of the handheld interactive devices; and

,

assigning roles based on the relative performance of the handheld interactive devices.

15. The method for providing an immersive virtual reality environment for a plurality of users of claim 8, wherein one of the roles includes a leader role, the leader role having a function of firing a virtual projectile within the virtual reality environment.

16. The method for providing an immersive virtual reality environment for a plurality of users of claim 15, wherein interpreting the status of the handheld interactive device having the leader role further comprises:

detecting the existence of the trigger event from the handheld interactive device having the leader role;

determining a trajectory of the virtual projectile based on the position and orientation of the handheld interactive device having the leader role; and

,

determining if the trajectory of the virtual projectile affected one or more virtual objects.

17. The method for providing an immersive virtual reality environment for a plurality of users of claim 8, wherein the roles include a leader role for firing virtual projectiles, a steering role for maneuvering a virtual object, a speed control role for controlling the speed of the virtual object, and a weapon aiming role for aiming the handheld interactive device to a virtual object.

18. A system for providing an immersive virtual reality environment for a plurality of groups of users, the system comprising:

a virtual reality environment including a display screen for groups of users and a virtual control console displayed on the display screen, the virtual control console displaying a user controlled output associated with a virtual object displayed in the virtual environment and manipulated by user control;

a plurality of handheld interactive devices for interacting with the virtual object, each handheld interactive device comprising;

a housing having a barrel section and a handle section;

a plurality of lights positioned within the barrel section, the lights spaced apart and emitting a unique light emission pattern, the plurality of lights generally aligned with an expected trajectory of a virtual projectile, the unique light emission pattern being different between any two handheld interactive devices;

a trigger mechanism positioned on the handle section; and

,

a handheld interactive device controller coupled to the trigger mechanism and configured to;

provide electrical current to the lights,

control the lights to emit the unique light emission pattern, and

communicate trigger events to a system controller;

a plurality of sensors monitoring the handheld interactive devices for light signals and trigger events, the plurality of sensors outputting real-time device current status for each of the handheld interactive devices; and

,

a system controller receiving the real-time current status for each of the handheld interactive devices and updating the virtual reality environment.

19. The system for providing immersive virtual reality environment for a plurality of groups of users of claim 18, wherein the virtual reality environment further comprises a spherical screen.

20. The system for providing immersive virtual reality environment for a plurality of groups of users of claim 18, wherein the virtual reality environment further comprises a dome.

21. The system for providing immersive virtual reality environment for a plurality of groups of users of claim 18, wherein the virtual reality environment further comprises:

a spherical screen for displaying three dimensional images;

multiple motion seats for a plurality of users; and

a surround sound system for providing sound effects to the users.