PERSONAL A/V SYSTEM WITH CONTEXT RELEVANT INFORMATION

• US 20130083062A1
• Filed: 03/27/2012
• Published: 04/04/2013
• Est. Priority Date: 09/30/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Geisner, Kevin A., Latta, Stephen G., Sugden, Ben J., Vaught, Benjamin I., Kipman, Alex Aben-Athar, Perez, Kathryn Stone, Hastings, Ryan L., Bennett, Darren, McCulloch, Daniel J., Clavin, John, Scott, Jason
• Granted Patent: US 9,285,871 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2380/00 Specific applications
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays

Abstract

A system for generating an augmented reality environment in association with one or more attractions or exhibits is described. In some cases, a see-through head-mounted display device (HMD) may acquire one or more virtual objects from a supplemental information provider associated with a particular attraction. The one or more virtual objects may be based on whether an end user of the HMD is waiting in line for the particular attraction or is on (or in) the particular attraction. The supplemental information provider may vary the one or more virtual objects based on the end user'"'"'s previous experiences with the particular attraction. The HMD may adapt the one or more virtual objects based on physiological feedback from the end user (e.g., if a child is scared). The supplemental information provider may also provide and automatically update a task list associated with the particular attraction.

Claims

1. A method for generating an augmented reality environment using a mobile device, comprising:

detecting a user of the mobile device within a particular waiting area of an attraction;

acquiring virtual object information associated with the attraction, the virtual object information includes one or more virtual objects; and

generating and displaying on the mobile device one or more images associated with the one or more virtual objects, the one or more images are displayed such that the one or more virtual objects are perceived to exist within the particular waiting area;

detecting the user exiting the particular waiting area; and

disabling the one or more virtual objects in response to the detecting the user exiting the particular waiting area.

2. The method of claim 1, further comprising:

identifying an age associated with the user, the acquiring virtual object information includes acquiring virtual object information associated with the attraction based on the age of the user.

3. The method of claim 2, further comprising:

acquiring an attraction placement test, the attraction placement test includes one or more other virtual objects; and

generating and displaying the one or more other virtual objects while the user is within the particular waiting area.

4. The method of claim 2, further comprising:

determining whether an overseeing mobile device is required based on the age of the user.

5. The method of claim 4, wherein:

the overseeing mobile device sets a maximum level of scariness for the mobile device, the maximum level of scariness determines when the one or more virtual objects are replaced with one or more different virtual objects different from the one or more virtual objects, the one or more different virtual objects are less scary than the one or more virtual objects.

6. The method of claim 4, wherein:

the overseeing mobile device sets an upper limit for the number of virtual objects displayed on the mobile device.

7. The method of claim 1, wherein:

the disabling of the one or more virtual objects prevents the one or more virtual objects from being displayed on the mobile device.

8. The method of claim 1, wherein:

the mobile device comprises an HMD; and

the attraction comprises a ride at an amusement park.

9. One or more storage devices containing processor readable code for programming one or more processors to perform a method for generating an augmented reality environment using a mobile device comprising the steps of:

identifying a supplemental information provider;

establishing a connection with the supplemental information provider;

determining that the mobile device is associated with a user waiting in line for a particular attraction;

acquiring one or more virtual objects from the supplemental information provider in response to the determining that the mobile device is associated with a user waiting in line for a particular attraction, the one or more virtual objects are associated with the particular attraction; and

displaying on the mobile device one or more images associated with the one or more virtual objects, the one or more images are displayed such that the one or more virtual objects are perceived to exist within a real-world environment by the user.

10. The one or more storage devices of claim 9, further comprising:

automatically detecting that the user is at the front of a line associated with the particular attraction; and

disabling the one or more virtual objects in response to detecting that the user is at the front of the line.

11. The one or more storage devices of claim 10, wherein:

the disabling the one or more virtual objects prevents the one or more virtual objects from being displayed on the mobile device.

12. The one or more storage devices of claim 10, wherein:

the determining that the mobile device is associated with a user waiting in line for a particular attraction includes verifying that the connection has persisted for at least a predefined amount of time.

13. The one or more storage devices of claim 10, wherein:

the mobile device comprises an HMD.

14. The one or more storage devices of claim 10, wherein:

the particular attraction comprises a ride at an amusement park.

15. An electronic device for generating an augmented reality environment, comprising:

one or more processors, the one or more processors detect a user of the electronic device within a particular waiting area of an attraction, the one or more processors identify an age associated with the user, the one or more processors acquire virtual object information associated with the attraction based on the age of the user, the virtual object information includes one or more virtual objects associated with the attraction, the one or more processors acquire an attraction placement test including one or more other virtual objects, the one or more processors generate one or more images associated with the one or more virtual objects and the one or more other virtual objects while the user is within the particular waiting area; and

a see-through display, the see-through display displays one or more images such that the one or more virtual objects and the one or more other virtual objects are perceived to exist within the particular waiting area by the user.

16. The electronic device of claim 15, wherein:

the one or more processors detect the user exiting the particular waiting area and disable the one or more virtual objects in response to detecting the user exiting the particular waiting area.

17. The electronic device of claim 15, wherein:

the one or more processors determine whether an overseeing mobile device is required based on the age of the user.

18. The electronic device of claim 17, wherein:

the overseeing mobile device sets a maximum level of scariness for the mobile device.

19. The electronic device of claim 17, wherein:

the overseeing mobile device sets an upper limit for the number of virtual objects displayed on the mobile device.

20. The electronic device of claim 15, wherein:

the mobile device comprises an HMD; and

the attraction comprises a ride at an amusement park.