AR glasses with event and sensor triggered control of AR eyepiece applications

• US 9,285,589 B2
• Filed: 01/03/2012
• Issued: 03/15/2016
• Est. Priority Date: 02/28/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Osterhout, Ralph F., Haddick, John D., Lohse, Robert Michael, Cella, Charles, Nortrup, Robert J., Nortrup, Edward H.
• Primary Examiner(s): Hong, Stephen
• Assistant Examiner(s): HUERTAS TORRES, AYESHA E
• Application Number:
  US13/342,965
• Publication Number:
  US 20120212414A1
• Time in Patent Office: 1,533 Days
• Field of Search: 345/8
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 6/0038 Linear indentations or grooves, e.g. arc-shaped grooves or meandering grooves, extending over the full length or width of the light guide
• CPC Class Codes: G02B 6/0045 by shaping at least a portion of the light guide
• CPC Class Codes: G02B 6/0053 Prismatic sheet or layer; Brightness enhancement element, sheet or layer
• CPC Class Codes: G02B 6/0056 for producing polarisation effects, e.g. by a surface with polarizing properties or by an additional polarizing elements
• CPC Class Codes: G02B 6/12009 comprising arrayed waveguide grating [AWG] devices, i.e. with a phased array of waveguides
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

This disclosure concerns an interactive head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content, wherein the eyepiece includes an event and sensor triggered control of eyepiece applications.

Claims

1. A system, comprising:

a see-through display configured to display augmented reality images that augment a surrounding environment viewable via the see-through display;

a processor; and

a storage device configured to hold instructions executable by the processor to;

detect a first data feed from a first network source,

control an internal application executable by the processor according to a first user-input command scheme responsive to the first data feed being detected,

detect a second data feed from a second network source, the second data feed being different than the first data feed,

control the internal application according to a second user-input command scheme responsive to the second data feed being detected, the first user-input command scheme being different than the second user-input command scheme.

2. The system of claim 1, wherein the head-mounted device includes an eyepiece.

3. The system of claim 1, further comprising a communications facility configured to receive the first data feed from the first network source and the second data feed from the second network source.

4. The system of claim 1, further comprising a sensor configured to detect at least one of an event and a physical quantity as input.

5. The system of claim 4, wherein the storage device is configured to hold instructions executable by the processor to control the internal application based on a third user-input command scheme responsive to the event or the physical quantity being detected by the sensor, the third user-input command scheme being different than the first user-input command scheme and the second user-input command scheme.

6. The system of claim 4, wherein the sensor is an environmental sensor configured to detect an environmental condition.

7. An augmented reality system, comprising:

a communications facility configured to receive a first data feed from a first network source and a second data feed from a second network source;

an internal application that automatically makes available a first user-input command scheme to control the internal application responsive to detection of the first data feed and automatically makes available a second user-input command scheme to control the internal application responsive to detection of the second data feed, the second user-input command scheme being different than the first user-input command scheme; and

a see-through display to display augmented reality images of a user interface of the internal application, the first user-input command scheme useable to control the user interface and the second user-input command scheme useable to control the user interface.

8. The augmented reality system of claim 7, wherein the see-through display includes an eyepiece.

9. The augmented reality system of claim 7, further comprising a sensor configured to detect at least one of an event and a physical quantity as input.

10. The augmented reality system of claim 9, wherein the user-input command scheme automatically is made available to control the internal application responsive to the event or the physical quantity being detected by the sensor.

11. The augmented reality system of claim 9, wherein the sensor is an environmental sensor configured to detect an environmental condition.

12. A method of augmenting reality, the method comprising:

automatically making available a first user-input command scheme to control an internal application of an augmented reality device;

receiving, at the augmented reality device, a data feed from a network source;

responsive to reception of the data feed, automatically making available a second user-input command scheme to control the internal application of the augmented reality device, the second user-input command scheme being different than the first user-input command scheme; and

displaying, via a see-through display of the augmented reality device, augmented reality images of a user interface of the internal application, the first user-input command scheme and the second user-input command scheme mapping a same user-input action to different commands useable to control the user interface.

13. The method of claim 12, further comprising detecting, with a sensor of the augmented reality device, at least one of an event and a physical quantity.

14. The method of claim 13, further comprising automatically making available the user-input command scheme responsive to the event or the physical quantity being detected by the sensor.

15. The method of claim 13, wherein the sensor is an environmental sensor configured to detect an environmental condition.