AR GLASSES WITH EVENT, SENSOR, AND USER ACTION BASED CONTROL OF APPLICATIONS RESIDENT ON EXTERNAL DEVICES WITH FEEDBACK

• US 20120200499A1
• Filed: 01/03/2012
• Published: 08/09/2012
• Est. Priority Date: 02/28/2010
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Osterhout Design Group
• Inventors: Osterhout, Ralph F., Haddick, John D., Lohse, Robert Michael, Cella, Charles, Nortrup, Robert J., Nortrup, Edward H.
• Application Number:
  US13/342,945
• Publication Number:
  US 20120200499A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G02B 2027/0132 comprising binocular systems
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

This disclosure concerns an interactive head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content, wherein the eyepiece includes event, sensor, and user action based control of applications resident on external devices with feedback.

Claims

1. A system, comprising:

an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly;

a sensor that detects a condition as input;

a user action capture device that detects a user action as input;

a communications facility that connects an external device to the eyepiece; and

an internal application that detects an event;

wherein when the event is detected by the eyepiece application, a command and control interface for command and control of an external application resident on the external device is presented in the eyepiece,

wherein the command and control interface accepts input from at least one of the sensor and user action capture device and wherein the command and control interface presents feedback from the external application in the eyepiece.