SENSOR-BASED COMMAND AND CONTROL OF EXTERNAL DEVICES WITH FEEDBACK FROM THE EXTERNAL DEVICE TO THE AR GLASSES

• US 20120194550A1
• Filed: 12/30/2011
• Published: 08/02/2012
• Est. Priority Date: 02/28/2010
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Osterhout Design Group
• Inventors: Osterhout, Ralph F., Haddick, John D., Lohse, Robert Michael, Cella, Charles, Nortrup, Robert J., Nortrup, Edward H.
• Application Number:
  US13/341,798
• Publication Number:
  US 20120194550A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

This disclosure concerns an interactive head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content, wherein the eyepiece includes sensor-based command and control of external devices with feedback from the external device to the eyepiece.

Claims

1. A system, comprising:

an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly;

a communications facility that connects an external device to the eyepiece; and

a sensor that detects a condition

wherein when the sensor detects the condition, a user interface for command and control of the external device is presented in the eyepiece, and

wherein feedback from the external device is presented in the eyepiece.

2. The system of claim 1, wherein the sensor generates a signal for display as content when it detects the condition.