AR GLASSES WITH EVENT, SENSOR, AND USER ACTION BASED DIRECT CONTROL OF EXTERNAL DEVICES WITH FEEDBACK

• US 20120206335A1
• Filed: 01/03/2012
• Published: 08/16/2012
• Est. Priority Date: 02/28/2010
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Osterhout Design Group
• Inventors: Osterhout, Ralph F., Haddick, John D., Lohse, Robert Michael, Cella, Charles, Nortrup, Robert J., Nortrup, Edward H.
• Application Number:
  US13/342,957
• Publication Number:
  US 20120206335A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

This disclosure concerns an interactive head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content, wherein the eyepiece includes an event, sensor, and user action based direct control of external devices with feedback.

Claims

1. A system, comprising:

an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly;

a sensor that detects a condition;

a user action capture device that detects a user action as input; and

a communications facility that connects an external device to the eyepiece,

wherein when a condition is detected by the eyepiece, a command and control interface for command and control of the external device is presented in the eyepiece,

wherein the command and control interface accepts input from at least one of the user action capture device and the sensor, and

wherein the command and control interface presents feedback from the external device in the eyepiece.