Video display modification based on sensor input for a see-through near-to-eye display

• US 8,964,298 B2
• Filed: 09/26/2012
• Issued: 02/24/2015
• Est. Priority Date: 02/28/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Haddick, John D., Osterhout, Ralph F.
• Primary Examiner(s): Jones, James
• Application Number:
  US13/627,930
• Publication Number:
  US 20130127980A1
• Time in Patent Office: 881 Days
• Field of Search: 359/630
• US Class Current: 359/630
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 2027/0112 comprising device for genereting colour display
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2207/113 Fluorescence
• CPC Class Codes: G02B 2207/115 Electrowetting
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

This disclosure concerns a near field communication (NFC) device which includes a wrist-worn NFC-enabled electronics device, wherein the wrist-worn NFC enabled electronics device includes a first communications link for communicating with a second NFC-enabled electronics device via NFC protocols, and a second communications link for communicating with an eyepiece via a medium-range communications protocol and receiving control commands. The wrist-worn NFC-enabled electronics device facilitates the transfer of data between the eyepiece and the second NFC-enabled electronics device. The eyepiece comprises optics enabling a see-through display on which is displayed the data.

Claims

1. An interactive head-mounted device, comprising:

an optical assembly through which a surrounding environment is viewable;

an integrated processor for handling virtual content for display;

an integrated image source for introducing the virtual content to the optical assembly; and

an environmental sensor;

wherein the integrated processor is adapted to initially display, via the integrated image source and the optical assembly, the virtual content with a display parameter having a first setting, and

wherein the integrated processor is adapted to display, via the integrated image source and the optical assembly, the virtual content with the display parameter having a second setting, different from the first setting, responsive to a change in the surrounding environment as recognized by the environmental sensor.

2. The device of claim 1, wherein the virtual content is a video image.

3. The device of claim 2, wherein the display parameter is at least one of brightness, color saturation, color balance, color hue, video resolution, transparency, compression rate, frames per second rate, and playback speed.

4. The device of claim 1, wherein the environmental sensor includes at least one of a charge-coupled device, a black silicon sensor, an IR sensor, an acoustic sensor, an induction sensor, a motion sensor, an optical sensor, an opacity sensor, a proximity sensor, an inductive sensor, an Eddy-current sensor, a passive infrared proximity sensor, a radar, a capacitive displacement sensor, a hall-effect sensor, a magnetic sensor, a GPS sensor, a thermal imaging sensor, a thermocouple, a thermistor, a photoelectric sensor, an ultrasonic sensor, an infrared laser sensor, an inertial motion sensor, a MEMS internal motion sensor, an ultrasonic 3D motion sensor, an accelerometer, an inclinometer, a force sensor, a piezoelectric sensor, a rotary encoder, a linear encoder, a chemical sensor, an ozone sensor, a smoke sensor, a heat sensor, a magnetometer, a carbon dioxide detector, a carbon monoxide detector, an oxygen sensor, a glucose sensor, a smoke detector, a metal detector, a rain sensor, an altimeter, an activity sensor, an object detector, a marker detector, a laser rangefinder, a sonar, a capacitive sensor, a heart rate sensor, and an RF/micropower impulse radio (MIR) sensor.

5. The device of claim 2, wherein the video image is stopped from playing in response to an indication from an accelerometer input of the environmental sensor that a user'"'"'s head is moving.

6. The device of claim 4, wherein an audio sensor input of the environmental sensor is generated by the speaking of at least one participant of a video conference.

7. The device of claim 2, wherein the video image is made more or less transparent in response to an indication from the environmental sensor that a user is moving.

8. An interactive head-mounted device, comprising:

an optical assembly through which a surrounding environment is viewable;

an integrated processor for handling virtual content for display;

an integrated image source for introducing the virtual content to the optical assembly; and

an integrated virtual image capture facility that images an aspect of the surrounding environment and provides the virtual content for display;

wherein the integrated processor is adapted to initially display, via the integrated image source and the optical assembly, the virtual content with a display parameter having a first setting, and

wherein the integrated processor is adapted to display, via the integrated image source and the optical assembly, the virtual content with the display parameter having a second setting, different from the first setting, responsive to a change in the surrounding environment as recognized by the integrated virtual image capture facility.