HEAD-WORN ADAPTIVE DISPLAY

• US 20160209648A1
• Filed: 03/16/2016
• Published: 07/21/2016
• Est. Priority Date: 02/28/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Haddick, John D., Osterhout, Ralph F.
• Granted Patent: US 10,539,787 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01C 21/3629 Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02C 7/08 Auxiliary lenses; Arrangements for varying focal length
• CPC Class Codes: G02C 7/086 Auxiliary lenses located directly on a main spectacle lens or in the immediate vicinity of main spectacles
• CPC Class Codes: G02C 9/00 Attaching auxiliary optical parts auxiliary optical parts per se G02C7/08 - G02C7/16
• CPC Class Codes: G04G 21/025 for measuring physiological data
• CPC Class Codes: G04G 21/04 using radio waves radio-controlled time-pieces G04R
• CPC Class Codes: G04G 21/08 Touch switches specially adapted for time-pieces
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2203/0331 Finger worn pointing device
• CPC Class Codes: G06F 2203/0338 Fingerprint track pad, i.e. fingerprint sensor used as pointing device tracking the fingertip image
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 : Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 : Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/03547 : Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0428 : by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421
• CPC Class Codes: G06Q 30/02 : Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06V 20/20 : in augmented reality scenes
• CPC Class Codes: G06V 40/166 : using acquisition arrangements

Abstract

This disclosure concerns an interactive head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content. The optical assembly includes absorptive polarizers or anti-reflective coatings to reduce stray light.

Claims

1. A head-mounted display device, comprising:

an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable;

an integrated sensor configured to acquire sensor data relating to the surrounding environment;

an integrated processor for handling the sensor data and content for presentation to a user;

an image source configured to introduce content to the optical assembly; and

a communications facility configured to connect the head-mounted display device to a haptic interface separate from the head-mounted display device and to send a request to the haptic interface to output a haptic notification.

2. The head-mounted display device of claim 1, wherein the haptic output device is located on one or more of a wrap, a ring, a pad, a glove, a bracelet, and a watch.

3. The head-mounted display device of claim 1, wherein the haptic output device is located on a handheld device.

4. The head-mounted display device of claim 1, wherein the request comprises a request to output one or more of a vibration, a force, a pressure, an electrical impulse, and a temperature output.

5. The head-mounted display device of claim 1, wherein the head-mounted display device is configured to send the request to the haptic interface to output the haptic notification upon receipt of a message from a remote computing system.

6. The head-mounted display device of claim 1, wherein the integrated sensor comprises an image sensor configured to acquire image data of the surrounding environment, wherein the head-mounted display device comprises an object recognition application executable to recognize an object in the surrounding environment via the image data, and wherein the head-mounted display device is further configured to send the request to the haptic interface for the haptic notification upon recognition of the object.

7. The head-mounted display device of claim 6, wherein the object recognition application comprises facial recognition software and is configured to recognize a face via the image data of the surrounding environment, and wherein the head-mounted display device is further configured to send the request to the haptic interface for the haptic notification upon recognition of the face.

8. The head-mounted display device of claim 6, wherein the head-mounted display device is configured to send the request to the haptic interface for the haptic notification upon detecting that the user is approaching an object.

9. The head-mounted display device of claim 1, wherein the haptic interface is further configured to accept control inputs from the user and send the control inputs to the head-mounted display device.

17. The head-mounted display device of claim 1, wherein the communications facility is configured to connect to the haptic interface by connecting to a watch device.

10. A head-mounted display device, comprising:

an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable;

an integrated sensor configured to acquire sensor data relating to the surrounding environment;

an integrated processor for handling the sensor data and content for presentation to a user;

an image source configured to introduce content to the optical assembly; and

a communications facility configured to connect the head-mounted display device to a haptic interface separate from the head-mounted display device, to receive a message from a remote computing system, and to send a request to the haptic interface to output a haptic notification upon receipt of the message from the remote computing system.

11. The head-mounted display device of claim 10, wherein the head-mounted display device is configured to send the request to the haptic interface by sending the request to a haptic output device located on one or more of a wrap, a ring, a pad, a glove, a bracelet, and a watch.

12. The head-mounted display device of claim 10 wherein the head-mounted display device is configured to send the request to the haptic interface by sending the request to a haptic output device located on a handheld device.

13. The head-mounted display device of claim 10, wherein the request to the haptic interface comprises a request to output one or more of a vibration, a force, a pressure, an electrical impulse, and a temperature output.

14. The head-mounted display device of claim 10, wherein the head-mounted display device is further configured to send the message from the remote computing system to a haptic output device for display on the haptic output device.

15. The head-mounted display device of claim 10, wherein the integrated sensor comprises an image sensor configured to acquire image data of the surrounding environment, wherein the head-mounted display device comprises an object recognition application executable to recognize an object in the surrounding environment via the image data, and wherein the head-mounted display device is further configured to send the request to the wearable device for the haptic notification upon recognition of the object.

16. The head-mounted display device of claim 15, wherein the object recognition application comprises facial recognition software and is configured to recognize a face via the image data of the surrounding environment, and wherein the head-mounted display device is further configured to send the request to the wearable device for the haptic notification upon recognition of the face.

18. A system, comprising:

a head-mounted display device comprising an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable, one or more image sensors configured to acquire image data of the surrounding environment, an integrated processor for handling content for presentation to a user, and an image source configured to introduce content to the optical assembly; and

a haptic interface separate from the head-mounted display device, the haptic interface configured to receive a request from the head-mounted display device requesting output of a haptic notification and to output the haptic notification upon receiving the request.

19. The system of claim 18, wherein the haptic interface is located on one or more of a wearable device and a handheld remote control device.

20. The system of claim 18, wherein the haptic interface is configured to output the haptic notification through one or more of vibration, force, pressure, electrical impulse, and temperature.