ALIGNMENT CONTROL IN AN AUGMENTED REALITY HEADPIECE

• US 20120120103A1
• Filed: 01/25/2012
• Published: 05/17/2012
• Est. Priority Date: 02/28/2010
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Osterhout Design Group
• Inventors: Border, John N., Haddick, John D.
• Application Number:
  US13/358,229
• Publication Number:
  US 20120120103A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted

Abstract

This patent discloses a method for providing an augmented image in a see-through head mounted display. The method includes capturing an image of a scene containing objects and displaying the image to a viewer. The method also includes capturing one or more additional image(s) of the scene in which the viewer indicates a misalignment between the displayed image and a see-through view of the scene. The captured images are then compared to determine an image adjustment to align corresponding objects in displayed images to the objects in the see-through view of the scene. This method provides augmented image information that is displayed in correspondence to the image adjustments so the viewer sees an augmented image comprised of the augmented image information overlaid and aligned to the see-through view.

Claims

1. A method for providing an augmented image in a see-through head mounted display which includes a camera comprising:

capturing a first image of a scene with the camera wherein the scene contains objects;

displaying the first image to a viewer;

capturing one or more additional image(s) of the scene with the camera in which the viewer indicates a misalignment between the displayed first image and a see-through view of the scene;

comparing the captured images to determine an image adjustment to align corresponding objects in the first image to the objects in the see-through view of the scene;

providing augmented image information;

applying the determined image adjustments to the augmented image information; and

displaying the augmented image information so the viewer sees an augmented image comprised of the augmented image information overlaid on the see-through view.

2. The method of claim 1 wherein the image adjustment comprises a lateral shift, a longitudinal shift or a resizing.

3. The method of claim 1 wherein the viewer indicates the misalignment by a hand gesture that is captured in the one or more additional image(s) of the scene.

4. The method of claim 1 wherein the viewer indicates the misalignment by moving his or her head between captured images.

5. The method of claim 1 wherein the viewer indicates misalignments at two or more different locations in the see-through view of the scene.

6. The method of claim 1 further comprising:

capturing another image of a scene with the camera;

analyzing the another image to identify the locations of objects in the scene; and

providing augmented image information using the determined image adjustments so the augmented image information is aligned to objects in the scene.

7. The method of claim 6, further comprising identifying the objects.

8. The method of claim 7 wherein the augmented image information is related to the objects in the scene.

9. The method of claim 1 further comprising:

capturing another image of the scene;

analyzing the another image and using the determined image adjustment to determine the locations of objects in the see-through view;

providing augmented image information;

applying the determined image adjustment to the augmented image information;

displaying the augmented image information so the viewer sees another augmented image comprised of the augmented image information overlaid on the see-through view; and

repeating these steps for additional other images to provide an augmented video.

10. The method of claim 9 wherein the see-through head mounted display further includes a GPS sensor or a magnetometer;

and the locations of objects are further determined by using data provided by the GPS sensor or the magnetometer.

11. The method of claim 9 wherein the see-through head mounted display further includes a gyro or an accelerometer;

and the locations of objects are further determined by using data provided by the gyro or accelerometer.

12. The method of claim 1 wherein the augmented image is part of user interface.

13. The method of claim 8 wherein the augmented image includes instructions.

14. The method of claim 8 wherein the augmented image includes names or addresses of objects.

15. The method of claim 1 wherein the viewer indicates the misalignment by a combination of hand gesture and head movement.

16. The method of claim 9 wherein the capturing of additional another images of the scene and analyzing of the additional another images is done when movement of the viewer is detected.

17. The method of claim 1 wherein instructions are displayed to the viewer.