SYSTEM AND METHOD FOR DISPLAY CONTENT PLACEMENT USING DISTANCE AND LOCATION INFORMATION

• US 20120212484A1
• Filed: 04/06/2012
• Published: 08/23/2012
• Est. Priority Date: 02/28/2010
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Osterhout Design Group
• Inventors: Border, John N., Haddick, John D.
• Application Number:
  US13/441,145
• Publication Number:
  US 20120212484A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

This disclosure concerns an interactive head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content. The eyepiece also includes one or more range determination sensors and/or location sensors. Information relating to a distance to a real world object in the surrounding environment is extracted by the integrated processor from the sensors and the integrated processor determines, based on the location and distance, a placement position for the content within a field of view of the optical assembly.

Claims

1. A system, comprising:

an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, an integrated processor for handling content for display to the user, an integrated image source for introducing the content to the optical assembly, and a GPS sensor for determining the location of the user and an integrated camera operating in conjunction with an autofocus determination facility;

wherein information relating to a distance to a real world object in the surrounding environment is extracted by the integrated processor from the autofocus determination facility; and

wherein the integrated processor determines, based on the location and distance, a placement position for the content within a field of view of the optical assembly.

2. The system of claim 1, wherein the field of view comprises two separately controllable fields of view, each aligned with one of the user'"'"'s eyes, such that the user can view the surrounding area and content with both eyes and the placement position for the content comprises a placement position for each of the two separately controllable fields of view.

3. The system of claim 2, wherein the content comprises two independent images, and wherein the two independent images are placed separately in each of the two separately controllable fields of view.

4. The system of claim 3, wherein the two independent images form a three dimensional image when displayed to the user within the two separately controllable fields of view.

5. The system of claim 1, wherein the placement position is determined by extracting a placement value from a table of placement values that correspond with distances to real world objects.

6. The system of claim 1, wherein the placement position is calculated by the integrated processor.

7. A system, comprising:

an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, an integrated processor for handling content for display to the user, an integrated image source for introducing the content to the optical assembly, and a GPS sensor for determining the location of the user; and

an integrated range finder operating to determine a distance to a real world object in the surrounding environment, the integrated processor determining, based on the location and the distance, a placement position for the content within a field of view of the optical assembly.

8. The system of claim 7, wherein the field of view comprises two separately controllable fields of view, each aligned with one of the user'"'"'s eyes, such that the user can view the surrounding area and content with both eyes and the placement position for the content comprises a placement position for each of the two separately controllable fields of view.

9. The system of claim 8, wherein the content comprises two independent images, where the two independent images are placed separately in each of the two separately controllable fields of view.

10. The system of claim 9, wherein the two independent images form a 3D image when displayed to the user within the two separately controllable fields of view.

11. The system of claim 7, wherein the placement position is determined by extracting a placement value from a table of placement values that correspond with distances to real world objects.

12. The system of claim 7, wherein the placement position is calculated by the integrated processor.

13. The system of claim 7, wherein the rangefinder comprises two cameras.

14. A system, comprising:

an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly;

a plurality of integrated range determination sensors operating to determine a distance to a real world object in the surrounding environment; and

a GPS for determining the location of the user;

the integrated processor determining, based on the location and the distance, a placement position for the content within a field of view of the optical assembly.

15. The system of claim 14, wherein the field of view comprises two separately controllable fields of view, each aligned with one of the user'"'"'s eyes, such that the user can view the surrounding area and content with both eyes and the placement position for the content comprises a placement position for each of the two separately controllable fields of view.

16. The system of claim 15, wherein the content comprises two independent images, where the two independent images are placed separately in each of the two separately controllable fields of view.

17. The system of claim 16, wherein the two independent images form a 3D image when displayed to the user within the two separately controllable fields of view.

19. The system of claim 14, wherein the placement position is calculated by the integrated processor.

20. The system of claim 14, wherein the plurality of integrated range determination sensors are camera sensors.

21. The system of claim 14, wherein the plurality of integrated range determination sensors are range finders.

18. The system of 14, wherein the placement position is determined by extracting a placement value from a table of placement values that correspond with distances to real world objects.

22. A system, comprising:

an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, an integrated image source for introducing the content to the optical assembly, a GPS sensor for determining the location of the user, and at least one range determination sensor;

wherein information relating to a distance to a real world object in the surrounding environment is extracted from the range determination sensor by a processor in electrical communication with the eyepiece; and

wherein the processor determines, based on the location and distance, a placement position for the content within a field of view of the optical assembly.