Apparatus and method for a bioptic real time video system

• US 10,495,885 B2
• Filed: 06/14/2016
• Issued: 12/03/2019
• Est. Priority Date: 12/03/2010
• Status: Active Grant

• Current Assignee: eSight Corporation
• Original Assignee: eSight Corporation
• Inventors: Hilkes, Robert
• Primary Examiner(s): Chang, Kent W
• Assistant Examiner(s): Bibbee, Chayce R
• Application Number:
  US15/181,874
• Publication Number:
  US 20160282628A1
• Time in Patent Office: 1,267 Days
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0154 with movable elements
• CPC Class Codes: G02B 2027/0156 with optionally usable elements
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0149 characterised by mechanical features G02B27/0176 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

A method and apparatus of displaying an electronic video image using a head-worn near-to-eye display in a non-immersive fashion, such that the wearer can choose, through simple adjustments of their neck and eye angles, to either look at the displayed video image or their natural environment. The invention also relates to the incorporation of prescription lenses into the optical chain of the near-to-eye display. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to enable automatic stabilization of the video image. The invention also relates to the use of motion and position sensors incorporated into the head-worn device to automatically adjust the vertical angle of either the camera or the electronic display or both, by sensing the vertical angular position of the user'"'"'s head.

Claims

1. A head-worn device comprising:

a frame configured to mount onto a wearer'"'"'s head including a first portion configured to be disposed on a first side of the wearer'"'"'s head and a second portion configured to be disposed on a second distal side of the wearer'"'"'s head; and

a binocular electronic near-to-eye display assembly pivotally attached to the first portion of the frame and pivotally attached to the second portion of the frame such that the electronic near-to-eye display is restricted to pivot vertically across and in front of the wearer'"'"'s face and pivots about an axis parallel to an axis defined between a left temple of the wearer'"'"'s head and a right temple of the wearer'"'"'s head;

wherein

the wearer views their environment directly with the electronic near-to-eye display assembly pivoted upwards in front of a forehead of the wearer'"'"'s head above and out of their horizontal forward line of sight;

views first visual content presented on the electronic near-to-eye display with the electronic near-to-eye display assembly pivoted down in front of their eyes into their line of sight; and

the electronic near-to-eye display automatically pivots into the different positions based upon a position of the wearer'"'"'s head.

2. The head-worn device according to claim 1, wherein

when the electronic near-to-eye display is pivoted down in front of the wearer'"'"'s eyes the viewer'"'"'s direct view of their external environment is either

blocked by the electronic near-to-eye display except peripherally;

or

through the electronic near-to-eye display.

3. The head-worn device according to claim 1, wherein

the electronic near-to-eye display incorporates a camera for providing the first visual content;

and

the vertical angle of the camera is at least one of manually adjustable or adjusts automatically according to a position of the wearer'"'"'s head.

4. The head-worn device according to claim 1, further comprising:

a camera associated with the wearer;

an orientation sensor; and

a motion sensor,

wherein the image content acquired by the camera is stabilized using motion information provided by the orientation and motion sensors for presentation to the wearer as the first visual content.

5. The head-worn device according to claim 4, wherein

the vertical angle of the camera is automatically adjusted in dependence upon at least a task being performed by the wearer of the head-worn device and using information provided by at least one of the orientation sensor and the motion sensor.

6. The head-worn device according to claim 1, wherein

the first visual content presented on the electronic near-to-eye display is second content received from an external source overlaid to third content established in dependence upon the wearer'"'"'s field of view.

7. The head-worn device according to claim 1, wherein

the electronic near-to-eye display assembly comprises a display and an optical element having a first surface adjacent the display and a second surface configured to be disposed towards a user'"'"'s eye when the electronic near-to-eye display assembly is worn, wherein

a normal perpendicular to the surface of the display is approximately orthogonal to a line of sight of the user of the head-worn device when the user'"'"'s head is in the second position.

8. The head-worn display according to claim 1, wherein

the user views second visual content presented on the electronic near-to-eye display when the user'"'"'s head is pivoted forward.

9. The head-worn display according to claim 8, wherein

the first visual content and the second visual content are established by defining different areas of pixels within an image obtained from at least one of a camera and an external image source.

10. The head worn device according to claim 1, further comprising

a camera for providing the first visual content forming part of the electronic near-to-eye display;

a motor coupled to the camera and to a controller forming part of the electronic near-to-eye display; and

at least one of a position sensor providing position data to the controller relating to a position of the electronic near-to-eye display and a motion sensor providing motion data to the controller relating to motion of the electronic near-to-eye display;

wherein

the vertical angle of the camera adjusts automatically in dependence upon the controller processing the at least one of position data and motion data according to a position of the wearer'"'"'s head.

11. The head worn device according to claim 1, wherein

the first visual content presented on the electronic near-to-eye display is stabilized using motion information provided by at least one of an orientation sensor forming part of the electronic near-to-eye display and a motion sensor forming part of the electronic near-to-eye display;

and

the stabilization is only applied for small translational and rotational vectors.

12. The head worn device according to claim 4, wherein

the stabilization is only applied for small translational and rotational vectors.

13. A head mounted electronic near-to-eye display module, the electronic near-to-eye display module comprising:

a display electronics circuit in communication with a source of visual content;

a head mounted display optics having a first surface adjacent the display electronics circuit and a second surface disposed towards a wearer'"'"'s head; and

a first hinge for pivotally attaching the electronic near-to-eye display module to a first portion of a frame which is configured to be disposed on a first side of the wearer'"'"'s head when worn by the wearer;

a second hinge for pivotally attaching the electronic near-to-eye display module to a second portion of the frame which is configured to be disposed on a second distal side of the wearer'"'"'s head when worn by the wearer;

wherein

the first hinge and second hinge restrict the electronic near-to-eye display to pivoting vertically across and in front of the wearer'"'"'s face when worn by the user;

the electronic near-to-eye display pivots about an axis parallel to an axis defined between a left temple of the wearer'"'"'s head and a right temple of the wearer'"'"'s head;

the wearer views their environment directly when the electronic near-to-eye display assembly is pivoted upwards in front of a forehead of the wearer'"'"'s head above and out of their horizontal forward line of sight and views first visual content presented on the electronic near-to-eye display with the electronic near-to-eye display assembly pivoted down in front of their eyes into their line of sight; and

the head mounted electronic near-to-eye display automatically pivots into the different positions based upon a position of the wearer'"'"'s head.

14. The head mounted electronic near-to-eye display module according to claim 13, wherein

when the electronic near-to-eye display is pivoted down in front of the wearer'"'"'s eyes the viewer'"'"'s direct view of their external environment is either

blocked by the electronic near-to-eye display except peripherally;

or

through the electronic near-to-eye display.

15. The head mounted electronic near-to-eye display module according to claim 13, wherein

the head mounted electronic near-to-eye display incorporates a camera for providing the first visual content;

and

the vertical angle of the camera is at least one of manually adjustable or adjusts automatically according to a position of the wearer'"'"'s head.

16. The head mounted electronic near-to-eye display module according to claim 13, further comprising:

a camera associated with the wearer;

an orientation sensor; and

a motion sensor,

wherein the image content acquired by the camera is stabilized using motion information provided by the orientation and motion sensors for presentation to the wearer as the first visual content.

17. The head mounted electronic near-to-eye display module according to claim 16, wherein

the vertical angle of the camera is automatically adjusted in dependence upon at least a task being performed by the wearer of the head-worn device and using information provided by at least one of the orientation sensor and the motion sensor.

18. The head mounted electronic near-to-eye display module according to claim 13, wherein

a normal perpendicular to the surface of the display electronics circuit is approximately orthogonal to a line of sight of a user of the head mounted electronic near-to-eye display module.

19. The head mounted electronic near-to-eye display module according to claim 13, wherein

the first visual content presented on the electronic near-to-eye display is second content received from an external source overlaid to third content established in dependence upon the wearer'"'"'s field of view.

20. The electronic near-to-eye display module according to claim 13, further comprising

a camera for providing the first visual content forming part of the electronic near-to-eye display;

a motor coupled to the camera and to a controller forming part of the electronic near-to-eye display; and

at least one of a position sensor providing position data to the controller relating to a position of the electronic near-to-eye display and a motion sensor providing motion data to the controller relating to motion of the electronic near-to-eye display;

wherein

the vertical angle of the camera adjusts automatically in dependence upon the controller processing the at least one of position data and motion data according to a position of the wearer'"'"'s head.

21. The electronic near-to-eye display module according to claim 13, further comprising

a camera for providing the first visual content forming part of the electronic near-to-eye display;

a motor coupled to the camera and to a controller forming part of the electronic near-to-eye display; and

at least one of a position sensor providing position data to the controller relating to a position of the electronic near-to-eye display and a motion sensor providing motion data to the controller relating to motion of the electronic near-to-eye display;

wherein

the vertical angle of the camera adjusts automatically in dependence upon the controller processing the at least one of position data and motion data according to a position of the wearer'"'"'s head.

22. The electronic near-to-eye display module according to claim 16, wherein

the stabilization is only applied for small translational and rotational vectors.