Method and apparatus for displaying video data

• US 20150277121A1
• Filed: 03/29/2014
• Published: 10/01/2015
• Est. Priority Date: 03/29/2014
• Status: Active Grant

• Current Assignee: Frimory Technologies Ltd.
• Original Assignee: Frimory Technologies Ltd.
• Inventors: Fridental, Ron
• Granted Patent: US 9,971,153 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 3/12 for looking at the eye fundus, e.g. ophthalmoscopes A61B3/13 takes precedence
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: H04N 13/322 using varifocal lenses or mirrors
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 9/31 Projection devices for colour picture display , e.g. using electronic spatial light modulators [ESLM]

Abstract

A method and devices for displaying images, the method comprising: receiving an image, the image comprising depth information; determining at least a first group of pixels and a second group of pixels, based on the depth information; and displaying the first group of pixels at a first focus position of the projection device, and the second group of pixels at a second focus position of the projection device.

Claims

1. A method for displaying images by a projection device, comprising:

receiving an image, the image comprising depth information;

determining at least a first group of pixels and a second group of pixels, based on the depth information; and

displaying the first group of pixels at a first focus position of the projection device, and the second group of pixels at a second focus position of the projection device.

2. The method of claim 1, wherein the projection device is a head mounted display.

3. The method of claim 1, wherein the projection device is an optical head mounted display, allowing to simultaneously perceive the projected video and an environment of the projection device.

4. The method of claim 3, wherein the depth information is computed from the environment underlying the projected image.

5. The method of claim 1, further comprising repeating said receiving, said determining and said displaying for a multiplicity of images of a video stream, wherein the video stream is displayed at a frame rate of at about least 10 frames per second.

6. The method of claim 5, wherein

the video is a stereo video, comprising a left eye channel and a right eye channel, and having stereo disparity between the left eye channel and the right eye channel, wherein

a first sequence comprising images to be displayed to a left eye of a viewer and a second sequence rising images to be displayed to a right eye of the viewer, are retrieved from the video, wherein

the depth information is determined from stereo disparity between the images to be displayed to the left eye, and the images to be displayed to the right eye, and wherein

said displaying comprises projecting the first sequence to the left eye of the viewer, projecting the second sequence is projected to the right eye of the viewer.

7. A projecting system, comprising:

an active matrix for forming an image to be projected; and

an optical system for projecting the image onto a screen, wherein a focal distance of the optical system is adapted to change during display time of the image.

8. The projecting system of claim 7, wherein pixels in a first group of pixels in the image are turned on when the optical system assumes a first focus position, and are off at other focus positions, and pixels in a second group of pixels in the image are turned on when the optical system assumes a second focus position and are off at other focus positions.

9. The projecting system of claim 7, wherein a first group of pixels in the image is displayed when the optical system assumes a first focus position and a second group of pixels in the image is displayed when the optical system assumes a second focus position.

10. A video projection system, comprising:

an active matrix for forming an image to be projected;

an optical system for projecting the image onto a screen; and

a feedback image sensor, and a semitransparent mirror, placed so that the active matrix and the feedback image sensor forming equivalent optical paths relatively to the semitransparent mirror.

11. The video projection system of claim 10, wherein an image reflected from the screen and acquired by the feedback image sensor is used to control operation parameters of the video projecting system.

12. The video projection system of claim 11, wherein the image is projected onto an eye retina of a viewer, and information acquired by a feedback image sensor is used to control operation parameters of the video projecting system for image focusing or for alignment on the retina.

13. The video projection system of claim 12, wherein the video projecting system is comprised in a device wearable by a viewer.

14. A vision aid apparatus, comprising:

at least one video camera for acquiring a video stream of an environment of the apparatus;

a processing unit for processing the captured video; and

a head mounted display, comprising an image forming active matrix and projecting the acquired video stream onto a retina of an eye of a user,

wherein the vision aid is wearable by the user.

15. The vision aid apparatus of claim 14, wherein the at least one video camera comprises a first video camera and a second video camera, and wherein video captured by the first video camera is projected into a left eye of the user, and video captured by the second video camera is projected into a right eye of the user.

16. The vision aid apparatus of claim 14, wherein said processing unit processes the video to change at least one projection parameter, the at least one projection parameter selected from the group consisting of:

color spectrum, brightness, and layout geometry.

17. A vision aid apparatus of claim 14, further comprising a feedback image sensor and a semitransparent mirror placed diagonally between the image sensor and the active matrix, to form optically equivalent paths between the image sensor and the active matrix relatively to the said mirror.

18. A vision aid apparatus of claim 17, wherein the processing unit distorts images of the video stream to remap the images onto at least one sensitive part of the retina, and wherein the feedback image sensor is adapted to control alignment of the image on the retina during eye motion.