REAL-TIME VIDEO SIGNAL INTERWEAVING FOR AUTOSTEREOSCOPIC DISPLAY

• US 20090262181A1
• Filed: 04/17/2008
• Published: 10/22/2009
• Est. Priority Date: 04/17/2008
• Status: Abandoned Application

• Current Assignee: David Ohayon, Gal Rotem, Ofir Shefer
• Original Assignee: David Ohayon, Gal Rotem, Ofir Shefer
• Inventors: ROTEM, Gal, Shefer, Ofir
• Application Number:
  US12/104,546
• Publication Number:
  US 20090262181A1
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/31 using parallax barriers

Abstract

A method, apparatus and system for simultaneously capturing a plurality of video signals that carry images of a changing real three-dimensional scene, taken from respective different directions, and for combining them, in real time, into an interwoven video signal, ready to be fed to an active-matrix-based autostereoscopic display device.

Claims

1. A Method for real-time generation of a display video signal, adapted to be fed to an autostereoscopic display device for displaying an autostereoscopic video image of a changing three-dimensional scene, the display device including a matrix of active light-emitting or light-modulating elements, arranged in rows, and the display video signal structured as a sequence of frames, each frame structured as a sequence of lines that correspond to consecutive rows of said elements, the method comprising:

(d) Simultaneously obtaining a plurality of projection video signals, each signal structured as a sequence of frames representing two-dimensional projection images of the scene in a respective different direction and each frame including a plurality of pixels, each pixel carried as one or more digital values;

(e) copying pixel values from said projection video signals, or from any processed version thereof, into a digital representation of one or more of said rows so that values from different projection video signals become mutually interwoven.

(f) reading out said copied values from said digital representation in a line-by-line sequence and formatting them into the display video signal.

2. The method of claim 1, wherein there is a one-to-one correspondence between frames in the display video signal and frames in any of the projection video signals and the time delay between any pair of corresponding frames is equal to at most the duration of one frame.

3. The method of claim 1, wherein there is no limitation on the duration of any projection video signal or of the display video signal.

4. The method of claim 1, wherein each of said projection video signals is obtained by sensing the scene in any modality, including, but not limited to, passive optical sensing, ultrasonic echoing, radio echoing, optical echoing and x-ray projections.

5. The method of claim 1, wherein said copying is according to any given mapping function.

6. The method of claim 5, wherein said copying includes selectively copying according to the mapping function.

7. The method of claim 5, wherein said digital representation is of a plurality of rows and said copying includes copying each of said pixel values into a respective location in said digital representation according to the mapping function.

8. The method of claim 1, additionally comprising:

(g) For each projection video signal, correcting any occurring deviation of any pixel from its normal position within its respective frame.

9. The method of claim 1, additionally comprising:

(h) For each projection video signal, scaling each frame so that its resultant total number of pixels matches that required in steps ‘

b’ and

‘

c’

in order to fill the display device matrix or any designated portion thereof

10. The method of claim 7, additionally comprising:

(i) For each projection video signal, adjusting the values of any pixel, in dependency on any of its neighboring pixels, so as to match said values to the locations into which they are intended to be copied in step ‘

b’

.

11. The method of claim 1, wherein in step ‘

c’

said formatting is adaptable to any standard video format.

12. The method of claim 1, wherein the display device may be any commercially available autostereoscopic active-matrix display device.

13. The method of claim 1, wherein the display video signal is further adaptable to be stored in a video storage device.

14. Apparatus for real-time conversion of a plurality of projection video signals, representative of a changeable three-dimensional scene as projected in respective different directions, into a display video signal, adapted to be fed to an autostereoscopic display device for displaying an autostereoscopic image of the scene, each of the projection video signals being structured as a sequence of frames representing corresponding sequential two-dimensional projection images of the scene, the display device including a matrix of active light-emitting or light-modulating elements, arranged in rows, and the display video signal structured as a sequence of frames, each frame structured as a sequence of lines that correspond to consecutive rows of said elements, the apparatus comprising:

a plurality of Conditioning Processors, each receptive to a respective projection video signal and operative to output digital values of sequential pixels representative of corresponding projection images;

a Combiner, including a buffer storage that is adapted to store image values for one or more of said rows, the Combiner being operative to copy values obtained from said Conditioning Processors into said buffer storage so that values from different Conditioning Processors become mutually interwoven; and

a Video Formatter, operative to read out said copied values from said buffer storage in a line-by-line sequence and to format them into the display video signal.

15. The apparatus of claim 14, wherein there is a one-to-one correspondence between frames in the display video signal and frames in any of the projection video signals and the time delay between any pair of corresponding frames is equal to at most the duration of one frame.

16. The apparatus of claim 14, wherein there is no limitation on the duration of any projection video signal or of the display video signal.

17. The apparatus of claim 14, wherein each of said Conditioning Processors includes a Format Converter, operative to convert the respective projection video signal from any standard format into a corresponding sequence of pixel values.

18. The apparatus of claim 14, wherein said Combiner is further operative to copy said values into the buffer storage according to any given mapping function.

19. The apparatus of claim 18, wherein said Combiner further includes a plurality of mapping filters, each receptive to digital values output by a respective Conditioning Processor and operative to copy them selectively according to the mapping function.

20. The apparatus of claim 18, wherein said buffer storage is adapted to store image values for a plurality of said rows and said Combiner further includes a Mapper, operative to address each of said values to a respective location in said buffer storage according to the mapping function.

21. The apparatus of claim 14, wherein each of said Conditioning Processors includes an Aligner, operative to correct any deviation of any pixel from its normal position within its respective frame, occurring in the respective projection video signal.

22. The apparatus of claim 14, wherein each of said Conditioning Processors includes a Scaler, operative to scale each frame as obtained from the respective projection video signal so that its resultant total number of pixels matches that required by said Combiner and said Video Formatter in order to fill the display device matrix or any designated portion thereof.

23. The apparatus of claim 20, wherein each of said Conditioning Processors is further operative to adjust the values of any pixel, in dependency on any of its neighboring pixels, so as to match said values to the location to which they are addressed by said mapper.

24. The apparatus of claim 14, wherein said Video Formatter is adaptable to format said copied values into a display video signal of any standard format.

25. A System for continuous real-time autostereoscopic display of a changing three-dimensional scene, comprising:

means for sensing the scene from a plurality of directions and for outputting a plurality of corresponding projection video signals;

an active-matrix autostereoscopic display device; and

apparatus receptive to said projection video signals and operative to convert them into a display video signal, adapted to be fed to said display device for displaying an autostereoscopic image of the scene.

26. The system of claim 25, wherein said apparatus includes:

a plurality of Conditioning Processors, each receptive to a respective projection video signal and operative to output digital values of sequential pixels representative of corresponding projection images;

a Combiner, including a buffer storage that is adapted to store image values for one or more of said rows, the Combiner being operative to copy values obtained from said Conditioning Processors into said buffer storage so that values from different Conditioning Processors become mutually interwoven; and

a Video Formatter, operative to read out said copied values from said Pixel Buffer in a line-by-line sequence and to format them into the display video signal.

27. The system of claim 25, wherein said sensing may be in any modality, including, but not limited to, passive optical sensing, ultrasonic echoing, radio echoing, optical echoing and x-ray projections.

28. The system of claim 25, wherein said means of sensing is a plurality of video cameras, disposed to view the scene from respective directions.