Visualization of three dimensional images and multi aspect imaging

• US 20040223218A1
• Filed: 01/06/2004
• Published: 11/11/2004
• Est. Priority Date: 12/08/1999
• Status: Active Grant

• Current Assignee: James Virrilli
• Original Assignee: Neurok LLC
• Inventors: Lukyanitsa, Andrew, Putilin, Andrey N.
• Granted Patent: US 6,985,290 B2
• Time in Patent Office: Days
• US Class Current: 359/462
• CPC Class Codes: G02B 30/27 involving lenticular arrays
• CPC Class Codes: H04N 13/117 the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/368 for two or more viewers
• CPC Class Codes: H04N 13/373 for tracking forward-backward translational head movements, i.e. longitudinal movements
• CPC Class Codes: H04N 13/376 for tracking left-right translational head movements, i.e. lateral movements
• CPC Class Codes: H04N 13/395 with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

Three-dimensional imaging without parallax barriers or specialized eye gear, and without attendant loss of resolution, is provided by a display that produces dynamic images for display on at least two stacked electronic transmissive displays to create a continuous 3-D image field in a large viewing area or in multiple viewing areas. The images on each display are derived from stereoscopic image sources corresponding to both eyes of a viewer, and the derived images act as a mask for each other causing 3-D perception. The derived images are processed by summing the predicted image data, comparing the predicted image data to the desired stereopair, and minimizing the error. In preferred embodiments, the processing can be performed by an artificial neural network. A viewer may be presented with different aspects of an image as their viewing position changes to allow the viewer to perceive various perspectives of an image in dynamic fashion.

Claims

1. A method of creating a three-dimensional image display, comprising:

determining at least one viewing zone located in front of at least two transmissive electronic displays, said displays spaced one in front of another relative to said viewing zone;

selecting one pair of source stereopair images;

processing said source stereopair images to produce two calculated images derived from said source stereopair images and said relationship of said viewing zone and said displays, said calculated images being derived so that they act as a mask for each other when imaged on said displays, a first one of said calculated images being adapted for a front one of said two transmissive electronic displays and a second one of said two calculated images being adapted for a rear one of said transmissive electronic displays;

displaying each said calculated images on an appropriate transmissive electronic display such that each displayed calculated image acts as a mask for the other displayed calculated image; and

backlighting said transmissive electronic displays to display a stereoscopic image visible in said at least one viewing zone wherein said visible image corresponds to said selected pair of source stereopair images.

2. The method of claim 1, wherein processing for each said calculated image comprises iteratively:

estimating the light directed to each one of a viewer'"'"'s eyes by calculating interim calculated images for each of said transmissive electronic displays, and then determining the light directed through each discrete pixel of said front transmissive electronic display;

comparing the estimated light for each pixel with the equivalent light from the selected one of said stereopair images to determine an error;

adjusting said interim calculated images to reduce said error; and

accepting said interim calculated images as said calculated images once said error for each pixel is below a set limit.

3. The method of claim 2, wherein said processing of said selected source stereopair images is performed by an artificial neural network.

4. The method of claim 1, wherein said at least one viewing zone is determined by a calculation responsive to a sensed viewer position signal.

5. The method of claim 1, wherein said at least one viewing zone is continuously monitored by an automated viewer position sensor that generates a signal used in producing said calculated images.

6. The method of claim 1, wherein said calculated images are processed according to a plurality of viewing zones.

7. The method of claim 1, further comprising selecting a plurality of said stored stereopair images for display to a plurality of viewing zones, and wherein said two calculated images are produced by processing said selected stereopair images.

8. The method of claim 1, further comprising positioning a mask between said transmissive electronic displays, wherein said mask is adapted to suppress Moire patterns.

9. The method of claim 8, wherein said mask comprises a diffuser.

10. The method of claim 1, wherein said displays are selected from the group consisting of liquid crystal displays, gas plasma displays, organic light emitting diode displays and organic light emitting polymer displays.

11. The method of claim 1, wherein said selecting of said source stereopair images is performed according to said determined viewing zone, and wherein movements of said selected viewing zone impacts said selecting of said one of said stereopair images.

12. The method of claim 1, wherein said viewing zone is determined automatically to correspond to a variable position of an intended viewer of said visible image, and wherein said selected source stereopair images are changed as the position of said viewer varies.

13. The method of claim 12, wherein said changing of said source stereopair images comprises selecting a different source stereopair that corresponds to a different perspective of said selected source stereopair.

14. The method of claim 11, wherein said changing of said source stereopair images comprises selecting a different source stereopair that corresponds to a different perspective of said selected source stereopair.

15. The method of claim 1, further comprising determining at least two viewing zones and selecting at least two pairs of source stereopair images, a first pair of said selected source stereopair images corresponding to a first determined viewing zone and a second pair of said selected source stereopair images corresponding to a second determined viewing zone such that said calculated stereopair images causes said displays to create two different visible stereoscopic images, a different one of said two different stereoscopic images being visible in each said at least two viewing zones wherein said visible images corresponds to said selected pairs of source stereopair images.

16. A dynamic three-dimensional image display, comprising:

a source of stereopair images;

at least two electronic transmissive displays, said displays spaced one in front of another relative to a display viewing area;

an illumination source to backlight said transmissive electronic displays to said display viewing area;

a processor; and

a video controller electronically interfaced with said displays, said illumination source and said processor;

wherein said processor operates logic adapted to determine at least one viewing zone within said viewing area, to select a pair of source stereopair images, and to produce two calculated images derived from said source stereopair images and said relationship of said viewing zone and said displays, said calculated images being derived so that they act as a mask for each other when imaged on said displays, a first one of said calculated images being adapted for a front one of said two transmissive electronic displays and a second one of said two calculated images being adapted for a rear one of said transmissive electronic displays; and

wherein said video controller receives calculated image data from said processor and causes each display to generate an appropriate one of said calculated images such that each displayed calculated image acts as a mask for the other displayed calculated image to display an three-dimensional image visible in said at least one viewing zone, said visible image corresponding to said selected pair of source stereopair images.

17. The display of claim 16, wherein said processor logic for deriving each said calculated image comprises the iterative process of:

estimating the light directed to each one of a viewer'"'"'s eyes by calculating interim calculated images for each of said electronic transmissive displays, and then determine the light directed through each discrete pixel of said front electronic transmissive display;

comparing the estimated light for each pixel with the equivalent light from the selected ones of said stereopair images to determine an error;

adjusting said interim calculated images to reduce said error; and

accepting said interim calculated images as said calculated images once said error for each pixel is below a set limit.

18. The display of claim 17, wherein said means for processor logic for deriving each said calculated image is performed by said processor by emulating an artificial neural network.

19. The display of claim 16, further comprising a viewer position sensor that provides a signal for said processor to determine said least one viewing zone based upon the sensed position of a viewer.

20. The display of claim 19, wherein selecting of said source stereopair images is dependent upon a location of said determined viewing zone, and wherein movements of said selected viewing zone impacts said selecting of said one of said stereopair images.

21. The display of claim 16, wherein said viewing zone is a stationary viewing zone preset in a memory accessible by said processor.

22. The display of claim 16, wherein said processor logic derives said calculated images such that they can be displayed to a plurality of viewing zones to create an three-dimensional image visible in each of said plurality of viewing zones.

23. The display of claim 16, wherein said processor logic for selecting is adapted to select a plurality of said stereopair images, and where said means for processing is further adapted to process said plurality of selected stereopair images to calculate said calculated images such that they can be displayed to a plurality of viewing zones to create a plurality of aspects of a three dimensional image visible in said viewing zones.

24. The display of claim 16, further comprising a mask positioned between said electronic transmissive displays, wherein said mask is adapted to suppress Moire patterns.

25. The display of claim 24, wherein said mask is a diffuser.

26. The display of claim 16, wherein said displays are selected from the group consisting of liquid crystal displays, gas plasma displays, organic light emitting diode displays and organic light emitting polymer displays.

27. The display of claim 16, wherein said viewing zone is determined automatically to correspond to a variable position of an intended viewer of said visible image, and wherein said selected source stereopair images are changed by said processor as the position of said viewer varies.

28. The display of claim 27, wherein said processor changes said source stereopair images by selecting a different source stereopair that corresponds to a different perspective of said selected source stereopair.

29. The display of claim 27, wherein said changing of said source stereopair images comprises selecting a different source stereopair that corresponds to a different perspective of said selected source stereopair.

30. The display of claim 16, wherein said processor logic is further adapted to determine at least two viewing zones within said viewing area and to select at least two pairs of source stereopair images, a first pair of said selected source stereopair images corresponding to a first determined viewing zone and a second pair of said selected source stereopair images corresponding to a second determined viewing zone such that said calculated stereopair images causes said displays to create two different visible stereoscopic images, a different one of said two different stereoscopic images being visible in each said at least two viewing zones wherein said visible images corresponds to said selected pairs of source stereopair images.

31. The display of claim 16, further comprising a memory in communication with said processor;

said memory containing a database of various pairs of source stereoscopic images.

32. The display of claim 16, further comprising a mechanism for receiving source stereoscopic images input selected from the group consisting of one or more pairs paired video streams, one or more paired images of objects, and one or more paired views of 3-D scenes.