Software out-of-focus 3D method, system, and apparatus

• US 20030063383A1
• Filed: 09/27/2002
• Published: 04/03/2003
• Est. Priority Date: 02/03/2000
• Status: Abandoned Application

• Current Assignee: Bryan L. Costales
• Original Assignee: Bryan L. Costales
• Inventors: Costales, Bryan L.
• Application Number:
  US10/260,865
• Publication Number:
  US 20030063383A1
• Time in Patent Office: Days
• US Class Current: 359/464
• CPC Class Codes: G02B 21/22 Stereoscopic arrangements
• CPC Class Codes: G02B 23/04 for the purpose of beam splitting or combining, e.g. fitted with eyepieces for more than one observer G02B23/10 takes precedence
• CPC Class Codes: G02B 23/18 for binocular arrangements focusing binocular pairs G02B7/06; adjusting pupillary distance of binocular pairs G02B7/12
• CPC Class Codes: G02B 23/2415 Stereoscopic endoscopes
• CPC Class Codes: G02B 30/23 using wavelength separation, e.g. using anaglyph techniques
• CPC Class Codes: G02B 30/24 involving temporal multiplexing, e.g. using sequentially activated left and right shutters
• CPC Class Codes: G02B 30/25 using polarisation techniques
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/211 using temporal multiplexing
• CPC Class Codes: H04N 13/214 using spectral multiplexing
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/334 using spectral multiplexing
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/341 using temporal multiplexing

Abstract

A method, system, and apparatus are disclosed for producing enhanced three dimensional effects. The invention emulates physical processes of focusing wherein objects in the foreground and the background are in varying degrees out-of-focus and represented differently to each of a viewer'"'"'s eyes. In particular, the invention divides out-of-focus light representations so that different partitions of such a division are viewed by a viewer'"'"'s right eye as compared to what is viewed by the viewer'"'"'s left eye, and so that the identical in-focus representation is viewed by both eyes. Thus, the invention interposes novel processing between a determination as to what to render in a synthetically produced three dimensional space and the actual rendering thereof, wherein the novel processing produces stereoscopic views from a two dimensional view by utilizing information about the relation of light sources in the three dimensional space to the in-focus plane in the space.

Claims

1. A method for rendering a 3D view of an image, comprising:

providing an image, the image including at least a first image representation of a first object in the image and being associated with first image information; and

defocusing the first image information.

2. The method of claim 1, further comprising:

displaying at least some of the defocused first image information to a viewer.

3. The method of claim 1, wherein the image further includes at least a second image representation of a second object in the image, wherein the second image representation is associated with second image information, and wherein at least some of the second image information is displayed to a viewer without being defocused.

4. The method of claim 1, wherein the first image information comprises at least a first offset distance from an object plane and the defocusing step comprises:

comparing the first offset distance with a threshold distance;

when the first offset distance exceeds the threshold distance, the defocusing step is performed; and

when the first offset distance is less than the threshold distance, the defocusing step is not performed.

5. The method of claim 1, wherein the providing step includes the step of:

determining an image plane, wherein the first object is in-focus.

6. The method of claim 5, wherein the providing step further includes the step of:

determining an object plane in a model space that is parallel, or approximately parallel, to the image plane.

7. The method of claim 6, wherein the providing step further includes the steps of:

determining a set of pixels that are members of an out-of-focus image set associated with the first image representation and at least a first pixel in that set based on a distance of the a point represented by the pixel from the object plane; and

assigning to the pixel a value based on the point being in front of or behind the object plane relative to the point of view of the viewer.

8. The method of claim 7, wherein the assigning step further includes the steps of:

converting an in-focus pixel that is a member of an out-of-focus image set into an out-of-focus pixel representation by replacing the in-focus pixel with at least two new pixels adjacent to each other;

locating one of the new pixels in the same position as the in-focus pixel; and

adjusting the color intensity components of the new pixels such that they sum to no more than the color intensity of the in-focus pixel.

9. The method of claim 8, wherein the converting step further includes the steps of:

determining if the in-focus pixel has a value, wherein the in-focus pixel is behind the object plane, and horizontally reversing the positions of the adjacent pixels.

10. The method of claim 9, further comprising:

displaying the first new adjacent pixel to the first eye of the viewer; and

displaying the second new adjacent pixel to the second eye of the viewer.

11. The method of claim 7, wherein the assigning step further includes the step of:

determining a set of pixels that are members of an in-focus image set and at least a first pixel in that set based on that pixel'"'"'s correspondence to a point in the object plane.

12. The method of claim 11, wherein the presenting step includes the step of:

displaying the first pixel to both eyes of the viewer.

13. The method of claim 8, wherein the converting step includes the step of rendering the new adjacent pixels horizontally offset from each other.

14. The method of claim 8, wherein the converting step includes the step of rendering the new adjacent pixels diagonally offset from each other.

15. The method of claim 8, wherein the converting step includes the step of rendering the new adjacent pixels vertically offset from each other.

16. The method of claim 8, wherein the converting step includes the step of:

replacing the in-focus pixel with three or more new adjacent pixels; and

displaying the middle adjacent pixel to both eyes.

17. The method of claim 8, wherein the converting step includes the steps of:

determining a location in the image plane where new adjacent pixels overlap other adjacent pixels and where adjacent pixels overlap in-focus pixels; and

adjusting the sum of color intensity components for all such overlapping pixels at any given image plane pixel location to be no greater than the color intensity of the most color intense of all the overlapping pixels at that image plane pixel location.