Method and apparatus for optimizing the resolution of images which have an apparent depth

• US 5,973,700 A
• Filed: 09/16/1992
• Issued: 10/26/1999
• Est. Priority Date: 09/16/1992
• Status: Expired due to Term

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Morton, Roger A., Taylor, Roy Y.
• Primary Examiner(s): FETTING, ANTON W
• Application Number:
  US07/946,226
• Time in Patent Office: 2,596 Days
• Field of Search: 395/119, 395/127, 355/22, 354/112, 354/114, 354/115, 345/427
• US Class Current: 345/427
• CPC Class Codes: G03B 35/14 Printing apparatus specially adapted for conversion between different types of record G03B42/08 takes precedence
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/211 using temporal multiplexing
• CPC Class Codes: H04N 13/218 using spatial multiplexing
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects
• CPC Class Codes: H04N 13/225 using parallax barriers
• CPC Class Codes: H04N 13/229 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/282 for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/324 Colour aspects
• CPC Class Codes: H04N 13/332 Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• CPC Class Codes: H04N 13/349 Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for viewing without the aid of special glasses using fly-eye lenses H04N13/307

Abstract

Several different methods alone or in combination can be used to reduce image jump or stutter. The image plane on which the original image is taken can be mechanically or electronically rotated about a point of rotation in the scene. The number of original images which are viewed could be increased by interpolation. The subtended viewing angle of the viewpoints can be reduced and viewpoints within the subtended viewing angle can be increased by interpolation. Reduced subtended viewing angle images can be created for each eye. The depth of focus of the images can be changed by identifying the images that jump and blurring the images outside the area of interest. The original images can be processed to move the image plane further back from the objects in the scene. Some of the images ordinarily existing between the right and left eye perspectives can be eliminated. The objects in the background of the scene being photographed can be identified and shifted forward in the scene. The highest detail volume of the images can be identified and the images can be processed to rotate around the volume. The highest detail area can be identified and the original images processed to displace the images to minimize the movement of the highest detail area. The original images can be viewed and a point within each image identified to align the point from view to view using a linear or other transformation.

Claims

1. A method of producing a depth image, comprising the steps of:

(a) capturing views of a scene from various positions using convergent perspective axis imagers producing apparent viewing positions;

(b) processing the views changing the apparent viewing positions; and

(c) creating the depth image from the views.

2. A method as recited in claim 1, wherein the image is a lenticular photograph.

3. A method as recited in claim 1, further comprising creating views between the captured views by interpolation.

4. A method of producing a depth image, comprising the steps of:

(a) capturing views of a scene from various positions using parallel perspective axis imagers producing apparent viewing positions;

(b) converting the views into convergent perspective axis views and changing the apparent viewing positions of the views; and

(c) creating the depth image from the captured views.

5. A method as recited in claim 4, wherein the image is a lenticular photograph.

6. A method of producing a depth image comprising the steps of:

(a) capturing views of a scene from various positions, the views having actual visual displacements therebetween producing apparent viewing positions;

(b) producing created views from the captured views with created visual displacements therebetween less than the actual visual displacements changing the apparent viewing positions produced by the actual visual displacements; and

(c) creating the depth image from the created views.

7. A method as recited in claim 6, wherein the image is lenticular photograph.

8. A method as recited in claim 6, wherein step (b) includes creating a pair of created views for each eye.

9. A method of producing a depth image, comprising:

(a) capturing a view of a scene from various positions, the views having actual visual displacements therebetween producing apparent viewing positions;

(b) producing created views from and between the captured views using interpolation where the created views and captured views have created visual displacements therebetween less than the actual visual displacements changing the apparent viewing positions produced by the actual visual displacements; and

(c) creating the depth image from the created views.

10. A method as recited in claim 9, wherein the image is a lenticular photograph.

11. A method of producing a depth image, comprising the steps of:

(a) capturing views of a scene from various positions, the views with actual visual displacements therebetween producing apparent viewing positions;

(b) creating a created view between the captured views by interpolation where the created view and one of the captured views have a created visual displacement therebetween smaller than the actual visual displacement changing the apparent viewing positions;

(c) creating interpolated views between the one of the captured views and the created view by interpolation; and

(d) creating the depth image from the interpolated views.

12. A method as recited in claim 11, wherein the image is a lenticular photograph.

13. A method of producing a depth image, comprising the steps of:

(a) capturing views of a scene from various positions, the views with actual visual displacements therebetween producing apparent viewing positions;

(b) creating created views between the captured views by interpolation where the created views have a created visual displacement therebetween smaller than the actual visual displacement changing the apparent viewing positions;

(c) creating interpolated views between the created views by interpolation; and

(d) creating the depth image from the interpolated views.

14. A method as recited in claim 13, wherein the image is a lenticular photograph.

15. A method as recited in claim 13, wherein step (b) includes creating a pair of created views for each eye.

16. A method as recited in claim 15, wherein the image is a lenticular photograph.

17. A method of producing a depth image, comprising the steps of:

(a) capturing views of a scene with a perspective axis and from various positions producing apparent viewing positions;

(b) modifying the perspective axis of the views changing the apparent viewing positions; and

(c) creating the depth image from the modified perspective axis views.

18. A method of producing a depth image, comprising the steps of:

(a) capturing views of a scene with a perspective axis and from various positions Producing apparent viewing positions;

(b) identifying a volume in the scene with the greatest number of image edges;

(c) shifting the perspective axis of the views to rotate around the volume changing the apparent viewing positions; and

(d) creating the depth image from the shifted perspective axis views.

19. A method of producing a depth image, comprising the steps of:

(a) capturing views of a scene from various positions producing apparent viewing positions;

(b) identifying areas of highest detail in each view;

(c) correlating the areas and determining displacement distances between the correlated areas;

(d) determining a minimum displacement distance;

(e) displacing each view the minimum displacement distance changing the apparent viewing positions; and

(f) creating the depth image for the displaced views.

20. A method of producing a depth image, comprising the steps of:

(a) capturing views of a scene from various positions producing apparent viewing positions;

(b) identifying alignment points in each scene which correspond to a same scene point;

(c) shifting each view to align the alignment points changing the apparent viewing positions; and

(d) creating the depth image from the shifted views.

21. A method of producing a depth image, comprising the steps of:

(a) capturing views of a scene from various positions producing apparent viewing positions;

(b) determining displacements between the views;

(c) airbrushing objects in the views having a stuttering characteristic using the displacements as airbrushing diameters changing the apparent viewing positions; and

(d) creating the depth image from the airbrushed views.

22. A depth image apparatus, comprising:

a substrate including recorded images, the recorded images having a subtended viewing angle therebetween which reduces stutter to a visually non-distracting amount and changes apparent viewing positions of the recorded images as recorded; and

depth image display means confronting said substrate for producing a depth image from the recorded images.

23. An apparatus for producing a depth image, comprising:

first, second and third image capture devices with image planes oriented to a convergent point and capturing convergent images from various positions producing apparent viewing positions; and

means for producing a depth image having changed apparent viewing positions from the convergent images.

24. An apparatus for producing a depth image, comprising:

first, second and third image capture devices with image planes oriented in parallel toward infinity producing non-convergent images from various positions producing apparent viewing positions;

means for converting the non-convergent images to convergent images changing the apparent viewing positions; and

means for producing a depth image from the convergent images.