Electronically interpolated integral photography system

• US 5,455,689 A
• Filed: 02/14/1994
• Issued: 10/03/1995
• Est. Priority Date: 06/27/1991
• Status: Expired due to Term

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Chase, Scott B., Taylor, Roy Y.
• Primary Examiner(s): Coles, Sr., Edward L.
• Assistant Examiner(s): Grant, II, Jerome
• Application Number:
  US08/195,231
• Time in Patent Office: 596 Days
• Field of Search: 354/100, 354/101, 354/110, 352/52, 352/51, 355/20, 355/32, 355/33, 358/428, 358/450, 358/38, 359/25, 359/32, 359/463, 359/468, 359/472, 340/729, 382/57, 382/49
• US Class Current: 358/450
• CPC Class Codes: G03B 35/00 Stereoscopic photography
• CPC Class Codes: H04N 1/00201 Creation of a lenticular or stereo hardcopy image
• CPC Class Codes: H04N 1/23 Reproducing arrangements
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects
• CPC Class Codes: H04N 13/229 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/232 using fly-eye lenses, e.g. arrangements of circular lenses
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/257 Colour aspects
• CPC Class Codes: H04N 13/282 for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/307 using fly-eye lenses, e.g. arrangements of circular lenses
• CPC Class Codes: H04N 13/324 Colour aspects
• CPC Class Codes: H04N 13/327 Calibration thereof
• CPC Class Codes: H04N 13/349 Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for viewing without the aid of special glasses using fly-eye lenses H04N13/307
• CPC Class Codes: H04N 13/363 : using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/398 : Synchronisation thereof; Control thereof

Abstract

An integral, autostereoscopic three-dimensional image suitable for lenticular display is generated from a plurality of image perspectives by interpolating additional images from hypothetical perspectives, as follows. Initially, actual image signals are generated from a plurality of actual images obtained from a plurality of actual image perspectives. The additional images are obtained by operating upon the actual image signals and forming interpolated image signals from hypothetical image perspectives. Finally, an integral three-dimensional image is generated from the combination of images obtained from the actual image perspectives and the hypothetical image perspectives, and is suitably displayed. According to one suitable display, the integral image may be exposed upon a photosensitive sheet that is attached to a lenticular faceplate for subsequent viewing.

Claims

1. A method for generating an integral three-dimensional image from a plurality of image perspectives, said method comprising the steps of:

generating actual image signals from a plurality of actual images obtained from a plurality of actual image perspectives;

interpolating additional images by operating upon actual image signals to form interpolated image signals obtained from hypothetical image perspectives that are spatially interposed between the actual image perspectives by detecting edges of image features and utilizing the detected edge locations to interpolate between the actual images to obtain additional images from hypothetical image perspectives; and

generating an integral three-dimensional image from the combination of images obtained from the actual image perspectives and the hypothetical image perspectives.

2. A method for generating an integral three-dimensional image suitable for display through a lenticular faceplate, having a predetermined lenticular pitch, from a plurality of image perspectives, said method comprising the steps of:

acquiring a plurality of actual images from a plurality of actual image perspectives at substantially the same point in time, said actual image perspectives being separated in distance as a function of the lenticular pitch;

converting the plurality of actual images into actual digital image signals;

interpolating digital image signals by operating upon actual digital image signals to form interpolated digital image signals representing interpolated images taken from hypothetical image perspectives that are spatially interposed between the actual image perspectives by detecting image features and utilizing the detected feature locations to interpolate between the actual images to obtain additional images from hypothetical image perspectives;

generating a composite print file from the combination of actual and interpolated digital image signals taken from the actual and hypothetical image perspectives; and

printing an integral image suitable for lenticular viewing upon photosensitive material in response to the digital signals stored in the composite print file.

3. Apparatus for generating an integral three-dimensional image of an object viewed from a plurality of image perspectives, said integral image suitable for lenticular display through a lenticular faceplate, said apparatus comprising:

means for generating actual image signals from a plurality of actual images obtained from a plurality of actual image perspectives;

means for interpolating additional images by operating upon actual image signals from spatially separated actual images to form interpolated image signals obtained from hypothetical image perspectives that are spatially interposed between the spatially separated, actual image perspectives comprising means responsive to the actual image signals for recognizing image features and deriving therefrom the interpolated image signals; and

means for generating an integral three-dimensional image from the combination of actual image signals and interpolated image signals obtained from the actual image perspectives and the hypothetical image perspectives.

4. A method for generating an integral three-dimensional image from a plurality of image perspectives, said method comprising the steps of:

generating a plurality of image signals of images of a three-dimensional image from a corresponding plurality of actual image perspectives along a plurality of viewing axes with the images being arrayed in a direction normal to a principle viewing axis of image view;

forming additional image signals by operating upon said generated plurality of image signals to form interpolated image signals taken from hypothetical image perspectives that are spatially interposed between selected ones of the plurality of image perspectives; and

generating an integral three-dimensional image from the combination of the generated and formed images obtained from the actual image perspectives and the hypothetical image perspectives.

5. A method as claimed in claim 4 wherein the step of generating a plurality of image signals comprises the steps of:

producing a plurality of images from a plurality of actual image perspectives; and

converting the plurality of images into a plurality of image signals.

6. A method as claimed in claim 5 wherein the step of producing a plurality of images produces a plurality of photographic transparencies and the step of converting the plurality of images into a plurality of image signals comprises scanning the transparencies with a scanning beam to generate a plurality of image signals.

7. A method as claimed in claim 4 wherein the step of generating an integral three-dimensional image comprises the steps of:

generating a composite print file composed of said plurality of image signals and said interpolated image signals;

printing the integral three-dimensional image represented by the composite print file directly upon a photosensitive material; and

forming a lenticular display from the combination of the photosensitive material and a lenticular sheet.

8. A method as claimed in claim 7 wherein the step of printing the integral three-dimensional image represented by the composite print file comprises:

generating a visible display from the composite print file; and

optically directing the visible display onto the photosensitive material.

9. A method as claimed in claim 7 wherein the step of printing the integral three-dimensional image represented by the composite print file comprises electronically scan printing the photosensitive material with a light beam that varies in correspondence to the signals in the composite print file.

10. A method as claimed in claim 7 wherein the step of printing the integral three-dimensional image represented by the composite print file comprises generating a video signal from the print file, producing a video display from the video signal, and optically exposing the photosensitive material to the video display.

11. A method as claimed in claim 7 wherein the step of printing the integral three-dimensional image represented by the composite file comprises scanning the photosensitive material with a laser beam that is modulated in correspondence to the signals in the composite print file.

12. A method as claimed in claim 7 wherein the step of forming a lenticular display comprises affixing a lenticular sheet to photosensitive material that is transparent for transmissive viewing.

13. A method as claimed in claim 7 wherein the step of forming a lenticular display comprises affixing a lenticular sheet to a photosensitive material having a reflective underlayer for viewing by reflected light.

14. A method as claimed in claim 4 wherein said step of forming additional image signals comprises characterizing the changes in successive images as velocity vector fields, and utilizing the vector fields to interpolate between successive images to obtain additional image signals representing images from hypothetical image perspectives.

15. A method for generating an integral three-dimensional image from a plurality of image perspectives, said method comprising the steps of:

generating a plurality of image signals of a three-dimensional image from a corresponding plurality of real image perspectives along a plurality of viewing axes;

forming additional image signals by operating upon said generated plurality of image signals to form interpolated image signals taken from hypothetical image perspectives that are spatially interposed between selected ones of the plurality of image perspectives; and

generating an integral three-dimensional image from the combination of the generated and formed images obtained from the real image perspectives and the hypothetical image perspectives, wherein said plurality of image signals are digital representations of data from computer files, said digital representations corresponding to measures of hue and saturation at locations in a computer-generated image as viewed from a plurality of designated actual image perspectives.

16. Apparatus for generating an integral three-dimensional image of an object viewed from a plurality of image perspectives, said integral three-dimensional image suitable for lenticular display through a lenticular faceplate, said apparatus comprising:

means for generating a plurality of image signals of images of a three-dimensional image obtained from a plurality of actual image perspectives along a plurality of viewing axes with the images being arrayed in a direction normal to a principle axis of image view;

means for forming additional images by operating upon the generated plurality of image signals from spatially separated actual images to form interpolated image signals obtained from hypothetical image perspectives that are spatially interposed between selected ones of the spatially separated, actual image perspectives; and

means for generating an integral three-dimensional image from the combination of the plurality of image signals and interpolated image signals obtained from the actual image perspectives and the hypothetical image perspectives.

17. Apparatus as claimed in claim 16 wherein said means for generating an integral three-dimensional image comprises:

means for generating a composite print file composed of said plurality of image signals and the interpolated image signals, the combination thereof representative of an integral image;

means for printing the integral image upon photosensitive material in response to signals in the composite print file; and

means for forming an integral assemblage comprising the combination of the photosensitive material and a lenticular faceplate.

27. Apparatus as claimed in claim 17 wherein said means for printing the integral image comprises means for electronically scanning the photosensitive material with a light beam that varies in correspondence to the image signals in the composite print file.

28. Apparatus as claimed in claim 16 wherein said means for generating a plurality of image signals comprises:

means employing at least one optical system for producing a plurality of images from the object as viewed from a plurality of actual image perspectives; and

means for converting the plurality of images into a plurality of image signals.

29. Apparatus as claimed in claim 28 wherein said means for producing a plurality of images includes a plurality of cameras for capturing substantially planar representations of the images.

30. Apparatus as claimed in claim 28 wherein said means for producing a plurality of images comprises a single camera having plural lateral optical sections offset from each other to record substantially planar representations of plural images from a plurality of actual image perspectives.

31. Apparatus as claimed in claim 28 wherein said means for producing a plurality of images comprises a single camera and means for movably supporting said single camera in each of the actual image perspectives.

18. A method for generating an integral three-dimensional image suitable for display through a lenticular faceplate, having a predetermined lenticular pitch, from a plurality of image perspectives, said method comprising the steps of:

acquiring a plurality of actual images from a plurality of actual image perspectives along a plurality of viewing axes at substantially the same point in time the images being arrayed in a direction normal to a principle axis of image view, said actual image perspectives being separated in distance as a function of the lenticular pitch;

converting the plurality of actual images into actual digital image signals;

forming interpolated digital image signals by operating upon said actual digital image signals so as to represent interpolated images taken from hypothetical image perspectives that are spatially interposed between the actual image perspectives;

generating a composite print file from the combination of actual and interpolated digital image signals taken from the actual and hypothetical image perspectives; and

printing an integral three-dimensional image suitable for lenticular viewing, upon photosensitive material in response to the digital image signals stored in the composite print file.

19. A method as claimed in claim 18 wherein said step of printing an integral three-dimensional image further comprises affixing the photosensitive material to a lenticular faceplate having an array of generally convex refractive optical surfaces formed on the display side thereof.

20. A method as claimed in claim 18 wherein the step of printing an integral three-dimensional image comprises:

generating a visible display from the composite print file; and

optically directing the visible display upon the photosensitive material.

21. A method as claimed in claim 18 wherein the step of printing an integral three-dimensional image comprises electronically scanning the photosensitive material with a light beam that varies in correspondence to the signals in the composite print file.

22. A method as claimed in claim 18 wherein the step of printing an integral three-dimensional image comprises scanning the photosensitive material with a laser beam that is modulated in correspondence to the signals in the composite print file.

23. A method as claimed in claim 18 wherein said step of acquiring a plurality of actual images comprises producing a plurality of images with a plurality of cameras which record substantially planar representations of the images, said plurality of cameras positioned to capture a plurality of actual image perspectives.

24. A method as claimed in claim 18 wherein said step of acquiring a plurality of actual images comprises producing a plurality of images with a single camera having plural optical sections offset from each other to record substantially planar representations of plural images from a plurality of actual image perspectives.

25. A method as claimed in claim 18 wherein said step of acquiring a plurality of actual images comprises producing a plurality of images with a camera that is movably supported for positioning in a plurality of camera positions corresponding to the real image perspectives to acquire substantially planar representations of the plural actual images from the actual image perspectives.

26. A method as claimed in claim 18 wherein said step of forming interpolated digital image signals comprises characterizing the changes in successive images as velocity vector fields, and utilizing the vector fields to interpolate between successive images to obtain additional image signals representing images from hypothetical image perspectives.