Autostereoscopic imaging apparatus and method using suit scanning of parallax images

• US 5,510,831 A
• Filed: 02/10/1994
• Issued: 04/23/1996
• Est. Priority Date: 02/10/1994
• Status: Expired due to Term

• Current Assignee: Vision III Imaging, Inc.
• Original Assignee: Vision III Imaging, Inc.
• Inventors: Mayhew, Christopher A.
• Primary Examiner(s): Chin, Tommy P.
• Assistant Examiner(s): LIN, BRYAN T
• Application Number:
  US08/194,398
• Time in Patent Office: 803 Days
• Field of Search: 348/47, 348/46, 348/43, 348/51, 348/50, 348/49, 348/48, 348/42
• US Class Current: 348/47
• CPC Class Codes: H04N 13/117 the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/158 Switching image signals
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/167 Synchronising or controlling image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/289 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/332 Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• CPC Class Codes: H04N 13/334 using spectral multiplexing
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/341 using temporal multiplexing

Abstract

Autostereoscopic imaging is achieved by acquiring succession of first and second image frames from at least two different points of view, and image processing the first and second image frames, such that progressively different partial images of at least focussed and converged subject images in the second image frames are substituted for corresponding subject partial images in the first image frames in repeating sequence on a corresponding image frame-by-image frame basis to create a succession of composite image frames. Two-dimensional display of the resulting succession of composite image frames is perceivable in three-dimensional illusion.

Claims

1. Autostereoscopic imaging apparatus comprising in combination:

imaging means for acquiring first and second images of the same scene from respectively different points of view; and

an image processor coupled to receive the first and second images and adapted to extract a succession of different partial images from the second image and to sequentially substitute the extracted partial images in place of corresponding partial images in a repetitive scanning manner in the first image to create a succession of composite images viewable in perceived three-dimensional illusion without special viewing aids.

2. The autostereoscopic imaging apparatus defined in claim 1, which further includes means for storing the succession of composite images.

3. The autostereoscopic imaging apparatus defined in claim 1, which further includes means for two-dimensionally displaying the succession of composite images in perceived three-dimensional illusion.

4. The autostereoscopic imaging apparatus defined in claim 1, which further includes means for creating corresponding first and second subject image portions and corresponding first and second remainder image portions from each of the first and second images, respectively;

said image processor separately processing the corresponding first and second subject image portions to extract progressively different partial images from the second subject image portion and to substitute the extracted partial images in place of corresponding partial images in the first subject image portion on a repetitious basis to create a succession of composited subject images; and

a compositor for compositing the succession of composited subject images with a double image composition of the first and second remainder image portions to create the succession of composite images.

5. The autostereoscopic imaging apparatus defined in claim 1, which further includes means for converging the first and second images to a selected subject in the scene.

6. The autostereoscopic imaging apparatus defined in claim 1, wherein the first image is a first succession of image frames, and the second image is a second succession of image frames, and the succession of composite images is a third succession of image frames, the apparatus further including means for synchronizing the first, second and third successions of image frames in time.

7. The autostereoscopic imaging apparatus defined in claim 6, which further includes means for converting the first and second images into digital video signals.

8. The autostereoscopic imaging apparatus defined in claim 6, wherein the imaging means includes a first camera for acquiring the first image and a second camera for acquiring the second image.

9. The autostereoscopic imaging apparatus defined in claim 6, wherein the image processor has a cycle rate of 3-6 Hz.

10. The autostereoscopic imaging apparatus defined in claim 6, wherein each partial image of the second image and each corresponding partial image of the first image include plural image slices of the first and second images.

11. An autostereoscopic imaging method comprising the steps of:

acquiring a first image of a scene from a first point of view;

acquiring a second image of the scene from a second point of view different from the first point of view;

extracting a succession of different partial images from the second image; and

sequentially substituting the succession of extracted partial images in a repetitive scanning manner in place of like partial images in the first image to create a corresponding succession of composite images viewable in perceived three-dimensional illusion without special viewing aids.

12. The autostereoscopic imaging method defined in claim 11, which further includes the step of storing the succession of composite images.

13. The autostereoscopic imaging method defined in claim 11, which further includes the step of displaying the succession of composite images in perceived three-dimensional illusion.

14. The autostereoscopic imaging method defined in claim 11, wherein the substituting step is performed at a cycle rate of at least 3 Hz.

15. The autostereoscopic imaging method defined in claim 11, which further includes the steps of:

separating the first image into subject and remainder image portions;

separating the second image into subject and remainder image portions;

performing the partial image extracting and substituting steps only for the subject image portions of the first and second images to create a succession of composited subject image portions; and

compositing the composited subject image portions with a double image composition of the remainder image portions of the first and second images to create the succession of composite images.

16. The autostereoscopic imaging method defined in claim 15, which further includes the step of alternately comparing the first and second images to identify the subject and remainder image portions of the first and second images for separation by the separating steps.

17. The autostereoscopic imaging method defined in claim 11, which further includes the step of converging the first and second images to a selected subject in the scene.

18. The autostereoscopic imaging method defined in claim 11, wherein the first image is acquired as a first succession of image frames, and the second image is acquired as a second succession of image frames, the method further including the step of synchronizing the first and second successions of image frames and the succession of composite images in time.

19. The autostereoscopic imaging method defined in claim 11, wherein the first and second images are acquired by first and second cameras, respectively, the method further comprising the step of changing the relative positions of the first and second cameras.

20. Autostereoscopic imaging apparatus comprising, in combination:

a first imaging device for recording first images of a scene as a succession of first image frames;

a second imaging device for recording second images of the scene in synchronism with the first images, the second images being a succession of second image frames of differing parallax from the first image frames;

a video switcher for processing the first and second recorded images, such as to provide partial images of the second images and to effectively scan the partial images through the first images on a corresponding image frame-by-image frame basis to produce a succession of composite image frames comprising the first image frames and the partial images from the second image frames; and

means for recording the composite image frames for subsequent autostereoscopic display in perceived three-dimensional illusion without special viewing aids.

21. The autostereoscopic imaging apparatus of claim 20, which further includes a video effects device for processing the first and second images to produce a simulated optical axes convergence of the first and second imaging devices to a desired point in the scene, the processed first and second recorded images being fed to the video switcher.

22. The autostereoscopic imaging apparatus of claim 20, wherein a first optical axis of the first imaging device and a second optical axis of the second imaging device are oriented in relative angular relation, the apparatus further including an optical element for directing the first and second optical axes toward the scene.

23. The autostereoscopic imaging apparatus of claim 22, wherein the optical element is a beam splitter, the apparatus further including a video effects device for processing the first and second images to produce mirror images of one of said first and second images and to produce a simulated convergence of the first and second optical axes to a desired point in the scene, the processed first and second images being fed to the video switcher.

24. The autostereoscopic imaging apparatus of claim 22, which further includes means mounting at least one of the first and second imaging devices for linear and pivotal motion relative to the optical element and a controller for controlling the mounting means to linearly and pivotally position the one of the first and second imaging devices, such as to create a selected parallax relation of the first and second optical axes directed toward the scene and a convergence of the first and second optical axes at a selected point in the scene.

25. The autostereoscopic imaging apparatus of claim 22, which further includes:

first means mounting the first imaging device for linear and pivotal motion relative to the optical element;

second means mounting the second imaging device for linear and pivotal motion relative to the optical element; and

a controller controlling the first and second mounting means to linearly and pivotally position the first and second imaging devices, such as to create a selected parallax relation of the first and second optical axes and a convergence of the first and second optical axes at a selected point in the scene.

26. The autostereoscopic imaging apparatus of claim 20, wherein the partial images of the second images are scanned through the first images at a cycle rate of 3-6 Hz.

27. The autostereoscopic imaging apparatus of claim 20, wherein the partial images of the second images are in the form of slit images.

28. The autostereoscopic imaging apparatus of claim 20, wherein the partial images of the second images are in the form of a herringbone pattern.

29. The autostereoscopic imaging apparatus of claim 20, wherein the partial images of the second images are in the form of a wave pattern.

30. The autostereoscopic imaging apparatus of claim 20, wherein the partial images of the second images are in the form of a sawtooth pattern.

31. The autostereoscopic imaging apparatus of claim 20, wherein the partial images of the second images are in the form of a mosaic pattern.

32. The autostereoscopic imaging apparatus of claim 20, wherein the partial images of the second images are in the form of fan pattern rotating about a center moving in a circular path about a center point of the first image frames.

33. The autostereoscopic imaging apparatus of claim 20, wherein the partial images of the second images are in the form of a Backgammon board pattern.

34. A method of autostereoscopic imaging comprising the computer-implemented steps of:

defining a scene in three-dimensional space including a plurality of objects;

defining first and second cameras for imaging the scene from different points of view;

rendering successions of first and second image frames of the scene as acquired by the first and second cameras, respectively;

taking different partial images from the second image frames;

repeatedly scanning the partial images through the first image frames on a corresponding frame-by-frame basis to create a succession of composite image frames viewable in perceived three-dimensional illusion without special viewing aids; and

storing the composite image frames.

35. The method defined in claim 34, which further includes the steps of:

separating each of the first image frames into first horopter image portions and first remainder image portions;

separating each of the second image frames into second horopter image portions and second remainder image portions;

performing the partial image taking and scanning steps only on images of a selected subject in the first and second horopter image portions to create a succession of composited subject image portions; and

compositing the first and second remainder image portions in double image with the composited subject image portions on a corresponding frame-by-frame basis to create the succession of composite image frames.

36. The method defined in claim 34, further comprising the step of displaying the composite image frames in perceived three-dimensional illusion.

37. An autostereoscopic imaging method comprising the steps of

acquiring a succession of corresponding first and second images of a scene from respectively different points of view;

cyclically modifying an image portion of each successive first image using a like image portion from each successive second image corresponding thereto, the modified image portions being in different image locations in the first images during each modifying cycle to effectively scan the modified image portions through the first images, such as to create a corresponding succession of composite images viewable in perceived three-dimensional illusion without special viewing aids.

38. A method of autostereoscopic imaging comprising the computer-implemented steps of:

defining a scene in three-dimensional space including a plurality of objects;

defining first and second cameras for imaging the scene from different points of view and a corresponding succession of partial images of the scene as acquired by the second camera;

rendering a succession of image frames of the scene as acquired by the first camera and a corresponding succession of partial images of the scene as acquired by the second camera;

repeatedly scanning the partial images through the image frames acquired by the first camera on a synchronized basis to create a succession of composite image frames; and

storing the composite image frames for subsequent display in three-dimensional illusion without special viewing aids.