System and method for spherical stereoscopic photographing

• US 20040066449A1
• Filed: 05/27/2003
• Published: 04/08/2004
• Est. Priority Date: 11/29/2000
• Status: Active Grant

• Current Assignee: DD Micoy Inc.
• Original Assignee: Micoy Corporation (Digital Domain Holdings Ltd.)
• Inventors: Givon, Dor
• Granted Patent: US 7,429,997 B2
• Time in Patent Office: Days
• US Class Current: 348/48
• CPC Class Codes: G03B 35/00 Stereoscopic photography
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/282 for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 13/334 using spectral multiplexing
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays

Abstract

The present invention provides a novel imaging system for obtaining full stereoscopic spherical images of the visual environment surrounding a viewer, 360 degrees both horizontally and vertically. Displaying the images obtained by the present system, by means suitable for stereoscopic displaying, gives the viewers the ability to look everywhere around them, as well as up and down, while having stereoscopic depth perception of the displayed images. The system according to the present invention (FIG. 1A) comprises an array of cameras (10), wherein the lenses (1,1′) of said cameras are situated on a curved surface, pointing out from C common centers of said curved surface. The captured images of said system are arranged and processed to create sets of stereoscopic image pairs, wherein one image of each pair is designated for the observer'"'"'s right eye and the second image for his left eye, thus creating a three dimensional perception.

Claims

1. A photographing system for capturing a full stereoscopic curved image, or a continuous part thereof, said system comprising a three dimensional array of cameras, wherein the lenses of all said cameras are situated on a curved surface, pointing out from common centers of said curved surface:

wherein the collective field of vision captured by all said lenses covers the whole visual area surrounding said photographing system, or a continuous part thereof, and wherein any point in said collective field of vision is captured by at least two of said lenses.

2. The system of claim 1 wherein the curved surface is a spherical surface.

3. The system of claim 2 wherein said cameras are arranged in a specific configuration wherein the field of vision of any of said lenses is overlapped to a great extent by the fields of vision of the two adjacent lenses lying on said lens sides with respect to horizontal axis, and only to a small extent by the fields of view of adjacent lenses lying above or below said lens with respect to horizontal axis,

and wherein said collective field of vision comprises a collection of fully circular stereoscopic panoramic images wherein any point within each of said panoramic images is captured by at least two lenses.

4. The system of claim 2 wherein said cameras are arranged in a specific configuration wherein the field of vision of any of said lenses is overlapped to a great extent by the fields of vision of all adjacent lenses surrounding said lens, and wherein said lenses are optionally equally distributed on said spherical surface.

5. The system of claim 1 wherein the image information captured by each of said cameras is stored separately

6. The system of claim 1 wherein the number said lenses is preferably between 18 and 22.

7. The system of claim 1 wherein said lenses are preferably in the range of 35 mm to 70 mm.

8. The system of claim 1 further comprising a stabilization means for preventing vibrations of said cameras and for keeping the cameras at their fixed positions relative to each other.

9. The system of claim 1 wherein said array of cameras is mounted on a support device having means for enabling rotation and translation of said array.

10. The system of claim 1 wherein said cameras are video cameras.

11. The system according to claim 10 wherein said video cameras are digital video cameras.

12. The system of claim 1 further comprising a means for image processing for processing the image information captured by any of said cameras and for cropping out redundant data in order to enhance said image quality.

13. The system of claim 1 further comprising a marking means for marking the boundaries of any of the images captured by any of said lenses, or a set of predetermined points within the area of each of said images.

14. A multi-lens camera apparatus for generating a full stereoscopic curved imaging, or a continuous part thereof, said apparatus comprising,

a set of lenses which are situated on a curved surface pointing out from common centers of said curved surface, wherein the collective field of vision captured by all of said lenses covers the whole visual environment surrounding said camera apparatus, or a continuous part thereof and any point in said collective field of vision is captured by at least two of said lenses,

and a means for recording and optionally storing the image information of the images captured by each of said lenses.

15. A process for capturing a full or partial stereoscopic curved image of a visual environment to be displayed to a viewer by means allowing for stereoscopic viewing, said process comprising the step of arranging a three dimensional array of cameras wherein the lenses of all said cameras are situated on a curved surface pointing out form common centers of said curved surface,

wherein the collective field of vision captured by all said lenses covers the whole visual environment surrounding said array of cameras, or a continuous part thereof,

and wherein any point in said collective field of vision is captured by at least two of said lenses.

16. The process of claim 15 wherein the curved surface is a spherical surface.

17. A process for capturing and for displaying a full stereoscopic curved image of a visual environment, to be displayed to a viewer by a system having means for stereoscopic displaying and viewing, said process comprising the steps of:

arranging a three dimensional array of lenses for capturing a collection of images, wherein the collective field of vision captured by all said lenses covers the whole visual environment surrounding said array of lenses, and wherein any point in said collective field of vision is captured by at least two of said lenses;

receiving from said system for stereoscopic displaying and viewing, the coordinates of said viewer'"'"'s field of vision;

creating a stereoscopic image pair from said collection of images, said stereoscopic image pair covers said viewer'"'"'s field of vision; and

displaying said stereoscopic image pair to said viewer by means of said system for stereoscopic displaying and viewing.

18. The process of claim 17 wherein the said step of creating a stereoscopic image pair from said collection of images comprising the following steps:

projecting said viewer'"'"'s field of vision onto said collection of images;

selecting from said collection of images a selected group of images overlapping at least partially said viewer'"'"'s field of vision;

dividing each of the images in said selected group of images into a left part and a right part by a line perpendicular to viewer'"'"'s horizon and passing through image center to obtain a group of left image parts and a group of right image parts;

selecting from said group of left image parts those parts overlapping said viewer'"'"'s field of vision to obtain a group of selected left parts;

merging said selected left parts into a uniform two-dimensional first image, said first image is the right image of said stereoscopic pair,

selecting from said group of right image parts those parts overlapping said viewer'"'"'s field of vision to obtain a group of selected right parts;

merging said selected right parts into a uniform two-dimensional second image, said second image is the left image of said stereoscopic pair;

19. The process of claim 17 further comprising a step of processing each of the images in said collection of images for enhancing the image quality, for image balancing between adjacent images and for cropping out redundant data.

20. A process for capturing and for displaying a full stereoscopic curved image of a visual environment, to be displayed to a viewer by a system having means for stereoscopic displaying and viewing, said process comprising the steps of:

capturing multiple images taken by at least one camera from different angles and/or locations, wherein the collective field of said images covers the surrounding visual environment and wherein any point in said collective field of vision is captured by at least two of said images;

receiving from said system for stereoscopic displaying and viewing, the coordinates of said viewer'"'"'s field of vision;

creating a stereoscopic image pair from said collection of images, said stereoscopic image pair covers said viewer'"'"'s field of vision; and

displaying said stereoscopic image pair to said viewer by means of said system for stereoscopic displaying and viewing.

21. The process of claim 20 wherein the said step of creating a stereoscopic image pair from said collection of images comprising the following steps:

projecting said viewer'"'"'s field of vision onto said collection of images;

selecting from said collection of images a selected group of images overlapping at least partially said viewer'"'"'s field of vision;

dividing each of the images in said selected group of images into a left part and a right part by a line perpendicular to viewer'"'"'s horizon and passing through image center to obtain a group of left image parts and a group of right image parts;

selecting from said group of left image parts those parts overlapping said viewer'"'"'s field of vision to obtain a group of selected left parts;

merging said selected left parts into a uniform two-dimensional first image, said first image is the right image of said stereoscopic pair;

selecting from said group of right image parts those parts overlapping said viewer'"'"'s field of vision to obtain a group of selected right parts;

merging said selected right parts into a uniform two-dimensional second image, said second image is the left image of said stereoscopic pair;

22. A photographing system for capturing a full stereoscopic spherical image, or a continuous part thereof as substantially described hereinabove.

23. A process for capturing and for displaying a full stereoscopic spherical image of a visual environment as substantially described hereinabove.