THREE-DIMENSIONAL IMAGING DEVICE, IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM

• US 20130120540A1
• Filed: 05/09/2012
• Published: 05/16/2013
• Est. Priority Date: 05/19/2011
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Ishii, Yasunori, Hiramoto, Masao
• Granted Patent: US 9,154,770 B2
• Time in Patent Office: Days
• US Class Current: 348/49
• CPC Class Codes: G03B 35/08 by simultaneous recording
• CPC Class Codes: H04N 13/214 using spectral multiplexing
• CPC Class Codes: H04N 13/225 using parallax barriers

Abstract

A 3D image capture device includes: a light transmitting section 2 with m transmitting areas (where m is an integer and m≧2) that have different spectral transmittance characteristics; and an image sensor 1 which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which unit elements are arranged. Each unit element includes n photosensitive cells (where n is an integer and n≧m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells. The image capture device further includes an image processing section which modifies an n×m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×m matrix and which generates multi-viewpoint images using the modified n×m matrix.

Claims

1. A 3D image capture device comprising:

a light transmitting section with m transmitting areas (where m is an integer that is equal to or greater than two) that have mutually different spectral transmittance characteristics;

an image sensor which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which a plurality of unit elements are arranged, each said unit element including n photosensitive cells (where n is an integer that is equal to or greater than m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells;

an imaging section which produces an image on the imaging area of the image sensor; and

an image processing section which modifies an n×

m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×

m matrix and which generates multi-viewpoint images represented by light rays that have been incident on at least two of the m transmitting areas based on the modified n×

m matrix and n photoelectrically converted signals supplied from the n photosensitive cells.

2. The 3D image capture device of claim 1, wherein the image processing section increases the determinant of the n×

m matrix by increasing the angle between at least two of the m column vectors.

3. The 3D image capture device of claim 1, wherein the image processing section changes the angle so that a value representing correlation between the multi-viewpoint images becomes smaller than a predetermined threshold value.

4. The 3D image capture device of claim 1, wherein the image processing section increases the angle so that the determinant of the n×

m matrix becomes greater than a predetermined threshold value.

5. The 3D image capture device of claim 1, wherein the image processing section increases the angle between two column vectors that is smaller than the angle formed by any other pair of the m column vectors.

6. The 3D image capture device of claim 1, wherein the image processing section obtains the angle between two arbitrary ones of the m column vectors and increases the angles sequentially by beginning with the smallest one, thereby increasing the determinant of the n×

m matrix.

7. The 3D image capture device of claim 1, wherein m=2 and n=2.

8. An image processor which generates multi-viewpoint images based on a signal that has been obtained by a 3D image capture device, the device comprising:

a light transmitting section with m transmitting areas (where m is an integer that is equal to or greater than two) that have mutually different spectral transmittance characteristics;

an image sensor which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which a plurality of unit elements are arranged, each said unit element including n photosensitive cells (where n is an integer that is equal to or greater than m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells; and

an imaging section which produces an image on the imaging area of the image sensor,

wherein the image processor modifies an n×

m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×

m matrix and generates multi-viewpoint images represented by light rays that have been incident on at least two of the m transmitting areas based on the modified n×

m matrix and n photoelectrically converted signals supplied from the n photosensitive cells.

9. An image processing method for generating multi-viewpoint images based on a signal that has been obtained by a 3D image capture device, the device comprising:

a light transmitting section with m transmitting areas (where m is an integer that is equal to or greater than two) that have mutually different spectral transmittance characteristics;

an image sensor which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which a plurality of unit elements are arranged, each said unit element including n photosensitive cells (where n is an integer that is equal to or greater than m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells; and

an imaging section which produces an image on the imaging area of the image sensor,

wherein the image processing method comprises the steps of;

modifying an n×

m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×

m matrix; and

generating multi-viewpoint images represented by light rays that have been incident on at least two of the m transmitting areas based on the modified n×

m matrix and n photoelectrically converted signals supplied from the n photosensitive cells.

10. An image processing program for generating multi-viewpoint images based on a signal that has been obtained by a 3D image capture device, the device comprising:

a light transmitting section with m transmitting areas (where m is an integer that is equal to or greater than two) that have mutually different spectral transmittance characteristics;

an image sensor which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which a plurality of unit elements are arranged, each said unit element including n photosensitive cells (where n is an integer that is equal to or greater than m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells; and

an imaging section which produces an image on the imaging area of the image sensor,

wherein the program is defined so as to make a computer perform the steps of;

modifying an n×

m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×

m matrix; and

generating multi-viewpoint images represented by light rays that have been incident on at least two of the m transmitting areas based on the modified n×

m matrix and n photoelectrically converted signals supplied from the n photosensitive cells.