IMAGING APPARATUS AND IMAGING MODULE

• US 20190313018A1
• Filed: 06/17/2019
• Published: 10/10/2019
• Est. Priority Date: 12/27/2016
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: ONO, Shuji
• Granted Patent: US 11,272,098 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 3/00 Simple or compound lenses
• CPC Class Codes: G02B 3/08 with discontinuous faces, e.g. Fresnel lens diffractive Fresnel lenses G02B5/1876
• CPC Class Codes: G03B 11/00 Filters or other obturators specially adapted for photographic purposes
• CPC Class Codes: G03B 15/00 Special procedures for taking photographs; Apparatus therefor
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/54 Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 23/955 for lensless imaging
• CPC Class Codes: H04N 23/957 Light-field or plenoptic cameras or camera modules

Abstract

The present invention provides an imaging apparatus that individually obtains high image quality, restored images for a plurality of different directions at a wide angle of view without using a lens, and an imaging module using such an imaging apparatus. In an imaging apparatus according to an aspect of the invention, incident light is divided into a plurality of azimuthal regions by a directional sensor, and images corresponding to the azimuthal regions are restored from a plurality of projection images acquired corresponding to the azimuthal regions. Accordingly, incident light from oblique directions does not become noise to incident light from a front direction, and projection images can be individually acquired for the azimuthal regions throughout a wide range from the front direction to the oblique directions. For this reason, restoration processing according to properties of a pattern mask and the projection images is executed, whereby it is possible to individually obtain high image quality restored image for a plurality of different directions (azimuthal regions) at a wide angle of view without using a lens.

Claims

1. An imaging apparatus comprising:

a pattern mask in which a transmissive region transmitting incident light and a light shielding region shielding incident light are arranged;

a directional sensor that has a light receiving surface close to which the pattern mask is provided, receives a projection image of the pattern mask with light from a subject through the pattern mask, divides the light incident on the pattern mask from the subject into a plurality of azimuthal regions with different directions, and acquires a plurality of the projection images corresponding to the plurality of divided azimuthal regions; and

a restored image generation unit that restores and generates a plurality of images of the subject corresponding to the plurality of azimuthal regions from the plurality of acquired projection images.

2. The imaging apparatus according to claim 1,

wherein a pattern of the arrangement is a pattern in which the transmissive region and the light shielding region compose a Fresnel zone plate, and

the restored image generation unit comprises

a composition processing unit that superimposes the plurality of acquired projection images and a projection pattern corresponding to the Fresnel zone plate through image processing, and

a restoration processing unit that performs Fourier transform on a plurality of moire fringes formed of the plurality of projection images and the projection pattern superimposed and restores and generates the plurality of images of the subject.

3. The imaging apparatus according to claim 2,

wherein the composition processing unit superimposes the plurality of projection images and a plurality of projection patterns corresponding to the plurality of projection images obtained by shifting the projection pattern corresponding to the Fresnel zone plate according to directions of the plurality of azimuthal regions through image processing.

4. The imaging apparatus according to claim 3,

wherein the plurality of azimuthal regions include a center region of an imaging range centering on a direction perpendicular to a surface of the Fresnel zone plate, and

the composition processing unit superimposes the projection pattern corresponding to the Fresnel zone plate on a projection image of the center region among the plurality of projection images through image processing.

5. The imaging apparatus according to claim 3, further comprising:

a storage unit that stores the plurality of projection patterns; and

a magnification unit that reads the plurality of projection patterns from the storage unit and magnifies the plurality of projection patterns according to a distance of the subject,

wherein the composition processing unit superimposes the plurality of projection images and the plurality of projection patterns magnified by the magnification unit through image processing.

6. The imaging apparatus according to claim 5, further comprising:

a display unit that displays an image restored by the restoration processing unit; and

an instruction input unit through which an instruction on a magnification ratio of the plurality of projection patterns or a subject distance is manually input,

wherein the magnification unit magnifies the plurality of projection patterns read from the storage unit based on an instruction input of the magnification ratio or the subject distance from the instruction input unit.

7. The imaging apparatus according to claim 5, further comprising:

a magnification ratio acquisition unit that automatically acquires a magnification ratio of the plurality of projection patterns at which resolution of an image restored by the restoration processing unit becomes maximum,

wherein the magnification unit magnifies the plurality of projection patterns read from the storage unit based on the magnification ratio acquired by the magnification ratio acquisition unit.

8. The imaging apparatus according to claim 3, further comprising:

a storage unit that stores a plurality of projection patterns with different magnification ratios according to a subject distance as the plurality of projection patterns;

a display unit that displays an image restored by the restoration processing unit; and

an instruction input unit through which an instruction on a magnification ratio of the plurality of projection patterns or a subject distance is manually input,

wherein the composition processing unit, based on an instruction input of the magnification ratio or the subject distance from the instruction input unit, reads the plurality of projection patterns with the corresponding magnification ratio from the storage unit and superimposes the plurality of projection images and the plurality of read projection patterns through image processing.

9. The imaging apparatus according to claim 3, further comprising:

a storage unit that stores a plurality of projection patterns with different magnification ratios according to a subject distance as the plurality of projection patterns; and

a magnification ratio acquisition unit that automatically acquires a magnification ratio of the plurality of projection patterns at which resolution of an image restored by the restoration processing unit becomes maximum,

wherein the composition processing unit, based on the magnification ratio acquired by the magnification ratio acquisition unit, reads the plurality of projection patterns with the corresponding magnification ratio from the storage unit and superimposes the plurality of projection images and the plurality of read projection patterns through image processing.

10. The imaging apparatus according to claim 1,

wherein the directional sensor is a sensor composed of

an image sensor having a plurality of pixels composed of photoelectric conversion elements arrayed in a two-dimensional manner, and

a microlens array provided on an incidence surface side of the image sensor, one microlens composing the microlens array being provided for every a plurality of pixels corresponding to the plurality of azimuthal regions, light incident on each microlens being divided into and incident on a plurality of pixels corresponding to the plurality of azimuthal regions.

11. The imaging apparatus according to claim 1,

wherein the directional sensor is a sensor composed of

an image sensor having a plurality of pixels composed of photoelectric conversion elements arrayed in a two-dimensional manner,

a microlens array provided for each pixel of the image sensor, and

a plurality of kinds of light shielding masks which are provided between the pixels of the image sensor and the microlenses of the microlens array, respectively, and in which openings corresponding to the plurality of azimuthal regions are formed.

12. The imaging apparatus according to claim 11,

wherein the plurality of kinds of light shielding masks are arranged in the same density for a plurality of pixels of the image sensor.

13. The imaging apparatus according to claim 11,

wherein the plurality of kinds of light shielding masks are arranged in different densities for a plurality of pixels of the image sensor.

14. The imaging apparatus according to claim 1, further comprising:

a combined image generation unit that combines the plurality of images restored by the restored image generation unit and generates one image.

15. The imaging apparatus according to claim 1,

wherein a pattern of the arrangement is an encoded pattern.

16. The imaging apparatus according to claim 1,

wherein a pattern of the arrangement is a pattern in which a plurality of openings as the transmissive region are arranged in a random manner in two-dimensional directions.

17. An imaging module comprising:

a Fresnel zone plate; and

a directional sensor that has a light receiving surface close to which the Fresnel zone plate is provided, receives a projection image of the Fresnel zone plate with light from a subject through the Fresnel zone plate, divides the light incident on the Fresnel zone plate from the subject into a plurality of azimuthal regions with different directions, and acquires a plurality of the projection images corresponding to the plurality of divided azimuthal regions.

18. The imaging module according to claim 17,

wherein the directional sensor is a sensor composed of

an image sensor having a plurality of pixels composed of photoelectric conversion elements arrayed in a two-dimensional manner, and

a microlens array provided on an incidence surface side of the image sensor, one microlens composing the microlens array being provided for every a plurality of pixels corresponding to the plurality of azimuthal regions, light incident on each microlens being divided into and incident on a plurality of pixels corresponding to the plurality of azimuthal regions.

19. The imaging module according to claim 17,

wherein the directional sensor is a sensor composed of

an image sensor having a plurality of pixels composed of photoelectric conversion elements arrayed in a two-dimensional manner, and

a microlens array provided for each pixel of the image sensor, and

a plurality of kinds of light shielding masks which are provided between the pixels of the image sensor and the microlenses of the microlens array, respectively, and in which openings corresponding to the plurality of azimuthal regions are formed.

20. The imaging module according to claim 19,

wherein the plurality of kinds of light shielding masks are arranged in the same density for a plurality of pixels of the image sensor.

21. The imaging module according to claim 19,

wherein the plurality of kinds of light shielding masks are arranged in different densities for a plurality of pixels of the image sensor.