Image capturing apparatus and distance measuring method

• US 20010021011A1
• Filed: 02/16/2001
• Published: 09/13/2001
• Est. Priority Date: 02/16/2000
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Photo Film Co Limited (Fujifilm Holdings Corporation)
• Inventors: Ono, Shuji
• Granted Patent: US 6,538,751 B2
• Time in Patent Office: Days
• US Class Current: 356/3
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 7/586 from multiple light sources, e.g. photometric stereo

Abstract

An image capturing apparatus for obtaining information regarding a depth of a subject includes: an illumination unit operable to cast a first illumination light beam mainly having a first wavelength and a second illumination light beam mainly having a second wavelength and a third wavelength from optically different emission positions onto the subject, the second and third wavelengths being different from the first wavelength; and a depth calculator operable to calculate a depth-direction distance to the subject based on outgoing light beams from the subject.

Claims

1. An image capturing apparatus for obtaining information regarding a depth of a subject, comprising:

an illumination unit operable to cast a first illumination light beam mainly having a first wavelength and a second illumination light beam mainly having a second wavelength and a third wavelength from optically different emission positions onto said subject, said second and third wavelengths being different from said first wavelength; and

a depth calculator operable to calculate a depth-direction distance to said subject based on outgoing light beams from said subject.

2. An image capturing apparatus as claimed in

claim 1

, wherein said illumination unit casts said first and second illumination light beams onto said subject simultaneously.

3. An image capturing apparatus as claimed in

claim 2

, further comprising:

an optically converging unit operable to converge said outgoing light beams from said subject onto which said first and second illumination light beams are cast;

a separation unit operable to optically separate said outgoing light beams from said subject into a first outgoing light beam having said first wavelength, a second outgoing light beam having said second wavelength and a third outgoing light beam having said third wavelength;

a light-receiving unit operable to receive said first, second and third outgoing light beams that are separated by said separation unit and are converged by said optically converging unit; and

a light intensity detector operable to detect intensities of said first, second and third outgoing light beams received by said light-receiving unit,

wherein said depth calculator calculates the depth-direction distance to said subject by using the intensities of said first, second and third outgoing light beams.

4. An image capturing apparatus as claimed in

claim 3

, wherein said light-receiving unit includes three panels of solid state image sensors, and

said separation unit separates said first, second and third outgoing light beams by using an optical path splitter so as to allow said first, second and third outgoing light beams to be received by said three panels of solid state image sensors, respectively.

5. An image capturing apparatus as claimed in

claim 3

, wherein said light-receiving unit includes a solid state image sensor, and

said separation unit includes a first optical filter that transmits light having said first wavelength, a second optical filter that transmits light having said second wavelength and a third optical filter that transmits light having said third wavelength, said first, second and third optical filter being arranged alternately on a light-receiving surface of said solid state image sensor.

6. An image capturing apparatus as claimed in

claim 3

, wherein said illumination unit includes a first optical filter that transmits light having a shorter wavelength than a first boundary wavelength and a second optical filter that transmits light having a longer wavelength than a second boundary wavelength,

said illumination unit casts said first illumination light transmitted by said first optical filter and said second illumination light transmitted by said second optical filter from said optically different emission positions onto said subject,

said separation unit includes first, second and third optical filters that transmits light beams having said first, second and third wavelengths, respectively, said first wavelength being shorter than a shorter one of said first and second boundary wavelengths, said second and third wavelengths being longer than a longer one of said first and second boundary wavelengths, and

said separation unit separates said first outgoing light beam having said first wavelength by making said outgoing light beams from said subject pass through said first optical filter of said separation unit, and separates said second light beam having said second wavelength and said third outgoing light beam having said third wavelength by making said outgoing light beams from said subject pass through said second and third optical filters of said separation unit.

7. An image capturing apparatus as claimed in

claim 3

, wherein said depth calculator calculates said depth-direction distance to said subject by using a value based on the intensities of said second and third outgoing light beams and the intensity of said first outgoing light beam.

8. An image capturing apparatus as claimed in

claim 7

, wherein said depth calculator obtains a dummy intensity of a dummy outgoing light beam from said subject in a case where it is assumed that a light beam having said first wavelength is cast from the emission position of said second illumination light beam, based on the intensities of said second and third outgoing light beams.

9. An image capturing apparatus as claimed in

claim 7

, wherein said depth calculator calculates said depth-direction distance to said subject by using an averaged intensity of said second and third outgoing light beams and the intensity of said first outgoing light beam.

10. An image capturing apparatus as claimed in

claim 2

, wherein said illumination unit casts said first illumination light beam mainly having said first wavelength and said second illumination light beam mainly having said second and third wavelengths from the optically different emission positions onto said subject, said second wavelength being shorter than said first wavelength, said third wavelength being longer than said first wavelength, said image capturing apparatus further comprising:

an optically converging unit operable to converge outgoing light beams from said subject onto which said first and second illumination light beams are cast;

a separation unit operable to optically separate said outgoing light beams from said subject into a first outgoing light beam having said first wavelength and a second outgoing light beam having said second and third wavelengths;

a light-receiving unit operable to receive said first and second outgoing light beams converged by said optically converging unit; and

a light intensity detector operable to detect intensities of said first and second outgoing light beams received by said light-receiving unit,

wherein said depth calculator calculates the depth-direction distance to said subject by using the intensities of said first and second outgoing light beams.

11. An image capturing apparatus as claimed in

claim 10

, wherein said light-receiving unit includes two panels of solid state image sensors, and said separation unit optically separates an optical path of said first outgoing light beam from that of said second outgoing light beam by using an optical path splitter to allow said first and second outgoing light beams to be received by said two panels of solid state image sensors, respectively.

12. An image capturing apparatus as claimed in

claim 10

, wherein said light-receiving unit includes a solid state image sensor, and said separation unit includes a first optical filter that transmits light having said first wavelength and a second optical filter that transmits light having said second and third wavelengths, said first and second optical filters being arranged alternately on a light-receiving surface of said solid state image sensor.

13. An image capturing apparatus as claimed in

claim 10

, wherein said depth calculator calculates said depth-direction distance to said subject based on a ratio of the intensity of said first outgoing light beam and a half of the intensity of said second outgoing light beam.

14. An image capturing apparatus as claimed in

claim 4

, wherein an optical axis of said illumination unit when said illumination unit casts said first and second illumination light beams is substantially coincident with an optical axis of said capturing unit when said capturing unit captures said outgoing light beams from said subject.

15. An image capturing apparatus as claimed in

claim 14

, wherein said light intensity detector detects the intensities of said first and second outgoing light beams in each pixel of an image of said subject captured by said light-receiving unit, and said depth calculator calculates a depth distribution of said subject by obtaining for each pixel said depth to a region of said subject corresponding to said pixel.

16. An image capturing apparatus as claimed in

claim 15

, wherein said first and second illumination light beam are light beams in an infrared region,

said separation unit further includes a device operable to optically separate visible light from said outgoing light beams from said subject, and

said light-receiving unit further includes a solid state image sensor for visible light operable to receive said visible light that is optically separated by said separation unit and is converged by said optically converging unit.

17. An image capturing apparatus as claimed in

claim 4

, further comprising a controller operable to control at least one of emission periods, the intensities, and the emission positions of said first and second illumination light beams cast from said illumination unit and an exposure period of said light-receiving unit, based on at least one of the intensities of said outgoing light beams from said subject detected by said light intensity detector and said depth-direction distance to said subject calculated by said depth calculator.

18. An image capturing apparatus as claimed in

claim 5

, wherein an optical axis of said illumination unit when said illumination unit casts said first and second illumination light beams is substantially coincident with an optical axis of said capturing unit when said capturing unit captures said outgoing light beams from said subject.

19. An image capturing apparatus as claimed in

claim 18

, wherein said light intensity detector detects the intensities of said first and second outgoing light beams in each pixel of an image of said subject captured by said light-receiving unit, and said depth calculator calculates a depth distribution of said subject by obtaining for each pixel said depth to a region of said subject corresponding to said pixel.

20. An image capturing apparatus as claimed in

claim 19

, wherein said first and second illumination light beam are light beams in an infrared region,

said separation unit further includes a device operable to optically separate visible light from said outgoing light beams from said subject, and

said light-receiving unit further includes a solid state image sensor for visible light operable to receive said visible light that is optically separated by said separation unit and is converged by said optically converging unit.

21. An image capturing apparatus as claimed in

claim 5

, further comprising a controller operable to control at least one of emission periods, the intensities, and the emission positions of said first and second illumination light beams cast from said illumination unit and an exposure period of said light-receiving unit, based on at least one of the intensities of said outgoing light beams from said subject detected by said light intensity detector and said depth-direction distance to said subject calculated by said depth calculator.

22. An image capturing apparatus as claimed in

claim 6

, wherein an optical axis of said illumination unit when said illumination unit casts said first and second illumination light beams is substantially coincident with an optical axis of said capturing unit when said capturing unit captures said outgoing light beams from said subject.

23. An image capturing apparatus as claimed in

claim 22

, wherein said light intensity detector detects the intensities of said first and second outgoing light beams in each pixel of an image of said subject captured by said light-receiving unit, and said depth calculator calculates a depth distribution of said subject by obtaining for each pixel said depth to a region of said subject corresponding to said pixel.

24. An image capturing apparatus as claimed in

claim 23

, wherein said first and second illumination light beam are light beams in an infrared region,

said separation unit further includes a device operable to optically separate visible light from said outgoing light beams from said subject, and

said light-receiving unit further includes a solid state image sensor for visible light operable to receive said visible light that is optically separated by said separation unit and is converged by said optically converging unit.

25. An image capturing apparatus as claimed in

claim 6

, further comprising a controller operable to control at least one of emission periods, the intensities, and the emission positions of said first and second illumination light beams cast from said illumination unit and an exposure period of said light-receiving unit, based on at least one of the intensities of said outgoing light beams from said subject detected by said light intensity detector and said depth-direction distance to said subject calculated by said depth calculator.

26. An image capturing apparatus as claimed in

claim 11

, wherein an optical axis of said illumination unit when said illumination unit casts said first and second illumination light beams is substantially coincident with an optical axis of said capturing unit when said capturing unit captures said outgoing light beams from said subject.

27. An image capturing apparatus as claimed in

claim 26

, wherein said light intensity detector detects the intensities of said first and second outgoing light beams in each pixel of an image of said subject captured by said light-receiving unit, and said depth calculator calculates a depth distribution of said subject by obtaining for each pixel said depth to a region of said subject corresponding to said pixel.

28. An image capturing apparatus as claimed in

claim 27

, wherein said first and second illumination light beam are light beams in an infrared region,

said separation unit further includes a device operable to optically separate visible light from said outgoing light beams from said subject, and

said light-receiving unit further includes a solid state image sensor for visible light operable to receive said visible light that is optically separated by said separation unit and is converged by said optically converging unit.

29. An image capturing apparatus as claimed in

claim 11

, further comprising a controller operable to control at least one of emission periods, the intensities, and the emission positions of said first and second illumination light beams cast from said illumination unit and an exposure period of said light-receiving unit, based on at least one of the intensities of said outgoing light beams from said subject detected by said light intensity detector and said depth-direction distance to said subject calculated by said depth calculator.

30. An image capturing apparatus as claimed in

claim 12

, wherein an optical axis of said illumination unit when said illumination unit casts said first and second illumination light beams is substantially coincident with an optical axis of said capturing unit when said capturing unit captures said outgoing light beams from said subject.

31. An image capturing apparatus as claimed in

claim 30

, wherein said light intensity detector detects the intensities of said first and second outgoing light beams in each pixel of an image of said subject captured by said light-receiving unit, and said depth calculator calculates a depth distribution of said subject by obtaining for each pixel said depth to a region of said subject corresponding to said pixel.

32. An image capturing apparatus as claimed in

claim 31

, wherein said first and second illumination light beam are light beams in an infrared region,

said separation unit further includes a device operable to optically separate visible light from said outgoing light beams from said subject, and

said light-receiving unit further includes a solid state image sensor for visible light operable to receive said visible light that is optically separated by said separation unit and is converged by said optically converging unit.

33. An image capturing apparatus as claimed in

claim 12

, further comprising a controller operable to control at least one of emission periods, the intensities, and the emission positions of said first and second illumination light beams cast from said illumination unit and an exposure period of said light-receiving unit, based on at least one of the intensities of said outgoing light beams from said subject detected by said light intensity detector and said depth-direction distance to said subject calculated by said depth calculator.

34. A distance measuring method for obtaining information regarding a depth of a subject, comprising:

an illumination step of casting a first illumination light beam mainly having a first wavelength and a second illumination light beam mainly having second and third wavelengths from optically different emission positions onto said subject simultaneously, said second and third wavelengths being different from said first wavelength;

a separation step of separating outgoing light beams obtained from said subject that is illuminated with said first and second illumination light beams into a first outgoing light beam having said first wavelength, a second outgoing light beam having said second wavelength and a third outgoing light beam having said third wavelength;

a capturing step of capturing said first, second and third outgoing light beam that are separated;

a light intensity detection step of detecting intensities of said first, second and third outgoing light beams that are captured; and

a depth calculation step of calculating a depth-direction distance to said subject by using the intensities of said first, second and third outgoing light beams.

35. A distance measuring method as claimed in

claim 34

, wherein in said depth calculation step said depth-direction distance to said subject is calculated by using a value based on the intensities of said second and third outgoing light beams and the intensity of said first outgoing light beam.

36. A distance measuring method as claimed in

claim 35

, wherein in said depth calculation step a dummy intensity of a dummy outgoing light beam from said subject in a case where it is assumed that a light beam having said first wavelength is emitted from the emission position of said second illumination light beam is obtained based on the intensities of said second and third outgoing light beams, and said depth-direction distance to said subject is calculated based on a ratio of the intensity of said first outgoing light beam and said dummy intensity.

37. A distance measuring method as claimed in

claim 35

, wherein said depth-direction distance to said subject is calculated based on a ratio of an averaged intensity of said second and third outgoing light beams and the intensity of said first outgoing light beam.

38. A distance measuring method for obtaining information regarding a depth of a subject, comprising:

an illumination step of casting a first illumination light beam mainly having a first wavelength and a second illumination light beam mainly having a second wavelength and a third wavelength from optically different emission positions onto said subject, said second wavelength being shorter than said first wavelength, said third wavelength being longer than said first wavelength;

a separation step of optically separating outgoing light beams from said subject onto which said first and second illumination light beams are cast into a first outgoing light beam having said first wavelength and a second outgoing light beam having said second and third wavelengths;

a capturing step of capturing said first and second outgoing light beams separated from each other;

a light intensity detection step of detecting intensities of said first and second outgoing light beams;

a depth calculation step of calculating a depth-direction distance to said subject by using the intensities of said first and second outgoing light beams.

39. A distance measuring method as claimed in

claim 38

, wherein in said depth calculation step said depth-direction distance is calculated based on a ratio of the intensity of said first outgoing light beam and a half of the intensity of said second outgoing light beam.

40. An information obtaining method for obtaining distance information indicative of a distance to an object, comprising:

an illumination step of casting light beams onto said object from optically different two illumination positions;

a capturing step of capturing said light beams reflected from said object;

an angle calculation step of calculating one of angles at which said light beams are cast onto said object from said optically different two illumination positions; and

a calculation step of calculating distance information indicative of a distance to a measured portion of said object based on reflected light beams from said measured portion of and reflected light beams from a region in the vicinity of said measured portion of said object both of which are captured in said capturing step.

41. An information obtaining method as claimed in

claim 40

, wherein, in said calculation step, said distance information indicating said distance to said measured portion and surface-inclination information indicating inclination of a surface of said measured portion are calculated based intensities of said reflected light beams from said measured portion and intensities of said reflected light beams from said region in the vicinity of said measured portion.

42. An information obtaining method as claimed in

claim 41

, wherein said calculation step comprises:

a first calculation step of calculating said surface-inclination information of said measured portion to be obtained in a case where assumed distance information for said measured portion indicating an assumed distance to said measured portion is considered, based on the intensities of said reflected light beams from said measured portion and an incident angle of said reflected light beams;

a second calculation step of calculating assumed distance information for said region in the vicinity of said measured portion that indicates an assumed distance to said region, based on said assumed distance information for said measured portion and said surface-inclination information of said measured portion;

a third calculation step of calculating surface-inclination information of said region in the vicinity of said measured portion based on said assumed distance information for said region, the intensities of said reflected light beams from said region and an incident angles of said reflected light beams; and

a fourth calculation step of calculating an error between said surface-inclination information of said measured portion and said surface-inclination information of said region in the vicinity of said measured portion, and

wherein said assumed distance information for said measured portion is output as actual distance information for said measured portion in a case where said error falls within a predetermined range.

43. An information obtaining method for obtaining distance information indicative of a distance to an object, comprising:

an illumination step of casting light beams onto said object from optically different three or more illumination positions;

a capturing step of capturing said light beams reflected from said object; and

a calculation step of calculating said distance information based on said reflected light beams captured in said capturing step.

44. An information obtaining method as claimed in

claim 43

, wherein said reflected light beams are captured at a position that is optically the same as one of said three or more illumination positions in said capturing step.

45. An information obtaining method as claimed in

claim 44

, wherein said three or more illumination positions are arranged on optically the same line.