Liquid droplet recognition apparatus, raindrop recognition apparatus, and on-vehicle monitoring apparatus

• US 8,466,960 B2
• Filed: 01/26/2010
• Issued: 06/18/2013
• Est. Priority Date: 02/16/2009
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Kobayashi, Masanori, Hirai, Hideaki, Aoki, Shin, Oouchida, Shigeru
• Primary Examiner(s): VO, TUNG T
• Application Number:
  US12/693,864
• Publication Number:
  US 20100208060A1
• Time in Patent Office: 1,239 Days
• Field of Search: 348/135, 348/143, 348/148, 250/208.01
• US Class Current: 348/135
• CPC Class Codes: B60S 1/0844 including a camera
• CPC Class Codes: G01N 21/21 Polarisation-affecting properties G01N21/19 takes precedence
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

Disclosed is a liquid droplet recognition apparatus for detecting liquid droplets attached to a front surface of a transparent member. The apparatus includes an image pickup apparatus that picks up a vertically polarized light image and a horizontally polarized light image at the front surface of the transparent member from a side of a rear surface of the transparent member; and a signal processing unit that determines whether the liquid droplets are attached to the front surface of the transparent member based on a polarized-light image ratio composed of the vertically polarized light image and the horizontally polarized light image picked up by the image pickup apparatus.

Claims

1. A liquid droplet recognition apparatus for detecting a liquid droplet attached to a front surface of a transparent member, the apparatus comprising:

an image pickup apparatus that picks up a vertically polarized light image and a horizontally polarized light image at the front surface of the transparent member from a side of a rear surface of the transparent member; and

a signal processing unit that determines whether the liquid droplet is attached to the front surface of the transparent member based on a polarized-light image ratio composed of the vertically polarized light image and the horizontally polarized light image picked up by the image pickup apparatus,

wherein the image pickup apparatus includes

a lens array having a plurality of image pickup lenses on a same substrate,

a filter that is separated into two polarizer regions with transmission axes orthogonal to each other so as to correspond to light fluxes passing through the plurality of image pickup lenses of the lens array, and

an image pickup unit having a plurality of image pickup regions that pick up an image of a subject by receiving light passing through the respective polarizer regions of the filter,

wherein the vertically polarized light image is picked up by any of the plurality of image pickup regions of the image pickup unit and the horizontally polarized light image is picked up by another of the plurity of image pickup regions thereof, and

wherein the signal processing unit includes an image position correction unit that corrects a parallax positional shift between the vertically polarized light image and the horizontally polarized light image picked up by the plurality of image pickup regions.

2. The liquid droplet recognition apparatus according to claim 1, wherein the image pickup apparatus further comprises:

a beam splitter that separates a light flux passing through the plurity of image pickup lenses into two parallel light fluxes,

wherein the transmission axes that are orthogonal to each other correspond to the two parallel light fluxes separated by the beam splitter, and

wherein the vertically polarized light image is acquired by the light flux passing through one of the two polarizer regions of the filter and the horizontally polarized light image is acquired by the light flux passing through the other of the two polarizer regions thereof.

3. The liquid droplet recognition apparatus according to claim 1 wherein the two polarizer regions of the filter have a multilayer structure in which a plurality of transparent materials with different refractive indexes are laminated together on a transparent substrate and have one-dimensional periodic irregularities repeatedly formed in one direction for the layers.

4. A raindrop recognition apparatus using the liquid droplet recognition apparatus according to claim 1, wherein the image pickup apparatus is provided inside a vehicle and detects a raindrop attached to a front surface of a windshield of the vehicle.

5. The raindrop recognition apparatus according to claim 4, further comprising:

a light source that irradiates a region of the windshield of the vehicle with illumination light of a wavelength range not visible to a human eye to be picked up by the image pickup apparatus.

10. The liquid droplet recognition apparatus according to claim 1, wherein the image pickup apparatus is disposed inside a vehicle to detect a raindrop attached to a front surface of a windshield of the vehicle, and

wherein the image pickup apparatus includes first and second polarizing regions, each region having grooves that extend in parallel with the surface of the windshield.

6. An on-vehicle monitoring apparatus comprising:

a first light source;

first and second image pickup apparatuses; and

a signal processing unit;

wherein the light source, the first and second image pickup apparatuses, and the signal processing unit are mounted on a vehicle,

wherein the light source irradiates a windshield of the vehicle with a parallel light flux at an incident angle of Brewster'"'"'s angle,

wherein the first image pickup apparatuses picks up an S-polarized light image and a P-polarized light image by receiving reflection light of the light flux irradiated from the light source to the windshield while picking up an image of a subject ahead of the vehicle,

wherein the second image pickup apparatuses picks up an image of the subject ahead of the vehicle, and

wherein the signal processing unit has a raindrop detection processing unit and an external information processing unit, the raindrop detection processing unit determining whether a raindrop is attached to the windshield based on a reflectance difference between the S-polarized light image and the P-polarized light image picked up by the first image pickup apparatus and the external information processing unit calculating a distance to the subject based on the images of the subject ahead of the vehicle picked up by the first image pickup apparatus and the second image pickup apparatus,

wherein the first image pickup apparatus includes

a lens array having a plurality of image pickup lenses on a same substrate,

a filter that is separated into two polarizer regions with transmission axes orthogonal to each other so as to correspond to light fluxes passing through the plurality of image pickup lenses of the lens array, and

an image pickup unit having a plurality of image pickup regions that pick up an image of a subject by receiving light passing through the respective polarizer regions of the filter,

wherein a vertically polarized light image is picked up by any of the plurality of image pickup regions of the image pickup unit and the horizontally polarized light image is picked up by another of the plurity of image pickup regions thereof, and

wherein the signal processing unit includes an image position correction unit that corrects a parallax positional shift between the vertically polarized light image and the horizontally polarized light image picked up by the plurality of image pickup regions.

7. The on-vehicle monitoring apparatus according to claim 6, wherein the filter of the first image pickup apparatus is a polarized light filter that is provided on an outgoing side of the light flux passing through the plurality of image pickup lenses and the two polarizer regions where polarized light is separated by transmission axes orthogonal to each other and a region where the polarized light is not separated,

wherein the image of the subject picked up by the image pick up unit is an image of a front surface of the windshield, and

wherein the first image pickup apparatus acquires the S-polarized light image from the light flux passing through a first of the two polarizer regions of the polarized light filter and acquires the P-polarized light image from the light flux passing through a second of the two polarizer regions thereof.

8. The on-vehicle monitoring apparatus according to claim 6, further comprising:

a second light source,

wherein the first light source and the second light source irradiate different regions of the windshield of the vehicle with parallel light fluxes at an incident angle of Brewster'"'"'s angle,

wherein the first and second of image pickup apparatuses pick up S-polarized light images and P-polarized light images by receiving reflection light of the light fluxes irradiated from the first and second light sources to the different regions of the windshield while picking up images of the subject ahead of the vehicle, and

wherein the raindrop detection processing unit of the signal processing unit determines whether a raindrop is attached to the windshield based on a reflectance difference between the S-polarized light images and the P-polarized light images picked up by the first and second image pickup apparatuses.

9. The on-vehicle monitoring apparatus according to claim 6, further comprising:

third and fourth image pickup apparatuses, the first and second image pickup apparatuses being used for measuring a short distance and the third and fourth image pickup apparatuses being used for measuring a long distance;

wherein the external information processing unit of the signal processing unit calculates a distance to the subject based on the images of the subject ahead of the vehicle picked up by the first and second image pickup apparatuses for measuring the short distance and the third and fourth image pickup apparatuses for measuring the long distance.