State monitoring apparatus

• US 9,679,209 B2
• Filed: 07/22/2013
• Issued: 06/13/2017
• Est. Priority Date: 07/25/2012
• Status: Expired due to Fees

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Yamamoto, Takahiro, Omi, Takuhiro
• Primary Examiner(s): Li, Tracy Y
• Application Number:
  US14/408,397
• Publication Number:
  US 20150186737A1
• Time in Patent Office: 1,422 Days
• CPC Class Codes: G01B 11/14 for measuring distance or clearance between spaced objects or spaced apertures G01B11/26 takes precedence; rangefinders G01C3/00
• CPC Class Codes: G03B 11/045 Lens hoods or shields
• CPC Class Codes: G03B 15/05 Combinations of cameras with electronic flash apparatus; Electronic flash units
• CPC Class Codes: G03B 2215/0503 Built-in units
• CPC Class Codes: G03B 2215/0567 Solid-state light source, e.g. LED, laser
• CPC Class Codes: G03B 2215/0592 installed in front of light emitter
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: H04N 23/50 Constructional details
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

In an image pickup system, illumination light emitted by a light emission part is collected and reflected by an optical member and is distributed to a predetermined area. This light distribution to the predetermined area permits a constituent point farther away from the light emission part to receive illumination light having a greater intensity of light being equal to or greater than a predetermined reference value. The image pickup system thus distributing the illumination light enables the intensity of light incident on each pixel constituting an image pickup predetermined area to be equal to or greater than an intensity reference value while enabling the distribution of the intensity of light incident on each pixel constituting the image pickup predetermined area to be within a first reference range.

Claims

1. A state monitoring apparatus mounted in a vehicle to monitor a state of an occupant who is a driver of the vehicle, comprising:

at least one light emission part that emits light to project illumination light having a wavelength including at least a near infrared wavelength to a predetermined area that is defined as an area where a face of the occupant being the driver of the vehicle is positioned in space in a compartment of the vehicle;

an image pickup part that generates a picture image by receiving light incident from the predetermined area with an image sensor having a plurality of pixels;

a state monitoring section that monitors a state of the occupant being the driver based on a result of processing the picture image generated by the image pickup part; and

an optical control part that controls light distribution

to cause an intensity of light incident on each pixel included in an image pickup predetermined area

to be equal to or greater than an intensity reference value that is predetermined as an intensity of light providing a picture image suitable for image processing by the state monitoring section and

to cause a distribution of the intensity of light incident on each pixel included in the image pickup predetermined area

to be within a predetermined first reference range,

the image pickup predetermined area

being at least a part of a light receptive surface of the image sensor in the image pickup part, and

corresponding to the predetermined area,

wherein;

the predetermined area includes a center presence area where a central axis of the face of the occupant being the driver is probably positioned, while

the image pickup predetermined area includes an area corresponding to the center presence area, in the light receptive surface; and

the optical control part controls the light distribution in the center presence area such that

(i) a distribution of the intensity of the illumination light along a perpendicular direction is to be uniform, whereas

(ii) a distribution of the intensity of the illumination light along a horizontal direction is

to be greater to arrive at an area closer to the center presence area, and

to be smaller to arrive at an area farther away from the center presence area.

2. The state monitoring apparatus according to claim 1,

wherein the optical control part controls the light distribution

to cause the illumination light having a greater intensity

to arrive at a point farther away from the light source of the light emission part among points in the face of the occupant that is possibly present in the predetermined area.

3. The state monitoring apparatus according to claim 1,

wherein the optical control part includes at least one optical element.

4. The state monitoring apparatus according to claim 1,

wherein the light emission part individually includes a floodlight projector that emits the illumination light, and

wherein the optical control part is a plurality of the floodlight projectors that are arranged

to cause the illumination light having a greater intensity

to arrive at a point farther away from a light source in the light emission part among points in the face of the occupant probably present in the predetermined area.

5. The state monitoring apparatus according to claim 1,

wherein:

the at least one light emission part includes a plurality of floodlight projectors that each emit the illumination light having high rectilinearity;

the plurality of the floodlight projectors function as the optical control part;

the plurality of the floodlight projectors are arranged to cause the illumination light having a greater intensity to arrive at a point farther away from a light source in the light emission part, the point being among points in the face of the occupant probably present in the predetermined area; and

the plurality of floodlight projectors are arranged more densely in the perpendicular direction than in the horizontal direction to cause the distribution of the intensity of the illumination light along the perpendicular direction to be uniform.

6. The state monitoring apparatus according to claim 1, further comprising:

a position determination section that determines whether or not a position where the face of the occupant is present is within the predetermined area; and

a brightness correcting section that performs correction control

to increase, when a result of determination at the position determination section reveals that the position where the face of the occupant is present is out of the predetermined area, a brightness value of each pixel in an area in the picture image corresponding to the position where the face of the occupant is present is increased to provide a picture image after the correction control,

wherein the picture image after the correction control by the brightness correcting section is taken as the picture image generated by the image pickup part.

7. The state monitoring apparatus according to claim 6,

wherein the brightness correcting section performs the correction control when the picture image is generated by the image pickup part.

8. The state monitoring apparatus according to claim 6,

wherein the brightness correcting section performs the correction control against the picture image that was generated by the image pickup part.

9. The state monitoring apparatus according to claim 1, further comprising:

a filter portion that is placed on a path of the illumination light from the light emission part to the predetermined area, the filter portion having a filter that lets through light having a wavelength including a near infrared wavelength; and

an incidence reduction part that reduces light incident on the image sensor through the filter portion.

10. The state monitoring apparatus according to claim 9,

wherein the incidence reduction part is an attenuating portion that is placed in the filter and attenuates the illumination light propagating in the filter.

11. The state monitoring apparatus according to claim 1, wherein

the optical control part includes

an incident part that collects the illumination light projected by the light emission part, and

a projecting part that performs, at a projecting surface, light distribution that projects the illumination light collected by the incident part to the space in the compartment

to cause the intensity of light incident on each pixel included in the image pickup predetermination area,

wherein the optical control part is an optical member including the projecting part that is connected to a connecting face that is a plane formed in the incident part.

12. A state monitoring apparatus mounted in a vehicle to monitor a state of an occupant who is a driver of the vehicle, comprising:

at least one light emission part that emits light to project illumination light having a wavelength including at least a near infrared wavelength to a predetermined area that is defined as an area where a face of the occupant being the driver of the vehicle is positioned in space in a compartment of the vehicle;

an image pickup part that generates a picture image by receiving light incident from the predetermined area with an image sensor having a plurality of pixels;

a state monitoring section that monitors a state of the occupant being the driver based on a result of processing the picture image generated by the image pickup part; and

an optical control part that includes

an incident part that collects the illumination light projected by the light emission part, and

a projecting part that performs, at a projecting surface, light distribution that projects the illumination light collected by the incident part to the space in the compartment

to cause an intensity of light incident on each pixel included in an image pickup predetermined area

to be equal to or greater than an intensity reference value predetermined as an intensity of light providing a picture image suitable for image processing by the state monitoring section and

to cause a distribution of the intensity of light incident on each pixel included in the image pickup predetermined area

to be within a predetermined first reference range, the image pickup predetermined area

being at least a part of a light receptive surface of the image sensor in the image pickup part and

corresponding to the predetermined area,

wherein the optical control part is an optical member including the projecting part that is connected to a connecting face that is a plane formed in the incident part.

13. The state monitoring apparatus according to claim 12,

wherein the projecting part performs light distribution

to cause the illumination light having a greater intensity

to arrive at a constituent point farther away from the light emission part among constituent points that are a plurality of fine areas included in a plane where the face of the occupant is probably present in the predetermined area.

14. The state monitoring apparatus according to claim 12,

wherein the predetermined area includes a center presence area where a central axis of the face of the occupant is probably positioned, and

wherein the projecting part performs the light distribution

to permit the center presence area

to have a distribution of the intensity of the illumination light along a perpendicular direction, the distribution being within a second reference range that is predetermined as a range providing the distribution to be uniform.

15. The state monitoring apparatus according to claim 14,

wherein the projecting part controls the light distribution

to cause the illumination light having a greater intensity

to arrive at an area closer to the center presence area, and

to cause the illumination light having a smaller intensity

to arrive at an area farther away from the center presence area in a horizontal direction.

16. The state monitoring apparatus according to claim 12,

wherein the projecting part includes a cylindrical lens placed on the connecting face, the cylindrical lens having

a cylindrical surface that is at least a part of the projecting surface and

an axial direction that is along a perpendicular direction of the vehicle.

17. The state monitoring apparatus according to claim 12,

wherein the projecting part includes at least one prism shaped of triangular pole and placed on the connecting face, the prism having a plurality of faces including

one face being at least a part of the projecting surface and

one face being an inclined plane inclined along a perpendicular direction.

18. The state monitoring apparatus according to claim 12,

wherein the projecting part includes:

a cylindrical lens placed on the connecting face,

the cylindrical lens having

a cylindrical surface being at least a part of the projecting surface and

an axial direction along a perpendicular direction of the vehicle; and

two prisms shaped of triangular pole and placed on the connecting face, each prism having a plurality of faces including

one face being at least a part of the projecting surface and

one face being an inclined plane inclined along a perpendicular direction,

wherein the two prisms are arranged to cause the cylindrical lens to be sandwiched between the two prisms.

19. The state monitoring apparatus according to claim 17,

wherein the inclined plane is inclined along a horizontal direction to have a height from the connecting face, the height being increased as it goes closer to a center of the projecting part.

20. The state monitoring apparatus according to claim 12,

wherein the incident part includes:

a salient part that is shaped of cone, permits part of illumination light from the light emission part to pass through, and guides part of illumination light having passed through to the projecting part;

a guiding part that is shaped of ring to surround the salient part circumferentially, the guiding part having a transmitting plane permitting part of illumination light from the light emission part to pass through; and

a reflecting part that is shaped of cylinder having

a diameter that is increased

from a plane where the salient part and the guiding part are extended

to the connecting face, and

a reflecting side face that reflects and guides at least part of the illumination light having passed through the transmitting plane of the guiding part to the projecting part.

21. The state monitoring apparatus according to claim 20,

wherein the reflecting side face of the reflecting part is shaped of a curved surface that totally reflects the illumination light having passed through the transmitting plane of the guiding part.

22. The state monitoring apparatus according to claim 12, further comprising:

a filter portion that is placed on a path of the illumination light from the light emission part to the predetermined area, the filter portion having a filter letting through the illumination light; and

a diffuser part that is placed between the optical control part and the filter portion and diffuses illumination light having passed through the optical control part.

23. An optical member used in a state monitoring apparatus that is mounted in a vehicle and includes

at least one light emission part that emits light to project illumination light having a wavelength including a near infrared wavelength to a predetermined area defined as an area where a face of an occupant of the vehicle is positioned in space in a compartment of the vehicle,

an image pickup part that generates a picture image by receiving light incident from the predetermined area with an image sensor having a plurality of pixels, and

a state monitoring section that monitors a state of the occupant based on a result of processing the picture image generated by the image pickup part,

the optical member comprising:

an incident part that collects illumination light emitted projected by the light emission part; and

a projecting part that performs, at a projecting surface, light distribution that projects the illumination light collected by the incident part to the space in the compartment, the projecting part being connected to a connecting face that is a plane formed in the incident part,

to cause an intensity of light incident on each pixel included in an image pickup predetermined area

to be equal to or greater than an intensity reference value predetermined as an intensity of light providing a picture image suitable for image processing by the state monitoring section and

to cause a distribution of the intensity of light incident on each pixel included in the image pickup predetermined area

to be within a predetermined first reference range,

the image pickup predetermined area

being at least a part of a light receptive surface of the image sensor in the image pickup part and

corresponding to the predetermined area.