Apparatus and method for controlling airbag

• US 10,131,309 B2
• Filed: 11/21/2016
• Issued: 11/20/2018
• Est. Priority Date: 05/16/2016
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Kim, Seon A
• Primary Examiner(s): Black, Thomas G
• Assistant Examiner(s): Smith-Stewart, Demetra R
• Application Number:
  US15/356,986
• Publication Number:
  US 20170327069A1
• Time in Patent Office: 729 Days
• Field of Search: None
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2011/0003 inside the vehicle
• CPC Class Codes: B60R 2021/01286 Electronic control units
• CPC Class Codes: B60R 21/0136 responsive to actual contact with an obstacle , e.g. to vehicle deformation, bumper displacement or bumper velocity relative to the vehicle monitoring crash strength in combination with passenger seat detection B60R21/01558
• CPC Class Codes: B60R 21/01538 for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: B60R 21/01552 detecting position of specific human body parts, e.g. face, eyes or hands
• CPC Class Codes: B60R 21/263 using a variable source, e.g. plural stage or controlled output hybrid inflators B60R21/272
• CPC Class Codes: G06V 10/28 Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
• CPC Class Codes: G06V 10/507 Summing image-intensity values; Histogram projection analysis
• CPC Class Codes: G06V 20/593 Recognising seat occupancy
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships

Abstract

An apparatus and a method for controlling an airbag are provided. The apparatus includes an imaging device that includes cameras and lights and an image processor that performs an image processing for an image obtained by the imaging device. A collision sensor senses a collision of a vehicle and an airbag driver operates the airbag. A controller extracts face information of a passenger from the image of which the image processing is performed by the image processor, determines airbag control information based on the extracted face information, and then operates the airbag driver based on the determined airbag control information when the collision of the vehicle is predicted.

Claims

1. An apparatus for controlling airbags, comprising:

an imaging device including one or more cameras and one or more lights;

an image processor configured to perform an image processing for an image obtained by the imaging device;

a collision sensor configured to sense a collision of a vehicle;

an airbag driver configured to operate the airbags; and

a controller configured to extract face information of a passenger from the image of which the image processing is performed by the image processor, determine airbag control information based on the extracted face information, and operate the airbag driver based on the determined airbag control information when the collision of the vehicle is predicted,

wherein the airbag driver selectively unfolds the airbags under the control of the controller, and

wherein the face information includes whether the passenger wears the glasses, and

wherein the airbag control information includes an unfolding angle, an unfolding pressure, and an unfolding speed of the airbags.

2. The apparatus according to claim 1, wherein the imaging device is implemented by a driver state monitoring (DSM) apparatus.

3. The apparatus according to claim 1, wherein the controller is configured to perform one or more camera calibrations when the imaging device is mounted within the vehicle and when the imaging device includes two or more cameras.

4. The apparatus according to claim 1, wherein the face information includes a face position, and a distance between the camera and a face.

5. The apparatus according to claim 1, wherein the image processor is configured to convert the obtained image into a binarization image and remove noise using a mask.

6. The apparatus according to claim 5, wherein the image processor is configured to perform a binarization processing for the image obtained by the imaging device when the passenger is not detected on a seat to generate the mask, and store the generated mask in a memory.

7. The apparatus according to claim 6, wherein when a mounting position and angle of the imaging device are adjusted, the image processor is configured to capture an image of inside the vehicle when no passenger is detected and perform the binarization processing for the photographed image to generate the mask, and update a previous mask stored in the memory.

8. The apparatus according to claim 1, wherein the controller is configured to determine whether the passenger wears glasses based on whether a lighting reflection point having a reference size or greater is detected within the obtained image.

9. A method for controlling airbags, comprising:

obtaining, by an imaging device, an image;

extracting, by a controller, face information of a passenger from the obtained image;

determining, by the controller, airbag control information based on the face information;

sensing, by the collision sensor, a collision of a vehicle after the determining of the airbag control information; and

unfolding, by the controller, the airbags based on the airbag control information when the collision of the vehicle is sensed,

wherein the controller selectively unfolds the airbags,

wherein the face information includes whether the passenger wears glasses, and

wherein the airbag control information includes an unfolding angle, an unfolding pressure, and an unfolding speed of the airbags.

10. The method according to claim 9, further comprising:

performing, by the controller, a camera calibration before the obtaining of the image, when the imaging device includes two or more cameras.

11. The method according to claim 9, wherein the extracting of the face information includes:

confirming, by the controller, a face position within the obtained image; and

confirming, by the controller, whether the passenger wears glasses from the obtained image.

12. The method according to claim 11, wherein the confirming of the face position includes:

converting, by an image processor, the obtained image into a binarization image;

removing, by the image processor, noise within the binarization image using a designated mask; and

detecting, by the controller, the face position by calculating a column accumulation graph and a row accumulation graph for the binarization image from which the noise is removed.

13. The method according to claim 11, further comprising:

calculating, by the controller, a distance between a camera and a face of the passenger after detecting the face position.

14. The method according to claim 11, wherein whether the passenger wears the glasses is detected using a lighting reflection point detected within the obtained image.