METHOD AND DEVICE FOR RECOGNIZING PEDESTRIAN AND VEHICLE SUPPORTING THE SAME

• US 20150161796A1
• Filed: 06/19/2014
• Published: 06/11/2015
• Est. Priority Date: 12/09/2013
• Status: Abandoned Application

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Kim, Jae Kwang, Kim, Jin Hak, Lee, Wan Jae, Lee, Kang Hoon, Choi, Eun Jin
• Application Number:
  US14/309,146
• Publication Number:
  US 20150161796A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: H04N 23/20 for generating image signals from infrared radiation only
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A method and a device for recognizing a pedestrian and a vehicle supporting the same are provided. The method includes collecting, by a controller, a far-infrared image using a far-infrared imaging device and detecting a pedestrian candidate group from the far-infrared image. In addition, the method includes extracting, by the controller, pedestrian features based on previously normalized pedestrian database (DB) learning and comparing the pedestrian features with the pedestrian DB learning results to determine similarity. The controller is configured to perform pedestrian recognition based on the comparison result.

Claims

1. A device for recognizing a pedestrian, the device comprising:

a far-infrared imaging device configured to collect a far-infrared image of a predetermined area; and

a controller configured to;

detect a pedestrian candidate group from the far-infrared image; and

draw and compare pedestrian features based on primary features among features detected by a classifier, while learning normalized pedestrian database (DB), to perform pedestrian detection.

2. The device according to claim 1, wherein the controller is configured to perform pedestrian candidate group detection based on temperature information and object information in the far-infrared image.

3. The device according to claim 1, wherein the controller is configured to determine a surrounding area of the pedestrian candidate group detected from the far-infrared image, and normalize the surrounding area of the pedestrian candidate group to have a size of a pedestrian area in the normalized pedestrian DB.

4. The device according to claim 3, wherein the controller is configured to normalize the surrounding area of the pedestrian candidate group to have a size with a ratio of 1:

2 of width and height.

5. The device according to claim 1, wherein the controller is configured to apply an Adv_HOG scheme in which the pedestrian candidate group area is divided into square blocks adjustable in size and an angle range of 360 degrees is divided into nine bins to express angles, or apply a local binary pattern (LBP) scheme in which a value obtained by pattern changes in a currnent pixel value and a neighbor pixel value is applied to each block having adjustable size in the pedestrian candidate group area to configure a histogram to draw features.

6. The device according to claim 1, wherein the controller is configured to perform clustering on an area in which objects overlap in the pedestrian detection result image to determine whether a single pedestrian is present or a plurality of pedestrians are present.

7. A vehicle supporting a pedestrian recognition function, the vehicle comprising:

a far-infrared imaging device configured to collect a far-infrared image of a predetermined area;

a controller configured to;

detect a pedestrian candidate group from the far-infrared image; and

draw and compare pedestrian features based on primary features among features detected by a classifier, while learning normalized pedestrian database (DB), to perform pedestrian detection; and

an information output device configured to output the pedestrian detection result.

8. The vehicle according to claim 7, wherein the controller is configured to perform pedestrian candidate group detection based on of temperature information and object information in the far-infrared image, determines a surrounding area of the pedestrian candidate group detected from the far-infrared image, and normalize the surrounding area of the pedestrian candidate group to match the surrounding area to a size of a pedestrian area in the normalized pedestrian DB, and have a size having a ratio of 1:

2 of width and height.

9. The vehicle according to claim 7, wherein the controller is configured to apply an Adv_HOG scheme in which the pedestrian candidate group area is divided into square blocks adjustable in size and an angle range of 360 degrees is divided into nine bins to express angles, or apply a local binary pattern (LBP) scheme in which a value obtained by pattern changes in a current pixel value and a neighbor pixel value is applied to each block having adjustable size in the pedestrian candidate group area to configure a histogram to draw features.

10. The vehicle according to claim 7, wherein the controller is configured to perform clustering on an area in which objects overlap in the pedestrian detection result image to determine whether a single pedestrian is present or a plurality of pedestrians are present.

11. The vehicle according to claim 7, wherein the information output device includes at least one of a group consisting of:

an audio device configured to output an alarm sound based on at least one of a distance between the pedestrian and a vehicle and a position of the pedestrian and a video device configured to output the pedestrian detection image.

12. The vehicle according to claim 7, further comprising:

at least one of a group consisting of;

a timer configured to determine a time at which the pedestrian recognition function is automatically applied;

an luminance sensor configured to detect ambient intensity of illumination to automatically apply the pedestrian recognition function; and

a temperature sensor configured to detect ambient temperature to automatically apply the pedestrian recognition function.

13. A method for recognizing a pedestrian, the method comprising:

collecting, by a controller, a far-infrared image captured by a far-infrared imaging device;

detecting, by the controller, a pedestrian candidate group from the far-infrared image;

extracting, by the controller, pedestrian features based on previously normalized pedestrian database (DB) learning;

comparing, by the controller, the pedestrian features with the pedestrian DB learning results to determine similarity; and

performing, by the controller, pedestrian recognition based on the comparison result.

14. The method according to claim 13, wherein the detecting includes performing, by the controller, the pedestrian candidate group detection based on temperature information and object information from the far-infrared image.

15. The method according to claim 13, further comprising:

determining, by the controller, a surrounding area of the pedestrian candidate group detected from the far-infrared image; and

normalizing, by the controller, the surrounding area of the pedestrian candidate group such to correspond to a size of a pedestrian area in a normalized pedestrian database and have a size with a ratio of 1;

2 in width and length.

16. The method according to claim 13, wherein the feature extraction includes:

extracting, by the controller, primary features among features drawn by a classifier during the database learning.

17. The method according to claim 16, wherein the feature extraction includes at least one of:

applying by the controller, an Adv_HOG scheme in which the pedestrian candidate group region is divided into square blocks adjustable in size and an angle range of 360 degrees is configured as 9 bins to express angles; and

applying, by the controller, a local binary pattern (LBP) scheme in which a value obtained by patterning changes in a current pixel value and a neighbor pixel value is applied to each block having adjustable size in the pedestrian candidate group area to configure a histogram to draw features.

18. The method according to claim 13, further comprising:

determining, by the controller, whether a single pedestrian is present or a plurality of pedestrians are present with respect to an area in which detection objects overlap in the pedestrian detection result image.

19. The method according to claim 13, further comprising at least one of:

outputting, by the controller, an alarm sound based on at least one of a distance between a pedestrian and a vehicle and a position of the pedestrian; and

outputting, by the controller, the pedestrian detection image.

20. The method according to claim 13, further comprising at least one of:

automatically applying, by the controller, the pedestrian recognition function when a pre-set time is reached;

automatically applying, by the controller, the pedestrian recognition function when an luminance sensor value is less than or grater than a predetermined value; and

automatically applying, by the controller, the pedestrian recognition function when a temperature sensor value is less than or greater than a predetermined value.