HUMAN DETECTION APPARATUS AND METHOD

• US 20140177946A1
• Filed: 08/05/2013
• Published: 06/26/2014
• Est. Priority Date: 12/21/2012
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: LIM, Kil-Taek, CHUNG, Yun-Su, HAN, Byung-Gil, CHOI, Eun-Chang, LEE, Soo-In
• Application Number:
  US13/959,310
• Publication Number:
  US 20140177946A1
• Time in Patent Office: Days
• US Class Current: 382/156
• CPC Class Codes: G06V 10/446 using Haar-like filters, e.g. using integral image techniques
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

Disclosed herein is an apparatus and method for detecting a person from an input video image with high reliability by using gradient-based feature vectors and a neural network. The human detection apparatus includes an image preprocessing unit for modeling a background image from an input image. A moving object area setting unit sets a moving object area in which motion is present by obtaining a difference between the input image and the background image. A human region detection unit extracts gradient-based feature vectors for a whole body and an upper body from the moving object area, and detects a human region in which a person is present by using the gradient-based feature vectors for the whole body and the upper body as input of a neural network classifier. A decision unit decides whether an object in the detected human region is a person or a non-person.

Claims

1. A human detection apparatus comprising:

an image preprocessing unit for modeling a background image from an input image;

a moving object area setting unit for setting a moving object area in which motion is present by obtaining a difference between the input image and the background image;

a human region detection unit for extracting gradient-based feature vectors for a whole body and an upper body from the moving object area, and detecting a human region in which a person is present by using the gradient-based feature vectors for the whole body and the upper body as input of a neural network classifier; and

a decision unit for deciding whether an object in the detected human region is a person or a non-person.

2. The human detection apparatus of claim 1, wherein the human region detection unit comprises:

a gradient map generation unit for converting an image in the moving object area into a gradient map;

a normalized gradient map generation unit for normalizing the gradient map; and

a determination unit for extracting feature vectors for a whole body and an upper body of a person from the normalized gradient map generated by the normalized gradient map generation unit, and determining the human region based on the feature vectors.

3. The human detection apparatus of claim 2, wherein the gradient map generation unit generates the gradient map using the following Equation (1):

4. The human detection apparatus of claim 2, wherein the normalized gradient map generation unit generates the normalized gradient map using the following Equation (2):

5. The human detection apparatus of claim 2, wherein the determination unit comprises:

a feature vector extraction unit for applying a search window to the normalized gradient map, and individually extracting the feature vectors for the whole body and the upper body of the person from respective locations of a scanned search window while scanning the search window; and

a classification unit for generating detection scores for the respective locations of the search window by using the feature vectors for the whole body and the upper body of the person extracted from the respective locations of the search window as the input of the neural network classifier, and determining a location of the search window having a highest detection score to be a region in which a person is present.

6. The human detection apparatus of claim 5, wherein the classification unit sets a sum of a whole body detection score and an upper body detection score generated for each location of the search window as a detection score of a corresponding location of the search window.

7. The human detection apparatus of claim 5, wherein:

the neural network classifier comprises a whole body neural network classifier and an upper body neural network classifier, and

the classification unit uses feature vectors for the whole body of the person extracted from the respective locations of the search window as input of the whole body neural network classifier, and uses feature vectors for the upper body of the person extracted from the respective locations of the search window as input of the upper body neural network classifier.

8. The human detection apparatus of claim 7, wherein the decision unit comprises a final neural network classifier for receiving the whole body neural network feature vectors from the whole body neural network classifier and the upper body neural network feature vectors from the upper body neural network classifier as input.

9. The human detection apparatus of claim 8, wherein the decision unit finally decides that a person has been detected if a difference between an output value of an output node corresponding to a person and an output value of an output node corresponding to a non-person in the final neural network classifier exceeds a threshold value.

10. A human detection method comprising:

modeling, by an image preprocessing unit, a background image from an input image;

setting, by a moving object area setting unit, a moving object area in which motion is present by obtaining a difference between the input image and the background image;

extracting, by a human region detection unit, gradient-based feature vectors for a whole body and an upper body from the moving object area;

detecting, by the human region detection unit, a human region in which a person is present by using the gradient-based feature vectors for the whole body and the upper body as input of a neural network classifier; and

deciding, by a decision unit, whether an object in the detected human region is a person or a non-person.

11. The human detection method of claim 10, wherein extracting the feature vectors comprises:

converting an image in the moving object area into a gradient map;

normalizing the gradient map; and

extracting the feature vectors for the whole body and the upper body of the person from the normalized gradient map.

12. The human detection method of claim 11, wherein the gradient map is generated by the following Equation (1):

13. The human detection method of claim 11, wherein the normalized gradient map is generated by the following Equation (2):