Human detection method and apparatus

• US 7,486,826 B2
• Filed: 07/09/2007
• Issued: 02/03/2009
• Est. Priority Date: 12/06/2002
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Tae-kyun, Sung, Young-hoon
• Primary Examiner(s): Bella; Matthew C.
• Assistant Examiner(s): RAHMJOO, MANUCHER
• Application Number:
  US11/822,678
• Publication Number:
  US 20070258646A1
• Time in Patent Office: 575 Days
• Field of Search: 382/191, 382/103, 382/167, 382/165, 382/117, 382/173
• US Class Current: 382/191
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/167 using comparisons between temporally consecutive images

Abstract

A human detection method and apparatus are provided. In the method, a person is detected from an image provided by a digital video camera. The method includes (a) initializing parameters used for a user detection; (b) determining a current mode; (c) when it is determined that the current mode is the face detection mode, performing a face detection on each of a plurality of image frames, and when a face is not detected even after a predetermined number of face detection trials, selecting a motion detection mode and going back to step (b); and (d) when it is determined that the current mode is the motion detection mode, performing a motion detection on a predetermined number of image frames at a time, and when at least a predetermined number of motion detections are performed successfully within a predetermined period of time, going back to step (a).

Claims

1. A method of detecting a motion from an image provided by a digital video camera, the method comprising:

(e1) receiving a predetermined number of image frames;

(e2) detecting a motion in the image frames using the temporal edge detection algorithm and variance of pixel values with respect to time; and

(d4) when it is determined that a motion has been detected, storing the image;

wherein step (e2) comprises;

(e20) detecting pixels by finding zero crossings of a Laplacian with respect to time using the predetermined number of image frames, wherein the predetermined number of image frames is classified into two groups such that a first group is f(t₁) through f(t<sub>2m−

1</sub>) and a second group is f(t₂) through f(t_2m), and the Laplacian is obtained with respect to time of the two groups;

(e22) calculating the variance of pixel values with respect to time using the two groups of the predetermined number of image frames; and

(e24) determining whether the variance calculated for each zero crossing pixel of the Laplacian is equal to or greater than a predetermined value, and determining that a detected pixel whose variance is equal to or greater than the predetermined value is a motion pixel.

2. The method of claim 1, wherein when 2m image frames are received and “

n”

pixels exist in each image frame, step (e20) comprises;

(e200) multiplying each of f(t₁) through f(t<sub>2m−

1</sub>) in a group of image frames by a predetermined weight and then averaging the results of multiplication to obtain ∇

²f(t_m);

(e202) multiplying each of f(t₂) through f(t_2m) in another group of image frames by a predetermined weight and then averaging the results of multiplication to obtain ∇

²f(t_m+1); and

(e204) determining a pixel of interest as a zero crossing pixel when ∇

²f(t_m) is negative and ∇

²f(t_m+1) is positive or when ∇

²f(t_m) is positive and ∇

₂f(t_m+1) is negative,

wherein f(t₁) through f(t_2m) denote pixel values of the pixel of interest under processing, and steps (e200) through (e204) are repeated “

n”

times.

3. The method of claim 1, wherein step (e3) comprises determining whether the number of pixels determined as motion pixels in step (e2) is equal to or greater than a predetermined value and determining that a motion has been detected when it is determined that the number of motion pixels is at least the predetermined value.

4. The method of claim 1, further comprising performing a Gaussian filtering on the received image frames to smooth the image frames before step (e20).

5. An apparatus of detecting a motion from an image provided by a digital video camera, the apparatus comprising:

means for receiving a predetermined number of image frames;

means for detecting a motion in the image frames using the temporal edge detection algorithm and variance of pixel values with respect to time; and

means for storing the image when it is determined that a motion has been detected;

wherein the means for detecting a motion in the photographed image comprises;

means for detecting pixels by finding zero crossings of a Laplacian with respect to time using the predetermined number of image frames, wherein the predetermined number of image frames is classified into two groups such that a first groups is f(t₁) through f(t<sub>2m−

1</sub>) and a second group is f(t₂) through f(t_2m), and the Laplacian is obtained with respect to time of the two groups;

means for calculating the variance of pixel values with respect to time using the predetermined number of image frames; and

means for determining whether the variance calculated for each zero crossing pixel of the Laplacian is equal to or greater than a predetermined value, and determining that a detected pixel whose variance is equal to or greater than the predetermined value is a motion pixel.

6. The apparatus of claim 5, wherein the means for detecting pixels by finding zero crossings of the Laplacian with respect to pixel coordinates and time comprises:

means for multiplying each of f(t₁) through f(t<sub>2m−

1</sub>) in a group of image frames by a predetermined weight and then averaging the results of multiplication to obtain Laplacian of f(t_m) with respect to time, i.e., ∇

₂f(t_m);

means for multiplying each of f(t₂) through f(t_2m) in another group of image frames by a predetermined weight and then averaging the results of multiplication to obtain Laplacian of f(t_m+1) with respect to time, i.e., ∇

²f(t_m+1); and

means for determining a pixel of interest as a zero crossing pixel when ∇

²f(t_m) is negative and ∇

²f(t_m+1)is positive or when ∇

²f(t_m) is positive and ∇

²f(t_m+1) is negative,

wherein 2m image frames are received, “

n”

pixels exist in each image frame, f(t₁) through f(t_2m) denote pixel values of the pixel of interest under processing, and operations of the above three means are repeated “

n”

times.

7. The apparatus of claim 5, wherein the means for determining whether a motion has been detected comprises a means for determining whether the number of pixels determined as motion pixels is equal to or greater than a predetermined value and determining that a motion has been detected when it is determined that the number of motion pixels is equal to or greater than the predetermined value.

8. The apparatus of claim 5, further comprising a means for performing a Gaussian filtering on the received image frames to smooth the image frames and transmitting the smoothed image frames to the means for detecting a motion in the photographed image.

9. A method of detecting a motion from an image provided by a digital video camera, the method comprising:

(e1) receiving a predetermined number of image frames;

(e2) detecting a motion in the image frames using the temporal edge detection algorithm and variance of pixel values with respect to time; and

(d4) when it is determined that a motion has been detected, storing the image;

wherein step (e2) comprises;

(e20) detecting pixels by finding temporal image intensity changes using the predetermined number of image frames, wherein the predetermined number of image frames is classified into two groups such that a first group is f(t₁) through f(t<sub>2m−

1</sub>) and a second group is f(t₂) through f(t_2m), and the Larlacian is obtained with respect to time of the two groups;

(e22) calculating the variance of pixel values with respect to time using the predetermined number of image frames; and

(e24) determining whether the variance calculated for each of the detected pixels is equal to or greater than a predetermined value, and determining that a detected pixel whose variance is equal to or greater than the predetermined value is a motion pixel.

10. The method of claim 9, wherein the temporal image intensity changes are found by zero crossings of a Laplacian.

11. The method of claim 9, wherein when 2m image frames are received and “

n”

pixels exist in each image frame, step (e20) comprises;

(e200) multiplying each of f(t₁) through f(t<sub>2m−

1</sub>) in a group of image frames by a predetermined weight and then averaging the results of multiplication to obtain ∇

²f(t_m);

(e202) multiplying each of f(t₂) through f(t_2m) in another group of image frames by a predetermined weight and then averaging the results of multiplication to obtain ∇

²f(t_m+1); and

(e204) determining a pixel of interest as a zero crossing pixel when ∇

²f(t_m) is negative and ∇

²f(t_m+1) is positive or when ∇

²f(t_m) is positive and ∇

²f(t_m+1) is negative,

wherein f(t₁) through f(t_2m) denote pixel values of the pixel of interest under processing, and steps (e200) through (e204) are repeated “

n”

times.

12. The method of claim 9, wherein step (e3) comprises determining whether the number of pixels determined as motion pixels in step (e2) is equal to or greater than a predetermined value and determining that a motion has been detected when it is determined that the number of motion pixels is at least the predetermined value.

13. The method of claim 9, further comprising performing a Gaussian filtering on the received image frames to smooth the image frames before step (e20).

14. An apparatus of detecting a motion from an image provided by a digital video camera, the apparatus comprising:

means for receiving a predetermined number of image frames;

means for detecting a motion in the image frames using the temporal edge detection algorithm and variance of pixel values with respect to time; and

means for storing the image when it is determined that a motion has been detected;

wherein the means for detecting a motion in the photographed image comprises;

means for detecting pixels by finding temporal image intensity changes using the predetermined number of image frames, wherein the predetermined number of image frames is classified into two groups such that a first group is f(t₁) through f(t<sub>2m−

1</sub>) and a second group is f(t₂) through f(t_2m), and the Laplacian is obtained with respect to time of the two groups;

means for calculating the variance of pixel values with respect to time using the predetermined number of image frames; and

means for determining whether the variance calculated for each of the detected pixels is equal to or greater than a predetermined value, and determining that a detected pixel whose variance is equal to or greater than the predetermined value is a motion pixel.

15. The method of claim 14, wherein the temporal image intensity changes are found by zero crossings of a Laplacian.

16. The apparatus of claim 15, wherein the means for detecting pixels by finding zero crossings of the Laplacian with respect to pixel coordinates and time comprises:

means for multiplying each of f(t₁) through f(t<sub>2m−

1</sub>) in a group of image frames by a predetermined weight and then averaging the results of multiplication to obtain Laplacian of f(t_m) with respect to time, i.e., ∇

²f(t_m);

means for multiplying each of f(t₂) through f(t_2m) in another group of image frames by a predetermined weight and then averaging the results of multiplication to obtain Laplacian of f(t_m+1) with respect to time, i.e., ∇

²f(t_m+1); and

means for determining a pixel of interest as a zero crossing pixel when ∇

²f(t_m) is negative and ∇

²f(t_m+1)is positive or when ∇

²f(t_m) is positive and ∇

²f(t_m+1) is negative,

wherein 2m image frames are received, “

n”

pixels exist in each image frame, f(t₁) through f(t_2m) denote pixel values of the pixel of interest under processing, and operations of the above three means are repeated “

n”

times.

17. The apparatus of claim 14, wherein the means for determining whether a motion has been detected comprises a means for determining whether the number of pixels determined as motion pixels is equal to or greater than a predetermined value and determining that a motion has been detected when it is determined that the number of motion pixels is equal to or greater than the predetermined value.

18. The apparatus of claim 14, further comprising a means for performing a Gaussian filtering on the received image frames to smooth the image frames and transmitting the smoothed image frames to the means for detecting a motion in the photographed image.