System, method and article of manufacture for tracking a head of a camera-generated image of a person

• US 7,715,476 B2
• Filed: 04/21/2005
• Issued: 05/11/2010
• Est. Priority Date: 07/30/1999
• Status: Expired due to Term

• Current Assignee: DigiMedia Tech, LLC (IP Investments Group LLC)
• Original Assignee: Electric Planet Interactive
• Inventors: Nguyen, Katerina H., Edwards, Jeffrey L.
• Primary Examiner(s): RAO, ANAND SHASHIKANT
• Application Number:
  US11/112,433
• Publication Number:
  US 20050185054A1
• Time in Patent Office: 1,846 Days
• Field of Search: 37524008-24017
• US Class Current: 375/240.08
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments

Abstract

A system, method and article of manufacture are provided for tracking a head portion of a person image in video images. Upon receiving video images, a first head tracking operation is executed for generating a first confidence value. Such first confidence value is representative of a confidence that a head portion of a person image in the video images is correctly located. Also executed is a second head tracking operation for generating a second confidence value representative of a confidence that the head portion of the person image in the video images is correctly located. The first confidence value and the second confidence value are then outputted. Subsequently, the depiction of the head portion of the person image in the video images is based on the first confidence value and the second confidence value.

Claims

1. A method performed by a computer for processing images to identify a head portion of a subject in the images comprising:

obtaining images of a subject;

generating, by the computer, a first confidence value representing a confidence that a first process has identified a location of a head portion of the subject in the images;

generating, by the computer, a second confidence value representing a confidence that a second, different process has identified the location of the head portion of the subject in the images; and

identifying, by the computer, the location of the head portion of the subject in the images based at least in part on the first confidence value and the second confidence value.

2. A method as recited in claim 1, wherein the first confidence value is based at least in part on information associated with a previously identified head portion.

3. A method as recited in claim 1, wherein the head portion is identified in the images based at least in part on a first head portion identified by the first process and a second head portion identified by the second process.

4. A method as recited in claim 1, wherein the head portion is based at least in part on a previously identified head portion.

5. A method as recited in claim 1, wherein the first process includes analyzing pixels within a search window, wherein the search window is created based on a previously identified head portion.

6. A method as recited in claim 1, wherein the first process includes:

identifying areas as possible head portions; and

ranking the areas based on their similarity to a predefined oval shape.

7. A method as recited in claim 1, wherein the first process includes identifying areas that are greater than a predefined size as possible head portions.

8. A method as recited in claim 1, wherein the first process includes:

identifying areas as possible head portions; and

selecting the head portion from the areas based at least in part on a plurality of factors, wherein a confidence value associated with an area is proportional to the number of factors the area satisfies.

9. A method as recited in claim 1, wherein the first process includes removing a background image from the obtained image.

10. A method as recited in claim 1, wherein the first process includes:

removing a background image from the obtained image to obtain a foreground image; and

identifying a person image in the foreground image.

11. A method as recited in claim 1, wherein the first process includes generating a mass distribution, wherein local maxima of the mass distribution are used to identify a person image.

12. A method as recited in claim 1, wherein the first process includes generating a mass distribution, wherein local maxima of the mass distribution in the context of a previously identified person image are used to identify a person image.

13. A method as recited in claim 1, wherein the first process includes identifying a point of separation between the head portion and a torso portion.

14. A method as recited in claim 1, wherein the first process includes:

in the event that the first confidence value is below a threshold, identifying an initial location of the head portion; and

identifying a current location of the head portion based at least in part on the initial location of the head portion.

15. A method as recited in claim 1, wherein the first process includes:

in the event that the first confidence value is below a threshold, identifying an initial location of the head portion based at least in part on motion detection; and

identifying a current location of the head portion based at least in part on the initial location of the head portion.

16. A method as recited in claim 1, wherein the first process includes:

in the event that the first confidence value is below a threshold, identifying an initial location of the head portion; and

identifying a current location of the head portion based at least in part on the initial location of the head portion and motion detection.

17. A method as recited in claim 1, wherein the first process includes:

in the event that the first confidence value is below a threshold, identifying an initial location of the head portion based at least in part on detection of a skin color; and

identifying a current location of the head portion based at least in part on the initial location of the head portion.

18. A method as recited in claim 1, wherein the first process includes:

in the event that the first confidence value is below a threshold, identifying an initial location of the head portion; and

identifying a current location of the head portion based at least in part on the initial location of the head portion and detection of a skin color.

19. A method as recited in claim 1, wherein the first process includes:

in the event that the first confidence value is below a threshold, identifying an initial location of the head portion; and

identifying a current location of the head portion based at least in part on the initial location of the head portion, including;

generating a three-dimensional color histogram associated with an area within the image; and

comparing the three-dimensional color histogram to a color model.

20. A method as recited in claim 1, wherein the first process includes:

in the event that the first confidence value is below a threshold, identifying an initial location of the head portion; and

identifying a current location of the head portion based at least in part on the initial location of the head portion, including;

generating a motion distribution map associated with an area within the image; and

identifying an area of motion using a motion histogram based on the motion distribution map.

21. A system for processing images to identify a head portion of a subject in the images comprising:

an interface configured to obtain images of a subject; and

a processor configured to identify a head portion of the subject in the images based at least in part on a first confidence value produced by a first process that analyzes the images to identify a location of the head portion of the subject in the images and a second confidence value produced by a second, different process that analyzes the images to identify the location of the head portion of the subject in the images.

22. A system as recited in claim 21, wherein:

the first confidence value represents a confidence that the first process has identified the location of the head portion of the subject in the images; and

the second confidence value represents a confidence that the second process has identified the location of the head portion of the subject in the images.

23. A system as recited in claim 21, wherein:

the first confidence value represents a confidence that a first process has identified the location of the head portion of the subject in the images;

the second confidence value represents a confidence that a second process has identified the location of the head portion of the subject in the images; and

the head portion of the subject is identified in the images based at least in part on the location of the head portion identified by the first process and the location of the head portion identified by the second process.

24. A system as recited in claim 21, wherein:

the first confidence value represents a confidence that a first process has identified the location of the head portion of the subject in the images;

the second confidence value represents a confidence that a second process has identified the location of the head portion of the subject in the images; and

the first process includes removing a background image from the obtained image.

25. A system as recited in claim 21, wherein:

the first confidence value represents a confidence that a first process has identified the location of the head portion of the subject in the images;

the second confidence value represents a confidence that a second process has identified the location of the head portion of the subject in the images; and

the first process includes generating a mass distribution, wherein local maxima of the mass distribution are used to identify a person image of the subject.

26. A system as recited in claim 21, wherein:

the first confidence value represents a confidence that a first process has identified the location of the head portion of the subject in the images;

the second confidence value represents a confidence that a second process has identified the location of the head portion of the subject in the images; and

the first process includes;

in the event that the first confidence value is below a threshold, identifying an initial location of the head portion; and

identifying a current location of the head portion based at least in part on the initial location of the head portion.

27. A computer-readable medium having instructions stored thereon that, if executed by a computing device, cause the computing device to process images to identify a head portion of a subject in the images by:

obtaining images of a subject;

generating a first confidence value representing a confidence that a first process has identified a location of a head portion of the subject in the images;

generating a second confidence value representing a confidence that a second, different process has identified the location of the head portion of the subject in the images; and

identifying the location of the head portion of the subject in the images based at least in part on the first confidence value and the second confidence value.

28. A computer-readable medium as recited in claim 27, wherein the instructions include instructions that cause the computing device to identify the head portion of the subject in the images based at least in part on the location of the head portion identified by the first process and the location of the head portion identified by the second process.

29. A computer-readable medium as recited in claim 27, wherein the instructions include instructions that cause the computing device to remove a background image from at least one of the obtained images with the first process.

30. A computer-readable medium as recited in claim 27, wherein the instructions include instructions that cause the computing device to generate a mass distribution with the first process, wherein local maxima of the mass distribution are used to identify a person image of the subject in the images.

31. A computer-readable medium as recited in claim 27, wherein the instructions cause the computing device to:

identify an initial location of the head portion in the event that the first confidence value is below a threshold; and

identify a current location of the head portion based at least in part on the initial location of the head portion.

32. A system for processing images to identify a head portion of a subject in the images comprising:

means for obtaining images of a subject; and

means for identifying a head portion of the subject in the images based at least in part on a first confidence value produced by a first process that analyzes the images to identify a location of the head portion of the subject in the images and a second confidence value produced by a second, different process that analyzes the images to identify the location of the head portion of the subject in the images.