Methods and apparatus to count people appearing in an image

• US 7,466,844 B2
• Filed: 10/11/2006
• Issued: 12/16/2008
• Est. Priority Date: 12/11/2002
• Status: Expired due to Term

• Current Assignee: Nielsen Company (US), LLC
• Original Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Inventors: Nelson, Daniel J., Ramaswamy, Arun, Srinivasan, Venugopal
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US11/548,578
• Publication Number:
  US 20070086623A1
• Time in Patent Office: 797 Days
• Field of Search: 382/103, 382/106, 382/107, 382/115, 382/100, 382/157, 382116-118, 382168-172, 382/203, 382/219, 382/232, 382/255, 382/260, 382/274, 382/276, 382/224, 382/123, 382/181, 382192-194, 382286-291, 382/305, 382/209, 348/239, 348/211.13, 348/154, 702/85
• US Class Current: 382/103
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: H04H 60/33 Arrangements for monitoring the users' behaviour or opinions

Abstract

Methods and apparatus to count people appearing in an image are disclosed. One disclosed method reduces objects appearing in a series of images to one or more blobs; for each individual image in a set of the images of the series of images, represents the one or more blobs in the individual image by one or more symbols in a histogram; and analyzes the symbols appearing in the histogram to count the people in the image.

Claims

1. A method of counting people appearing in a digital image comprising:

reducing objects appearing in a series of images to one or more blobs, each of the blobs corresponding to a respective center of motion of a corresponding one of the objects;

for each individual image in a set of the images of the series of images, representing the one or more blobs in the individual image by one or more symbols in a histogram; and

analyzing the symbols appearing in the histogram to count the people in the digital image.

2. A method as defined in claim 1 wherein reducing the objects appearing in the series of images to one or more blobs comprises creating the one or more blobs using a convex hull program.

3. A method as defined in claim 1 further comprising, if no symbols are added to a third symbol appearing in the histogram during a period in which a number of images are analyzed, removing the third symbol from the histogram.

4. A method as defined in claim 3 wherein analyzing the symbols appearing in the histogram to count the people in the digital image comprises, counting the symbols appearing in the histogram having a size greater than a threshold.

5. A method as defined in claim 1 wherein the series of images comprises a series of amalgamated images.

6. A method as defined in claim 5 wherein the series of amalgamated images are derived from a series of difference images, the series of difference images being derived from a sequence of original images including the digital image.

7. An apparatus to count people appearing in a digital image comprising:

a processor;

a memory storing computer readable instructions which, when executed, cause the processor to;

reduce objects appearing in a series of images to one or more blobs, each of the blobs corresponding to a respective center of motion of a corresponding one of the objects;

for each individual image in a set of the images of the series of images, represent the one or more blobs in the individual image by one or more symbols in a histogram; and

analyze the symbols appearing in the histogram to count the people in the image.

8. An apparatus as defined in claim 7 wherein the processor reduces the objects appearing in the series of images to one or more blobs by creating the one or more blobs using a convex hull program.

9. An apparatus as defined in claim 7 wherein, if no symbols are added to a third symbol appearing in the histogram during a period in which a number of images are analyzed, the processor removes the third symbol from the histogram.

10. An apparatus as defined in claim 9 wherein the processor analyzes the symbols appearing in the histogram to count the people in the digital image by counting the symbols appearing in the histogram having a size greater than a threshold.

11. An apparatus as defined in claim 7 wherein the series of images comprises a series of amalgamated images.

12. An apparatus as defined in claim 11 wherein the series of amalgamated images are derived from a series of difference images, the series of difference images being derived from a sequence of original images including the digital image.

13. A method of counting people appearing in a series of digital images comprising:

forming difference images by computing differences between sequential pairs of the digital images in the series of digital images, the difference images being indicative of motion;

combining a first set of the difference images into a first amalgamated image;

combining a second set of the difference images into a second amalgamated image;

reducing a first object appearing in the first amalgamated image to a first blob;

representing the first blob in the first amalgamated image by a first symbol in a histogram;

reducing a second object appearing in the second amalgamated image to a second blob;

representing the second blob in the second amalgamated image by adding a second symbol to the histogram; and

analyzing the histogram to count the people appearing in the series of images.

14. A method as defined in claim 13 wherein reducing the first object appearing in the first amalgamated image to the first blob comprises creating the first blob using a convex hull program.

15. A method as defined in claim 13 further comprising, if no symbols are added to the first symbol during a predetermined time period, removing the first symbol from the histogram.

16. A method as defined in claim 13, wherein representing the second blob in the second amalgamated image by adding the second symbol to the histogram comprises adding the second symbol to the first symbol in the histogram if the first and second symbols correspond to a same center of gravity.

17. A method as defined in claim 16 wherein analyzing the histogram to count the people comprises, counting any symbols appearing in the histogram having a size greater than a threshold.