Image recognition audience measurement system and method

• US 4,858,000 A
• Filed: 09/14/1988
• Issued: 08/15/1989
• Est. Priority Date: 09/14/1988
• Status: Expired due to Term

• Current Assignee: Nielsen Media Research, Inc. (Nielsen Holdings plc)
• Original Assignee: A. C. Nielsen Company, LLC (MOOD Media Corporation)
• Inventors: Lu, Daozheng
• Primary Examiner(s): NOT, DEFINED
• Application Number:
  US07/244,916
• Time in Patent Office: 335 Days
• Field of Search: 358/84, 379/92, 455/2, 382/2, 382/19, 382/23, 340/825.31, 340/825.34, 340/825.49
• US Class Current: 725/12
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: H04H 60/45 for identifying users
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00
• CPC Class Codes: H04N 19/20 using video object coding
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 7/17309 Transmission or handling of upstream communications

Abstract

An image recognition method and system are provided for identifying predetermined individual members of a viewing audience in a monitored area. A pattern image signature is stored corresponding to each predetermined individual member of the viewing audience to be identified. An audience scanner includes audience locating circuitry for locating individual audience members in the monitored area. A video image is captured for each of the located individual audience members in the monitored area. A pattern image signature is extracted from the captured image. The extracted pattern image signature is compared with each of the stored pattern image signatures to identify a particular one of the predetermined audience members. These steps are repeated to identify all of the located individual audience members in the monitored area.

Claims

1. An image recognition system for identifying predetermined individual members of a viewing audience in a monitored area:

means for storing a plurality of pattern image signatures, each of said pattern image signatures corresponding to one of the predetermined individual members;

means for locating individual members in the monitored area;

means for capturing an image of each of said located individual members in the monitored area;

means for comparing each of said captured images with said stored pattern image signatures to identify each of the predetermined individual members.

2. An image recognition system as recited in claim 1 wherein said means for locating the individual members includes an infrared detector for providing a temperature representative signal of the monitored area.

3. An image recognition system as recited in claim 2 further comprising processing means for processing said temperature representative signal to provide a direction signal.

4. An image recognition system as recited in claim 3 wherein said means for locating the individual members further includes ultrasonic means responsive to said direction signal for providing a distance signal.

5. An image recognition system as recited in claim 4 wherein said ultrasonic means include means for transmitting an ultrasonic pulse echo signal, means for detecting a reflected pulse echo signal, and means for processing said detected pulse echo signal for providing said distance signal.

6. An image recognition system as recited in claim 2 wherein said means for locating the individual members further includes scanner means for scanning the monitored area providing angular rotation of said infrared detector in a plane to provide said temperature representative signal of the monitored area.

7. An image recognition system as recited in claim 1 wherein said image capturing means includes an infrared video camera for providing a video image signal.

8. An image recognition system as recited in claim 7 wherein said comparing means includes:

means for processing each said captured video image to provide a digitized image signal; and

means for extracting a pattern signature from said digitized image signal.

9. An image recognition system as recited in claim 8 wherein said digitized image signal comprises a digitized gray level image.

10. An image recognition system as recited in claim 8 wherein said digitized image signal comprises a thresholding binary image.

11. An image recognition system as recited in claim 8 wherein said pattern signature extracting means includes:

means for defining a plurality of predefined feature positions from said digitized image signal;

means for identifying a feature value for each of said plurality of predefined feature positions; and

means for identifying a memory location corresponding to said identified feature value for each of a plurality of predefined feature positions.

12. An image recognition system as recited in claim 11 wherein said comparing means further includes:

means for calculating a number of matching memory locations with each of said pattern image signatures; and

means for identifying a match responsive to said calculated number greater than a predetermined threshold value.

13. An image recognition system as recited in claim 12 wherein said comparing means further includes:

means for identifying a highest matching value to identify each of the predetermined audience members.

14. An image recognition system as recited in claim 1 further comprising covert illumination means for illuminating the monitored area.

15. An image recognition system as recited in claim 14 wherein said covert illumination means include at least one infrared illuminator.

16. A method of identifying predetermined individual members of a viewing audience in a monitored area:

storing a plurality of pattern image signatures, each of said pattern image signatures corresponding to one of the predetermined individual members;

scanning the monitored area and generating a temperature representative signal of the monitored area;

processing said generated temperature representative signal and providing individual members direction signals;

capturing a video image responsive to each of said individual members direction signals in the monitored area;

sequentially comparing each said captured video image with each of said stored pattern image signatures to identify each of the predetermined individual members.

17. A method as recited in claim 16 wherein said step of sequentially comparing includes the steps of:

processing each said captured video image to provide a digitized image signal;

extracting a pattern image signature from each said digitized image; and

comparing each said extracted signature with each of said stored pattern image signatures.

18. A method as recited in claim 17 wherein said steps of extracting and comparing said extracted signature includes the steps of:

identifying a feature value for each of a plurality of predefined feature positions from said digitized image signal;

identifying and comparing a memory location corresponding to said identified feature value for each of said plurality of predefined feature positions with each of said stored pattern image signatures;

calculating the number of matching memory locations for each of said stored pattern image signatures; and

identifying a match responsive to said calculated number greater than a predetermined threshold value.

19. A method as recited in claim 18 further comprising the step of identifying a highest matching value of said identified matching signatures to identify each of the predetermined individual members.

20. A method as recited in claim 16 wherein said steps of storing said plurality of pattern image signatures includes the steps of:

providing a plurality of distinct pattern image signature memory spaces for storing each of said pattern image signatures;

capturing a first video image of each of the predetermined individual members;

sequentially processing each said first captured video image to provide a digitized image signal;

identifying a feature value from each said digitized image signal for each of a plurality of predefined feature positions;

identifying a memory location corresponding to each said identified feature value for each of a plurality of predefined feature positions; and

storing a binary digit one in said identified memory locations in the pattern image signature memory space corresponding to a sequential one of the predetermined individual members.

21. A method as recited in claim 20 further comprising capturing at least one subsequent video image of each predetermined individual member and sequentially repeating the processing, identifying and storing steps for each captured video image.

22. An image recognition system for identifying predetermined individual members of a viewing audience in a monitored area:

memory means for storing a plurality of pattern image signatures, each of said pattern image signatures corresponding to one of the predetermined individual members;

scanner means for scanning the monitored area;

infrared sensing means carried by said scanner for providing a temperature representative signal of the monitored area;

means responsive to said temperature representative signal for generating a direction signal for each located individual member in the monitored area;

infrared video camera means carried by said scanner means and responsive to said direction signal for capturing an image of each of said located individual members in the monitored area;

means for comparing each said captured image with said stored pattern image signatures to identify each of said located individual members of the predetermined individual members.

23. An image recognition system as recited in claim 22 further comprising:

ultrasonic detecting means carried by said scanner means and responsive to said direction signal for each located individual member for transmitting an ultrasonic pulse signal and for detecting a reflected ultrasonic echo signal;

means responsive to said detected ultrasonic echo signal for generating a distance signal; and

wherein said infrared video camera means is responsive to said distance signal for capturing said image of each of said located individual members in the monitored area.

24. An image recognition system as recited in claim 22 further comprising:

infrared illumination means carried by said scanner means and responsive to said direction signal for illuminating said located individual member in the monitored area.

25. An image recognition system as recited in claim 22 wherein said comparing means includes:

means for processing said captured video image to provide a digitized image signal; and

means for extracting a pattern signature from said digitized image signal.

26. An image recognition system as recited in claim 25 wherein said pattern signature extracting means includes:

means for defining a plurality of predefined feature positions from said digitized image signal;

means for identifying a feature value for each of said plurality of predefined feature positions; and

means for identifying a memory location corresponding to said identified feature value for each of a plurality of predefined feature positions.

27. An image recognition system as recited in claim 26 further includes:

means for sequentially comparing said identified memory locations with each of said stored pattern image signatures;

means for calculating a number of matching memory locations with each of said pattern image signatures; and

means for identifying a match responsive to said calculated number greater than a predetermined threshold value.