Analysis method and system for audience rating and advertisement effects based on viewing behavior recognition

• US 8,887,186 B2
• Filed: 04/26/2013
• Issued: 11/11/2014
• Est. Priority Date: 08/17/2012
• Status: Active Grant

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Jeong, Young-Ho, Hong, Jin-Woo, Oh, Cheon-In, Lee, Han-Kyu
• Primary Examiner(s): NGUYEN BA, HOANG VU A
• Application Number:
  US13/871,635
• Publication Number:
  US 20140053173A1
• Time in Patent Office: 564 Days
• Field of Search: 725/12, 725/42, 705/14.41, 705/14.43, 705/14.49, 705/14.53, 705/14.66, 705/14.67, 707/732, 707/736, 707/738, 707/748, 707/749, 707/751
• US Class Current: 725/12
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06Q 30/0242 Determining effectiveness of advertisements
• CPC Class Codes: G06Q 30/0244 Optimization
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: G06Q 30/0255 based on user history
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 30/0271 Personalized advertisement
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

Provided are an analysis method and system for audience rating and advertisement effects based on viewing behavior recognition including a method of recognizing a viewer on the basis of image recognition through a camera and efficiently collecting data and a method of transmitting collected data on the basis of viewer recognition to an audience rating and advertisement effect measurement server. The present invention includes a viewing behavior measurement device configured to receive a viewer image obtained by imaging one or more viewers who are viewing broadcast content, recognize the one or more viewers from the received viewer image to generate viewing behavior information, and deliver the generated viewing behavior information, and an advertisement effect measurement server configured to analyze an advertisement effect for each viewer on the basis of the received viewing behavior information and generate and deliver an advertisement effect measurement result.

Claims

1. A viewing behavior measurement device comprising:

an information collection unit configured to check information about current broadcast content to generate broadcast content information;

a viewer recognition unit configured to receive a viewer image obtained by imaging one or more viewers who are viewing the broadcast content and recognize the one or more viewers from the received viewer image to generate viewer recognition information; and

a data processing unit configured to generate viewing behavior information about the one or more viewers using the viewer recognition information and the broadcast content information,

wherein the viewing behavior information indicates whether each of the one or more viewers concentrate on the current broadcast content or not,

wherein the data processing unit delivers the viewing behavior information in a selected method between a pull method and a push method.

2. The viewing behavior measurement device of claim 1, wherein the information collection unit is configured to receive viewer information from each of the viewers and deliver the viewer information to the data processing unit.

3. The viewing behavior measurement device of claim 1, wherein the data processing unit is configured not to store the viewing behavior information when there is no change in the viewing behavior information and configured to store the viewing behavior information when a change in the viewing behavior information occurs.

4. The viewing behavior measurement device of claim 1, wherein the data processing unit is configured to compare face regions of the one or more viewers with previously stored personal information using the received viewer recognition information to distinguish between a registered viewer whose information is contained in the stored personal information and an unregistered viewer whose information is not contained in the stored personal information and generate the viewer behavior information.

5. The viewing behavior measurement device of claim 1, wherein the data processing unit is configured to deliver the generated viewing behavior information only when a transmission condition predetermined according to received transmission type setting information is met.

6. The viewing behavior measurement device of claim 1, wherein the data processing unit is configured to find out gaze directions of the one or more viewers using the received viewer recognition information to distinguish between a viewer whose gaze direction is toward the broadcast content and a viewer whose gaze direction is not toward the broadcast content.

7. The viewing behavior measurement device of claim 6, wherein the data processing unit is configured to generate viewing behavior information about only the viewer whose gaze direction is toward the broadcast content.

8. The viewing behavior measurement device of claim 1, wherein the viewing behavior information includes at least one of the number of viewers, gaze directions of the viewers, the broadcast content information, and viewing positions of the viewers.

9. The viewing behavior measurement device of claim 1, wherein the viewing behavior information further includes synchronized time information about the viewer recognition information and the broadcast content information.

10. An advertisement effect measurement server comprising:

an advertisement effect analysis unit configured to distinguish between a registered viewer and an unregister viewer and distinguish between a viewer whose gaze direction is toward broadcast content and a viewer whose gaze direction is not toward the broadcast content on the basis of received viewing behavior information to analyze an advertisement effect for each one or more viewers and generate an advertisement effect measurement result; and

an advertisement effect transmission unit configured to deliver the advertisement effect measurement result to an external user,

wherein the viewing behavior information indicates whether each of the one or more viewers concentrate on the broadcast content or not,

wherein the advertisement effect transmission unit delivers the advertisement effect measurement result in a selected method between a pull method and a push method.

11. The advertisement effect measurement server of claim 10, wherein the advertisement effect analysis unit is configured to obtain a personal viewing time and audience rating of advertisement content in connection with viewer recognition information and broadcast content information contained in the received viewing behavior information.

12. The advertisement effect measurement server of claim 10, wherein the advertisement effect analysis unit is configured to synchronize the viewer recognition information with the broadcast content information using synchronized time information contained in the viewing behavior information.

13. A method of measuring viewing behavior, the method comprising:

setting a transmission type on the basis of received transmission type setting information;

recognizing viewing behavior from a viewer image input through an image input device;

storing viewing behavior information when the recognized viewing behavior changes; and

determining whether a predetermined transmission condition for data transmission is satisfied and, if the transmission condition is satisfied, delivering the recognized viewing behavior information,

wherein the viewing behavior information indicates whether each of one or more viewers concentrate on current broadcast content or not,

wherein the recognized viewing behavior information is delivered in a selected method between a pull method and a push method.

14. The method of claim 13, wherein the viewing behavior information includes at least one of the number of viewers, gaze directions of the viewers, broadcast content information, and viewing positions of the viewers.

15. The method of claim 13, wherein the transmission type setting information includes at least one of information about a method of transmitting the viewing behavior information only when data is requested and information about a method of transmitting the viewing behavior information only when the predetermined transmission condition is satisfied.

16. An analysis system for audience rating and advertisement effects based on viewing behavior recognition, the system comprising:

a viewing behavior measurement device configured to generate viewer recognition information from a viewer image obtained by imaging one or more viewers who are viewing broadcast content and generate viewing behavior information about the one or more viewers using the viewer recognition information to deliver the viewing behavior information; and

an advertisement effect measurement server configured to distinguish between a registered viewer and an unregistered viewer and distinguish between a viewer whose gaze direction is toward broadcast content and a viewer whose gaze direction is not toward the broadcast content on the basis of the received viewing behavior information to analyze an advertisement effect for each viewer, generate an advertisement effect measurement result, and deliver the advertisement effect measurement result to an external user,

wherein the viewing behavior information indicates whether each of the one or more viewers concentrate on the broadcast content or not,

wherein the advertisement effect measurement server delivers the advertisement effect measurement result in a selected method between a pull method and a push method.