Characterizing dynamic regions of digital media data

• US 8,155,446 B2
• Filed: 11/06/2006
• Issued: 04/10/2012
• Est. Priority Date: 11/04/2005
• Status: Active Grant

• Current Assignee: EyeTracking, Inc.
• Original Assignee: EyeTracking, Inc.
• Inventors: Weatherhead, James J.
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): Abdi, Amara
• Application Number:
  US11/594,040
• Publication Number:
  US 20070104369A1
• Time in Patent Office: 1,982 Days
• Field of Search: 382/103, 382/173, 382/181, 345/156
• US Class Current: 382/181
• CPC Class Codes: G06Q 30/0242 Determining effectiveness of advertisements
• CPC Class Codes: H04H 60/45 for identifying users
• CPC Class Codes: H04H 60/48 for recognising items expressed in broadcast information
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00
• CPC Class Codes: H04H 60/66 for using the result on distributors' side

Abstract

A media analysis tool is provided for defining dynamic regions of a digital media segment. The dynamic regions may contain at least part of a visible feature of the segment. Correlation of the defined regions with external data quantifying attention of a subject viewing the segment to locations on the screen provides measures of interest level and attention to visible features in the segment. The dynamic regions may be defined in only some of the frames of a segment. The dynamic region may be interpolated or extrapolated for frames in which it is not explicitly defined.

Claims

1. A computer-implemented method comprising:

defining a dynamic region in two or more frames of a digital media segment comprising a portion of a digital media file and being defined by at least two time markers comprising a start time and an end time, the dynamic region containing at least part of a visible feature in the one or more frames;

analyzing a relationship between an external data set that is collected from one or more subjects viewing the digital media segment and the dynamic region, the external data set comprising eye-tracking data for the one or more subjects; and

reporting a metric indicative of a subject interest level in the visible feature, the reporting of the metric comprising plotting the external data set in conjunction with a display frame selected from the two or more frames to produce a snapshot comprising screen locations gazed at by the one or more subjects while viewing the digital media segment and the dynamic region, the snapshot comprising a still image of the display frame overlaid with one or more series of connected points that show the screen locations gazed at by the one or more subjects while viewing the two or more frames.

2. A computer-implemented method as in claim 1, wherein the defining of the dynamic region comprises using an image recognition algorithm to automatically produce a mathematical definition of a screen region containing at least part of the visible feature.

3. A computer-implemented method as in claim 1, wherein the digital media segment is incorporated into a digital media presentation in a stochastically determined order.

4. A computer-implemented method as in claim 1, further comprising:

defining a second dynamic region in the digital media segment;

analyzing a relationship between the external data and the second dynamic region in the digital media segment; and

reporting a second metric indicative of a second subject interest level in the second dynamic region.

5. A computer-implemented method as in claim 1, further comprising:

defining a second dynamic region in the digital media segment; and

recording a metric related to intersection of the dynamic region with the second dynamic region.

6. A computer-implemented method as in claim 1, wherein the external data set further comprises one or more of cognitive activity, cognitive engagement, and emotional response measurements.

7. A computer-implemented method as in claim 1, further comprising:

analyzing a relationship between a second external data set comprising one or more of cognitive activity, cognitive engagement, and emotional response measurements and the one or more dynamic region in the digital media segment; and

reporting a second metric indicative of one or more of a level of subject cognitive activity, a level of subject cognitive engagement, and a level of subject emotional response stimulated by the visible feature.

8. A computer-implemented method as in claim 1, further comprising generating a predicted definition of the dynamic region for an additional frame of the digital media segment in which the dynamic region is not defined.

9. A computer-implemented method as in claim 8, wherein the generating comprises interpolating the predicted definition based on the two or more frames, the predicted definition comprising an interpolated value for at least one attribute of the dynamic region selected from a size, a shape, a location, a visibility, a color, and a trajectory vector, the visibility comprising an indication of whether the dynamic region is visible or hidden in the digital media segment.

10. A computer-implemented method comprising

displaying, to a subject, a digital media segment comprising a portion of a digital media file that comprises a plurality of frames, the digital media segment being defined by at least two time markers comprising a start time and an end time;

recording a data set comprising screen locations gazed at by the subject while viewing the digital media segment;

selecting a display frame from the plurality of frames; and

plotting the data set in conjunction with the display frame to produce a snapshot comprising screen locations gazed at by the subject while viewing the digital media segment, the snapshot comprising a still image of the display frame overlaid with a series of connected points that show the screen locations gazed at by the subject while viewing the plurality of frames.

11. A computer-implemented method as in claim 10, further comprising:

defining a dynamic region in the digital media segment, the dynamic region being non-static in the plurality of frames; and

correlating the data set to the dynamic region such that the snapshot reflects a measure of subject attention to the dynamic region throughout the plurality of frames.

12. A computer-implemented method as in claim 10, further comprising:

recording a second data set comprising one or more of subject cognitive activity, subject cognitive engagement, and subject emotional response while viewing the digital media segment; and

plotting the second data set in conjunction with the snapshot.

13. A computer-implemented method as in claim 10, wherein the snapshot further comprises the still image of the display frame overlaid with an intensity plot that indicates an amount of time that the subject'"'"'s gaze fell within one or more regions on the display frame.

14. A computer-implemented method as in claim 10, further comprising:

aggregating additional data recorded while displaying the digital media segment to one or more additional subjects into the data set; and

plotting the aggregated data in conjunction with the snapshot.