Descriptive metadata extraction and linkage with editorial content
First Claim
1. A computer-implemented method, comprising:
- analyzing video data for a first instance of video content in order to identify a character in a scene depicted within two or more of a plurality of frames of the video data, including performing a temporal consistency enhancement operation across the plurality frames of the video data;
determining, for each of the two or more frames, a region of pixels within the respective frame that correspond to the identified character, including performing an object/character segmentation refinement operation across the two or more frames of the video data;
generating a mapping data structure that contains a mapping between a data value pair and the identified character, wherein the data value pair specifies (i) a content identifier that uniquely identifies the first instance of video content and (ii) a timestamp corresponding to a first position within the first instance of video content where the character was identified;
embedding a watermark at the first position within the video data; and
upon receiving, from a remote client device, a message specifying (i) the content identifier that uniquely identifies the first instance of video content (ii) the timestamp corresponding to the first position within the first instance of video content and (iii) a client identifier that uniquely identifies the remote client device, wherein the timestamp was determined by the remote client device based on the remote client device detecting the embedded watermark at the first position within the video data and without requiring user action;
determining the character by accessing the mapping data structure using the timestamp and the content identifier specified within the received message;
determining supplemental content to transmit to the remote client device, by selecting a portion of supplemental content having a predefined correspondence with the character, wherein the selection is made based on a device profile corresponding to the client identifier for the remote client device; and
transmitting the supplemental content corresponding to the character to the remote client device, for output together with the video data.
3 Assignments
0 Petitions
Accused Products
Abstract
Embodiments provide techniques for distributing supplemental content based on content entities within video content. Embodiments include analyzing video data to identify a known content entity within two or more frames of the video data. For each of the two or more frames, a region of pixels within the respective frame is determined that corresponds to the known content entity. Embodiments further include determining supplemental content corresponding to the known content entity. A watermark is embedded at a first position within the video data, such that the watermark corresponds to an identifier associated with the determined supplemental content. Upon receiving a message specifying the identifier, embodiments include transmitting the supplement content to a client device for output together with the video data.
-
Citations
20 Claims
-
1. A computer-implemented method, comprising:
-
analyzing video data for a first instance of video content in order to identify a character in a scene depicted within two or more of a plurality of frames of the video data, including performing a temporal consistency enhancement operation across the plurality frames of the video data; determining, for each of the two or more frames, a region of pixels within the respective frame that correspond to the identified character, including performing an object/character segmentation refinement operation across the two or more frames of the video data; generating a mapping data structure that contains a mapping between a data value pair and the identified character, wherein the data value pair specifies (i) a content identifier that uniquely identifies the first instance of video content and (ii) a timestamp corresponding to a first position within the first instance of video content where the character was identified; embedding a watermark at the first position within the video data; and upon receiving, from a remote client device, a message specifying (i) the content identifier that uniquely identifies the first instance of video content (ii) the timestamp corresponding to the first position within the first instance of video content and (iii) a client identifier that uniquely identifies the remote client device, wherein the timestamp was determined by the remote client device based on the remote client device detecting the embedded watermark at the first position within the video data and without requiring user action; determining the character by accessing the mapping data structure using the timestamp and the content identifier specified within the received message; determining supplemental content to transmit to the remote client device, by selecting a portion of supplemental content having a predefined correspondence with the character, wherein the selection is made based on a device profile corresponding to the client identifier for the remote client device; and transmitting the supplemental content corresponding to the character to the remote client device, for output together with the video data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 15, 16, 17, 18, 19, 20)
-
-
9. A non-transitory computer-readable medium containing program code that, when executed by operation of one or more computer processors, performs an operation comprising:
-
analyzing video data for a first instance of video content to identify a character in a scene depicted within two or more of a plurality of frames of the video data, including performing a temporal consistency enhancement operation across the plurality frames of the video data; determining, for each of the two or more frames, a region of pixels within the respective frame that correspond to the identified character, including performing an object/character segmentation refinement operation across the two or more frames of the video data; generating a mapping data structure that contains a mapping between a data value pair and the identified character, wherein the data value pair specifies (i) a content identifier that uniquely identifies the first instance of video content and (ii) a timestamp corresponding to a first position within the first instance of video content where the character was identified; embedding a watermark at the first position within the video data; and upon receiving, from a remote client device, a message specifying (i) a content identifier that uniquely identifies the first instance of video content (ii) the timestamp corresponding to the first position within the first instance of video content and (iii) a client identifier that uniquely identifies the remote client device, wherein the timestamp was determined by the remote client device based on the remote client device detecting the embedded watermark at the first position within the video data and without requiring user action; determining the character by accessing the mapping data structure using the timestamp and the content identifier specified within the received message; determining supplemental content to transmit to the remote client device, by selecting a portion of supplemental content having a predefined association correspondence with the character, wherein the selection is made based on a device profile corresponding to the client identifier for the remote client device; and transmitting the supplemental content corresponding to the character to the remote client device, for output together with the video data. - View Dependent Claims (10, 11, 12, 13)
-
-
14. A system, comprising:
-
one or more computer processors; and a memory containing a program that, when executed by the one or more computer processors, performs an operation comprising; analyzing video data for a first instance of video content to identify a character in a scene depicted within two or more of a plurality of frames of the video data, including performing a temporal consistency enhancement operation across the plurality frames of the video data; determining, for each of the two or more frames, a region of pixels within the respective frame that correspond to the identified character, including performing an object/character segmentation refinement operation across the two or more frames of the video data; generating a mapping data structure that contains a mapping between a data value pair and the identified character, wherein the data value pair specifies (i) a content identifier that uniquely identifies the first instance of video content and (ii) a timestamp corresponding to a first position within the first instance of video content where the character was identified; embedding a watermark at the first position within the video data; and upon receiving, from a remote client device, a message specifying (i) a content identifier that uniquely identifies the first instance of video content (ii) the timestamp corresponding to the first position within the first instance of video content and (iii) a client identifier that uniquely identifies the remote client device, wherein the timestamp was determined by the remote client device based on the remote client device detecting the embedded watermark at the first position within the video data and without requiring user action; determining the character by accessing the mapping data structure using the timestamp and the content identifier specified within the received message; determining supplemental content to transmit to the remote client device, by selecting a portion of supplemental content having a predefined correspondence with the character, wherein the selection is made based on a device profile corresponding to the client identifier for the remote client device; and transmitting the supplemental content corresponding to the character to the remote client device, for output together with the video data.
-
Specification