Methods, systems, and media for media transmission and management

• US 9,705,728 B2
• Filed: 03/15/2013
• Issued: 07/11/2017
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Bridges, Matt
• Primary Examiner(s): Moise, Emmanuel L
• Assistant Examiner(s): Ye, Zi
• Application Number:
  US13/834,394
• Publication Number:
  US 20140281004A1
• Time in Patent Office: 1,579 Days
• Field of Search: 709231, 715202, 715719, 715219, 382190, 725109
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/83 Generation or processing of protective or descriptive data associated with content; Content structuring

Abstract

Methods, systems, and media for media transmission and management are provided. In some implementations, a method for media content management is provided, the method comprising: receiving a portion of a media data stream from a first computing device prior to the first computing device processing the portion of the media data stream; processing the portion of the media data stream to identify an object of interest within the media data stream; determining an entity associated with the object of interest; associating a content item with the object of interest based on the determined entity; generating a first representation of the portion of the media data stream, wherein the first representation is associated with the content item; receiving a second representation of the media data stream from a second computing device; determining whether the second representation matches the first representation; and transmitting the content item associated with the first representation to the second computing device for placement within the media data stream in response to determining that the second representation matches the first representation.

Claims

1. A system for media content management, the system comprising:

a hardware processor coupled with memory containing computer executable instructions that, when executed by the hardware processor, is configured to;

identify a plurality of computing devices associated with a content provider, wherein each of the plurality of computing devices has provided an indication allowing the transmission of sequences of one or more media data streams;

divide the plurality of computing devices associated with a content provider based on device information that includes network bandwidth information of each of the plurality of computing devices or processing capability of each of the plurality of computing devices by assigning a first set of the plurality of computing devices to transmit full sequences of frames corresponding to a media data stream and assigning a second set of the plurality of computing devices to transmit fingerprints of the media data stream, wherein the first set of the plurality of computing devices includes a first computing device and the second set of the plurality of computing devices includes a second computing device;

receive a sequence of the media data stream from the first computing device prior to the first computing device processing the sequence of the media data stream for presentation on the first computing device and in response to receiving an authorization from the first computing device to process media data streams for related content items;

process the sequence of the media data stream received from the first computing device, wherein the processing includes identifying an object of interest within the media data stream received from the first computing device;

determine an entity associated with the object of interest identified within the media data stream received from the first computing device;

associate a content item with the object of interest based on the determined entity;

generate a first video fingerprint of the sequence of the media data stream, wherein the first video fingerprint is associated with the content item and placement information associated with the content item and wherein the content item and the placement information associated with the content item are transmitted in connection with the sequence of the media data stream for rendering on the first computing device;

receive a second video fingerprint of the media data stream from the second computing device;

determine whether the second computing device has been assigned to the second set of the plurality of computing devices;

compare the second video fingerprint with the first video fingerprint in response to determining that the second computing device was assigned to the second set of the plurality of computing devices and in response to receiving the second video fingerprint of the media data stream; and

transmit the content item and the placement information associated with the content item associated to the second computing device for placement within the media data stream in response to the comparison indicating that the second video fingerprint matches the first video fingerprint.

2. The system of claim 1, wherein the processor is further configured to transmit an instruction to delay the processing of the media data stream on the first computing device.

3. The system of claim 1, wherein the hardware processor is further configured to receive the indication from each of the plurality of computing devices to allow portions of the media data stream to be transmitted prior to processing the portions of the media data stream.

4. The system of claim 1, wherein the hardware processor is further configured to:

detect a face within the sequence of the media data stream using a facial recognition technique; and

determine the entity associated with the detected face.

5. The system of claim 1, wherein the hardware processor is further configured to:

identify a text portion within the sequence of the media data stream using an optical character recognition technique;

determine whether the identified text portion meets one or more criterion;

determine the content item associated with the identified text portion in response to the text portion meeting the one or more criterion; and

transmit the content item to the second computing device, wherein the content item causes the second computing device to navigate to a destination corresponding to the identified text portion.

6. The system of claim 1, wherein the hardware processor is further configured to:

extract the object of interest from the sequence of the media data stream using an object recognition technique; and

identify a product associated with the object of interest, wherein the content item includes information relating to the identified product.

7. The system of claim 1, wherein the hardware processor is further configured to:

extract an audio sample from the sequence of the media data stream;

identify a keyword in the audio sample using an audio recognition technique; and

determine a product associated with the identified keyword, wherein the content item includes information relating to the determined product.

8. The system of claim 1, wherein the first video fingerprint and the second video fingerprint include a smaller amount of media data than the received sequence of the media data stream.

9. A method for media content management, the method comprising:

identifying, using a hardware processor, a plurality of computing devices associated with a content provider, wherein each of the plurality of computing devices has provided an indication allowing the transmission of sequences of one or more media data streams;

dividing, using the hardware processor, the plurality of computing devices associated with a content provider based on device information that includes network bandwidth information of each of the plurality of computing devices or processing capability of each of the plurality of computing devices by assigning a first set of the plurality of computing devices to transmit full sequences of frames corresponding to a media data stream and assigning a second set of the plurality of computing devices to transmit fingerprints of the media data stream, wherein the first set of the plurality of computing devices includes a first computing device and the second set of the plurality of computing devices includes a second computing device;

receiving, using the hardware processor, a sequence of the media data stream from the first computing device prior to the first computing device processing the sequence of the media data stream for presentation on the first computing device and in response to receiving an authorization from the first computing device to process media data streams for related content items;

processing, using the hardware processor, the sequence of the media data stream received from the first computing device, wherein the processing includes identifying an object of interest within the media data stream received from the first computing device;

determining, using the hardware processor, an entity associated with the object of interest identified within the media data stream received from the first computing device;

associating, using the hardware processor, a content item with the object of interest based on the determined entity;

generating, using the hardware processor, a first video fingerprint of the sequence of the media data stream, wherein the first video fingerprint is associated with the content item and placement information associated with the content item and wherein the content item and the placement information associated with the content item are transmitted in connection with the sequence of the media data stream for rendering on the first computing device;

receiving, using the hardware processor, a second video fingerprint of the media data stream from the second computing device;

determining, using the hardware processor, whether the second computing device has been assigned to the second set of the plurality of computing devices;

comparing, using the hardware processor, the second video fingerprint with the first video fingerprint in response to determining that the second computing device was assigned to the second set of the plurality of computing devices and in response to receiving the second video fingerprint of the media data stream; and

transmitting, using the hardware processor, the content item and the placement information associated with the content item associated to the second computing device for placement within the media data stream in response to the comparison indicating that the second video fingerprint matches the first video fingerprint.

10. The method of claim 9, further comprising transmitting an instruction to delay the processing of the media data stream on the first computing device.

11. The method of claim 9, further comprising receiving the indication from each of the plurality of computing devices to allow portions of the media data stream to be transmitted prior to processing the portions of the media data stream.

12. The method of claim 9, further comprising:

detecting a face within the of the media data stream using a facial recognition technique; and

determining the entity associated with the detected face.

13. The method of claim 9, further comprising:

identifying a text portion within the sequence of the media data stream using an optical character recognition technique;

determining whether the identified text portion meets one or more criterion;

determining the content item associated with the identified text portion in response to the text portion meeting the one or more criterion; and

transmitting the content item to the second computing device, wherein the content item causes the second computing device to navigate to a destination corresponding to the identified text portion.

14. The method of claim 9, further comprising:

extracting the object of interest from the sequence of the media data stream using an object recognition technique; and

identifying a product associated with the object of interest, wherein the content item includes information relating to the identified product.

15. The method of claim 9, further comprising:

extracting an audio sample from the sequence of the media data stream;

identifying a keyword in the audio sample using an audio recognition technique; and

determining a product associated with the identified keyword, wherein the content item includes information relating to the determined product.

16. The method of claim 9, wherein the first video fingerprint and the second video fingerprint include a smaller amount of media data than the received sequence of the media data stream.

17. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for media content management, the method comprising:

identifying a plurality of computing devices associated with a content provider, wherein each of the plurality of computing devices has provided an indication allowing the transmission of sequences of one or more media data streams;

dividing the plurality of computing devices associated with a content provider based on device information that includes network bandwidth information of each of the plurality of computing devices or processing capability of each of the plurality of computing devices by assigning a first set of the plurality of computing devices to transmit full sequences of frames corresponding to a media data stream and assigning a second set of the plurality of computing devices to transmit fingerprints of the media data stream, wherein the first set of the plurality of computing devices includes a first computing device and the second set of the plurality of computing devices includes a second computing device;

receiving a sequence of the media data stream from the first computing device prior to the first computing device processing the sequence of the media data stream for presentation on the first computing device and in response to receiving an authorization from the first computing device to process media data streams for related content items;

processing the sequence of the media data stream received from the first computing device, wherein the processing includes identifying an object of interest within the media data stream received from the first computing device;

determining an entity associated with the object of interest identified within the media data stream received from the first computing device;

associating a content item with the object of interest based on the determined entity;

generating a first video fingerprint of the sequence of the media data stream, wherein the first video fingerprint is associated with the content item and placement information associated with the content item and wherein the content item and the placement information associated with the content item are transmitted in connection with the sequence of the media data stream for rendering on the first computing device;

receiving a second video fingerprint of the media data stream from the second computing device;

determining whether the second computing device has been assigned to the second set of the plurality of computing devices;

comparing the second video fingerprint with the first video fingerprint in response to determining that the second computing device was assigned to the second set of the plurality of computing devices and in response to receiving the second video fingerprint of the media data stream; and

transmitting the content item and the placement information associated with the content item associated to the second computing device for placement within the media data stream in response to the comparison indicating that the second video fingerprint matches the first video fingerprint.

18. The non-transitory computer-readable medium of claim 17, wherein the method further comprises transmitting an instruction to delay the processing of the media data stream on the first computing device.

19. The non-transitory computer-readable medium of claim 17, wherein the method further comprises receiving the indication from each of the plurality of computing devices to allow portions of the media data stream to be transmitted prior to processing the portions of the media data stream.

20. The non-transitory computer-readable medium of claim 17, wherein the method further comprises:

detecting a face within the sequence of the media data stream using a facial recognition technique; and

determining the entity associated with the detected face.

21. The non-transitory computer-readable medium of claim 17, wherein the method further comprises:

identifying a text portion within the sequence of the media data stream using an optical character recognition technique; and

determining whether the identified text portion meets one or more criterion;

determining the content item associated with the identified text portion in response to the text portion meeting the one or more criterion; and

transmitting the content item to the second computing device, wherein the content item causes the second computing device to navigate to a destination corresponding to the identified text portion.

22. The non-transitory computer-readable medium of claim 17, wherein the method further comprises:

extracting the object of interest from the sequence of the media data stream using an object recognition technique; and

identifying a product associated with the object of interest, wherein the content item includes information relating to the identified product.

23. The non-transitory computer-readable medium of claim 17, wherein the method further comprises:

extracting an audio sample from the sequence of the media data stream;

identifying a keyword in the audio sample using an audio recognition technique; and

determining a product associated with the identified keyword, wherein the content item includes information relating to the determined product.

24. The non-transitory computer-readable medium of claim 17, wherein the first video fingerprint and the second video fingerprint include a smaller amount of media data than the received sequence of the media data stream.