Video object tag creation and processing

• US 8,209,223 B2
• Filed: 11/30/2007
• Issued: 06/26/2012
• Est. Priority Date: 11/30/2007
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Fink, Michael, Tavory, Ran, Kolodny, Tamar Rachel, Marmasse, Natalia
• Primary Examiner(s): Colbert, Ella
• Assistant Examiner(s): AMELUNXEN, BARBARA J
• Application Number:
  US11/948,643
• Publication Number:
  US 20090144772A1
• Time in Patent Office: 1,670 Days
• Field of Search: 705/4, 705/14, 705/14.52, 705/35, 386/4, 386/52, 386/124, 707/765, 709/218, 715/723, 725/32, 725/36, 725/110, 726/1
• US Class Current: 705/14.4
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/784 the detected or recognised objects being people
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: G06Q 20/123 Shopping for digital content
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 30/0254 based on statistics
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: G06Q 40/08 Insurance
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/6175 involving transmission via Internet broadcast-related systems characterised by the transmission system being the Internet H04H60/82
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

An indication of an object included in a frame of a video content item is received. A tag is associated with the object, the tag including a reference to a media content item. An additional frame that includes the object is identified in the video content item. The tag is associated with the additional frame in the video content item.

Claims

1. A method comprising:

receiving, by one or more computers, representations of a plurality of objects;

receiving, by the one or more computers, tag data, wherein the tag data comprises one or more references to one or more media content items;

for each of the plurality of objects, locating, by the one or more computers, the object in a frame of a video content item, wherein the tag data is associated with the located objects; and

providing, by the one or more computers, the video content item, including the tag data associated with the located objects, to a user device that provides a user interface for a concurrent display of the video content item in a first display area and the located objects that are displayed during a presentation of the video content item in a second display area, and wherein the association of the tag data with the located objects cause the display of each located object to persist in the second display area after the located object is no longer displayed during the presentation of the video content item in the first display area.

2. The method of claim 1, wherein the one or more media content items comprises a web page, an audio content item, or a video content item.

3. The method of claim 1, wherein the one or more media content items comprises a sponsored-content item associated with at least one of the plurality of objects.

4. The method of claim 1, wherein the plurality of objects comprises a product and the one or more media content items comprises an advertisement promoting the product.

5. The method of claim 1, wherein the plurality of objects comprises a face and the one or more media content items comprises a web page associated with a human identified by the face.

6. The method of claim 1, wherein at least one of the representations of the plurality of objects comprises one or more images of an object.

7. A computer program product, tangibly embodied in a machine readable medium, the computer program product comprising instructions that, when read by a machine, cause a data processing apparatus to:

receive indications of objects included in frames of a video content item, wherein each of the objects is associated with a tag comprising a reference to a media content item, and wherein the tag is associated with an additional frame of the video content item that includes the object; and

provide the video content item, including the tags associated with the objects and associated with the frames of the video content item, to a user device that provides a user interface for a concurrent display of the video content item in a first display area and the objects that are displayed during a presentation of the video content item in a second display area, and wherein the association of the tags with the objects cause the display of each object to persist in the second display area after the object is no longer displayed during the presentation of the video content item in the first display area.

8. The computer program product of claim 7, wherein the media content items comprise a web page, an audio content item, or a video content item.

9. The computer program product of claim 7, wherein the media content items comprise a sponsored-content item associated with the corresponding object.

10. The computer program product of claim 7, wherein the objects comprise a representation of a product and the media content items comprise an advertisement promoting the product.

11. The computer program product of claim 7, wherein the objects comprise a representation of a face and the media content items comprise a web page associated with a human identified by the representation of the face.

12. The computer program product of claim 7, further comprising instructions that, when read by a machine, cause a data processing apparatus to:

identify a frame in an additional video content item that includes at least one of the objects; and

associate the tag associated with the at least one of the objects with the identified frame of the additional video content item.

13. The computer program product of claim 7, further comprising instructions that, when read by a machine, cause a data processing apparatus to:

preprocess the video content item to identify each occurrence of at least one of the objects in the video content item and to associate an identifier of an additional occurrence of the at least one of the objects with the video content item, and

process the identifier of the additional occurrence of the at least one of the objects to identify an additional frame of the video content item that includes the object.

14. A computer program product, tangibly embodied in a machine readable medium, the computer program product comprising instructions that, when read by a machine, cause a data processing apparatus to:

receive representations of a plurality of objects;

receive tag data, wherein the tag data comprises references to one or more media content items;

for each of the plurality of objects, locate the object in a frame of a video content item, wherein the tag data is associated with the located object in the frame of the video content item; and

provide the video content item, including the tag data associated with the located objects, to a user device that provides a user interface for a concurrent display of the video content item in a first display area and the located objects in a second display area, and wherein the association of the tag data with the located objects cause the display of each located object to be presented in the second display area upon presentation of the video content item in the first display area and cause the display of each located object to persist in the second display area during the presentation of the video content item in the first display area.

15. The computer program product of claim 14, wherein the one or more media content items comprises a web page, an audio content item, or a video content item.

16. The computer program product of claim 14, wherein the one or more media content items comprises a sponsored-content item associated with at least one of the plurality of objects.

17. The computer program product of claim 14, wherein the plurality of objects comprise a product and the one or more media content items comprises an advertisement promoting the product.

18. The computer program product of claim 14, wherein the plurality of objects comprise a face and the one or more media content items comprises a web page associated with a human identified by the face.

19. The computer program product of claim 14, wherein the representations of the plurality of objects comprise one or more images of an object.

20. A method for associating a tag with an object in a video content item comprising:

receiving, by one or more computers, an indication of a human face represented in a frame of a video content item;

associating, by the one or more computers, tag data with the human face representation, wherein the tag data comprises a reference to a web page associated with a human identified by the human face representation in the frame;

identifying, by the one or more computers, an additional frame of the video content item that includes the human face representation; and

associating, by the one or more computers, the tag data with the identified additional frame of the video content item.