Video object tag creation and processing

• US 8,732,766 B2
• Filed: 06/07/2012
• Issued: 05/20/2014
• Est. Priority Date: 11/30/2007
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Fink, Michael, Tavory, Ran, Kolodny, Tamar Rachel, Marmasse, Natalia
• Primary Examiner(s): Hammond, III, Thomas M
• Assistant Examiner(s): AMELUNXEN, BARBARA J
• Application Number:
  US13/490,912
• Publication Number:
  US 20120246685A1
• Time in Patent Office: 712 Days
• Field of Search: 705/1, 705/4, 705/7.18, 705/14, 705/14.27, 705/14.66, 705/35, 705/36, 715/723, 715/733, 709/204, 725/34, 725/54, 725/87, 725/42, 348/563, 348/564, 345/629
• US Class Current: 725/60
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/784 the detected or recognised objects being people
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: G06Q 20/123 Shopping for digital content
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 30/0254 based on statistics
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: G06Q 40/08 Insurance
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/6175 involving transmission via Internet broadcast-related systems characterised by the transmission system being the Internet H04H60/82
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Methods, and systems, including computer programs encoded on computer-readable storage mediums, including a method for presenting a video content item in a first display area; concurrently presenting, with the video content item in the first display area, objects that are displayed during the presentation of the video content item in a second display area, wherein the objects persist in the second display area after the object is no longer displayed during the presentation of the video content item in the first display area; receiving an indication identifying one of the objects presented in the first display area or the second display area; and processing a tag associated with the object, the tag comprising a reference to a media item, wherein the processing comprises: accessing the media item referenced by the tag; and presenting the media item at least partially in the first display area or the second display area.

Claims

1. A method comprising:

presenting a video content item in a first display area, wherein the video content item includes frames in which objects are located, wherein one or more objects are associated with respective tags comprising a reference to a media content item that is different from the respectively associated objects;

determining that a frame including a first respectively associated object of the one or more respectively associated objects is presented in the first display area, and in response to the determination;

concurrently presenting, prior to a user selection of the first respectively associated object in the first display area, the first respectively associated object in a second display area separate from the first display area, wherein;

during presentation of the frame in which the first respectively associated object is located, the concurrent presentation includes concurrently presenting the first respectively associated object in both the first display area and the second display area; and

subsequent to the concurrent presentation, the first respectively associated object persists in the second display area after the first respectively associated object is no longer presented in the first display area;

receiving an indication from a viewer of the video content item identifying the first respectively associated object presented in the second display area; and

processing, by one or more data processors, the respective tag associated with the first respectively associated object, wherein the processing comprises;

accessing the media content item referenced by the respective tag; and

presenting the media content item at least partially in the first display area or the second display area.

2. The method of claim 1, wherein receiving an indication comprises:

receiving the indication from the viewer identifying the one of the respectively associated objects at a time during which the one of the objects is presented only in the second display area.

3. The method of claim 1, wherein the media content item comprises a web page, an audio content item, or a video content item.

4. The method of claim 1, wherein the media content item comprises a sponsored-content item associated with the one of the respectively associated objects.

5. The method of claim 1, wherein the one of the respectively associated objects comprises a product and the media content item comprises an advertisement promoting the product.

6. The method of claim 1, wherein the one of the respectively associated objects is a face and the media content item comprises a web page associated with a human identified by the face.

7. A system, comprising:

one or more data processors; and

instructions stored on a computer readable storage medium that when executed by the one or more data processors cause the one or more data processors to perform operations comprising;

presenting a video content item in a first display area, wherein the video content item includes frames in which objects are located, wherein one or more objects are associated with respective tags comprising a reference to a media content item that is different from the respectively associated objects;

determining that a frame including a first respectively associated object of the one or more respectively associated objects is presented in the first display area, and in response to the determination;

concurrently presenting, prior to a user selection of the first respectively associated object in the first display area, the first respectively associated object in a second display area separate from the first display area, wherein;

during presentation of the frame in which the first respectively associated object is located, the concurrent presentation includes concurrently presenting the first respectively associated object in both the first display area and the second display area; and

subsequent to the concurrent presentation, the first respectively associated object persists in the second display area after the first respectively associated object is no longer presented in the first display area;

receiving an indication from a viewer of the video content item identifying the first respectively associated object presented in the second display area; and

processing, by one or more data processors, the respective tag associated with the first respectively associated object, wherein the processing comprises;

accessing the media content item referenced by the respective tag; and

presenting the media content item at least partially in the first display area or the second display area.

8. The system of claim 7, wherein receiving an indication comprises:

receiving the indication from the viewer identifying the one of the respectively associated objects at a time during which the one of the objects is presented only in the second display area.

9. The system of claim 7, wherein the media content item comprises a web page, an audio content item, or a video content item.

10. The system of claim 7, wherein the media content item comprises a sponsored-content item associated with the one of the respectively associated objects.

11. The system of claim 7, wherein the one of the respectively associated objects comprises a product and the media content item comprises an advertisement promoting the product.

12. The system of claim 7, wherein the one of the respectively associated objects is a face and the media content item comprises a web page associated with a human identified by the face.

13. A non-transitory computer-readable storage medium having instructions stored thereon, which, when executed by one or more data processors, causes the one or more data processors to perform operations comprising:

presenting a video content item in a first display area, wherein the video content item includes frames in which objects are located, wherein one or more objects are associated with respective tags comprising a reference to a media content item that is different from the respectively associated objects;

determining that a frame including a first respectively associated object of the one or more respectively associated objects is presented in the first display area, and in response to the determination;

concurrently presenting, prior to a user selection of the first respectively associated object in the first display area, the first respectively associated object in a second display area separate from the first display area, wherein;

during presentation of the frame in which the first respectively associated object is located, the concurrent presentation includes concurrently presenting the first respectively associated object in both the first display area and the second display area; and

subsequent to the concurrent presentation, the first respectively associated object persists in the second display area after the first respectively associated object is no longer presented in the first display area;

receiving an indication from a viewer of the video content item identifying the first respectively associated object presented in the second display area; and

processing, by one or more data processors, the respective tag associated with the first respectively associated object, wherein the processing comprises;

accessing the media content item referenced by the respective tag; and

presenting the media content item at least partially in the first display area or the second display area.

14. The medium of claim 13, wherein receiving an indication comprises:

receiving the indication from the viewer identifying the one of the respectively associated objects at a time during which the one of the objects is presented only in the second display area.