Systems and methods for generating and presenting augmented video content

• US 10,403,042 B2
• Filed: 11/06/2013
• Issued: 09/03/2019
• Est. Priority Date: 11/06/2012
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Oath Inc. (Verizon Communications Inc.)
• Inventors: Roveta, Nicholas, Farrell, Leon, Marshall, Alexander
• Primary Examiner(s): McCulley, Ryan
• Application Number:
  US14/073,683
• Publication Number:
  US 20140125703A1
• Time in Patent Office: 2,127 Days
• Field of Search: None
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4756 for rating content, e.g. scoring a recommended movie
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6547 comprising parameters, e.g. for client setup
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics

Abstract

Computerized systems and methods are provided for generating and providing augmented video content to viewers. In one implementation, a media player executed by a user device obtains playlist data identifying underlying video content and elements of overlay content. The media player may generate augmented video content by merging an element of the overlay content into the underlying video content at a temporal position within the underlying video content that is relevant to the overlay content element, and further, may present the augmented video content to a viewer. The media player may detect a triggering event during the presentation of the augmented video content, and may modify the augmented video content in response to the triggering event.

Claims

1. A computer-implemented method, comprising:

obtaining playlist data identifying an element of video content and one or more elements of overlay content, the playlist data and one or more elements of overlay content being linked by a common alphanumeric identifier;

generating, using at least one processor, augmented video content corresponding to the obtained playlist data, by parsing the playlist data to identify the common alphanumeric identifier, retrieving from memory the one or more overlay content elements based on the common alphanumeric identifier, and merging a first one of the overlay content elements into the video content element at one or more temporal positions within the video content element defined by the playlist data;

generating, according to one or more streaming protocols, one or more electronic instructions to present the augmented video content to a viewer;

tracking playback time of the presented augmented video content using a listener module;

comparing playback positions, based on the playback time tracked by the listener module, with temporal positions and merger durations specified within the playlist data to identify triggering events;

monitoring user activity during playback corresponding to clicking on one or more overlay content elements;

detecting, based on the comparison, a first triggering event or a second triggering event during the presentation of the augmented video content, the first triggering event being associated with an expiration of the first overlay content element, and the second triggering event being associated with a merger of a second one of the overlay content elements into the video content element, wherein the second overlay content element comprises a previously expired element of overlay content;

monitoring a social network feed of a social media network for the presence of specific keywords within social media posts contextually relevant to the augmented video content or the playlist data;

retrieving from memory one or more additional elements of overlay content from a server associated with the social network, wherein the additional elements of overlay content correspond to portions of the monitored social network feed of the social media network;

generating, using the at least one processor, modified augmented video content by merging, into the augmented video content, the one or more additional elements of overlay content corresponding to portions of the social network feed, in response to the detected first or second triggering event;

detecting, through data received from the viewer, a user interaction with overlay content in the modified augmented video content;

in response to the detected user interaction, generating, using the at least one processor, a second modified augmented video content that removes the interacted-with overlay content;

identifying user activity on websites corresponding to the one or more overlay content elements clicked on by the user;

collecting performance data corresponding to the one or more overlay content elements and generating a report based on the user activity and performance data; and

selecting one or more future overlay content elements based on the report.

2. The method of claim 1, wherein:

the method further comprises generating one or more electronic instructions to present the augmented video content within a corresponding container; and

the merged first element of overlay content obscures at least a portion of the video content element presented within the corresponding container.

3. The method of claim 2, wherein the merging of the first element of overlay content comprises establishing one or more spatial positions associated with the presentation of the first overlay content element within the corresponding container.

4. The method of claim 3, wherein the one or more spatial positions comprise at least one of a spatial position defined by the playlist data or a default display position associated with the augmented video content.

5. The method of claim 1, further comprising:

obtaining (i) a duration associated with the merged first overlay content element and (ii) a current playback position of augmented video content;

determining whether a difference between the current playback position and the first temporal position exceeds the duration; and

detecting the first triggering event when the difference exceeds the duration.

6. The method of claim 5, wherein generating the modified augmented content comprises removing the first overlay content element from the underlying video content element in response to the detected first triggering event.

7. The method of claim 1, further comprising:

obtaining a second temporal position associated with the second overlay content element;

determining whether the second temporal position corresponds to a current playback position of the augmented video content; and

detecting the second triggering event when the second temporal position corresponds to the current playback position.

8. The method of claim 7, wherein generating the modified augmented content comprises merging the second overlay content element into the video content at the second temporal position, in response to the detected second triggering event.

9. The method of claim 1, further comprising:

receiving the second element of overlay content during presentation of augmented video content; and

detecting the second triggering event in response to the received second overlay content element.

10. The method of claim 1, wherein the first or second elements of overlay video content comprise at least one of social media content, secondary video content, or cross-platform electronic content.

11. The method of claim 1, wherein:

the video content element further merges overlay content into underlying video content and includes interactive elements configured to obtain viewer feedback.

12. An apparatus, comprising:

a storage device; and

at least one processor coupled to the storage device, wherein the storage device stores a program for controlling the at least one processor, and wherein the at least one processor, being operative with the program, is configured to;

obtain playlist data identifying an element of video content and one or more elements of overlay content, the playlist data and one or more elements of overlay content being linked by a common alphanumeric identifier;

generate, according to one or more streaming protocols, augmented video content by parsing the playlist data to identify the common alphanumeric identifier, retrieving from memory the one or more overlay content elements based on the common alphanumeric identifier, and merging a first one of the overlay content elements into the video content element at one or more temporal positions within the video content element defined by the playlist data;

track playback time of the presented augmented video content using a listener module;

present the augmented video content to a viewer;

compare playback positions, based on the playback time tracked by the listener module, with temporal positions and merger durations specified within the playlist data to identify triggering events;

monitor user activity during playback corresponding to clicking on one or more overlay content elements;

detect, based on the comparison, a first triggering event or a second triggering event during the presentation of the augmented video content, the first triggering event being associated with an expiration of the first overlay content element, and the second triggering event being associated with merger of a second one of the overlay content elements into the video content element, wherein the second overlay content element comprises a previously expired element of overlay content;

monitoring a social network feed of a social media network for the presence of specific keywords within social media posts contextually relevant to the augmented video content or the playlist data;

retrieving from memory one or more additional elements of overlay content from a server associated with the social network, wherein the additional elements of overlay content correspond to portions of the monitored social network feed of the social media network;

generate, using the at least one processor, modified augmented video content by merging, into the augmented video content, the one or more additional elements of overlay content corresponding to portions of the social network feed, in response to the detected first or second triggering event;

detect, through data received from the viewer, a user interaction with overlay content in the modified augmented video content;

in response to the detected user interaction, generate, using the at least one processor, a second modified augmented video content that removes the interacted-with overlay content;

identify user activity on websites corresponding to the one or more overlay content elements clicked on by the user;

collect performance data corresponding to the one or more overlay content elements and generating a report based on the user activity and performance data; and

select one or more future overlay content elements based on the report.

13. The apparatus of claim 12, wherein:

the at least one processor is further configured to generate one or more electronic instructions to present the augmented video content within a corresponding container; and

the merged first element of overlay content obscures at least a portion of the underlying video content element presented within the corresponding container.

14. The apparatus of claim 13, wherein:

the at least one processor is further configured to establish one or more spatial positions associated with the presentation of first overlay content element within the corresponding container; and

the one or more spatial positions comprise at least one of a spatial position defined by the playlist data or a default display position associated with the augmented video content.

15. The apparatus of claim 12, wherein the at least one processor is further configured to:

obtain (i) a duration associated with the merged first overlay content element and (ii) a current playback position of augmented video content;

determine whether a difference between the current playback position and the first temporal position exceeds the duration; and

detect the first triggering event when the difference exceeds the duration; and

in response to the detected first triggering event, remove the first overlay content element from the underlying video content element to generate the modified augmented content.

16. The apparatus of claim 12, wherein the at least one processor is further configured to:

obtain a second temporal position associated with the second overlay content element;

determine whether the second temporal position corresponds to a current playback position of the augmented video content; and

detect the second triggering event when the second temporal position corresponds to the current playback position;

in response to the detected second triggering event, merge the second overlay content element into the video content at the second temporal position to generate the modified augmented content.

17. The apparatus of claim 12, wherein the at least one processor is further configured to:

receive the second element of overlay content during presentation of augmented video content; and

detect the second triggering event in response to the received second overlay content element.

18. The apparatus of claim 12, wherein first or second elements of overlay video content comprise at least one of social media content, secondary video content, or cross-platform electronic content.

19. The apparatus of claim 12, wherein:

the video content element further merges overlay content into underlying video content and includes interactive elements configured to obtain viewer feedback.

20. A tangible, non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method comprising:

obtaining playlist data identifying an element of video content and one or more elements of overlay content, the playlist data and one or more elements of overlay content being linked by a common alphanumeric identifier;

generating, according to one or more streaming protocols, using at least one processor, augmented video content in accordance with the obtained playlist data, the generating comprising parsing the playlist data to identify the common alphanumeric identifier, retrieving from memory the one or more overlay content elements based on the common alphanumeric identifier, and merging a first one of the overlay content elements into the video content element at one or more temporal positions within the video content element defined by the playlist data;

generating one or more electronic instructions to present the augmented video content to a viewer;

tracking playback time of the presented augmented video content using a listener module;

comparing playback positions, based on the playback time tracked by the listener module, with temporal positions and merger durations specified within the playlist data to identify triggering events;

monitoring user activity during playback corresponding to clicking on one or more overlay content elements;

detecting, based on the comparison, a first triggering event or a second triggering event during the presentation of the augmented video content, the first triggering event being associated with an expiration of the first overlay content element, and the second triggering event being associated with a merger of a second one of the overlay content elements into the video content element, wherein the second overlay content element comprises a previously expired element of overlay content;

monitoring a social network feed of a social media network for the presence of specific keywords within social media posts contextually relevant to the augmented video content or the playlist data;

retrieving from memory one or more additional elements of overlay content from a server associated with the social network, wherein the additional elements of overlay content correspond to portions of the monitored social network feed of the social media network;

generating, using the at least one processor, modified augmented video content by merging, into the augmented video content, the one or more additional elements of overlay content corresponding to portions of the social network feed, in response to the detected first or second triggering event;

detecting, through data received from the viewer, a user interaction with overlay content in the modified augmented video content;

in response to the detected user interaction, generating, using the at least one processor, a second modified augmented video content that removes the interacted-with overlay content;

identifying user activity on websites corresponding to the one or more overlay content elements clicked on by the user;

collecting performance data corresponding to the one or more overlay content elements and generating a report based on the user activity and performance data; and

selecting one or more future overlay content elements based on the report.