METHODS, SYSTEMS, AND MEDIA FOR ENHANCING TWO-DIMENSIONAL VIDEO CONTENT ITEMS WITH SPHERICAL VIDEO CONTENT

• US 20180160194A1
• Filed: 12/01/2016
• Published: 06/07/2018
• Est. Priority Date: 12/01/2016
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Bayliss, Leon, Hale, Richard
• Application Number:
  US15/366,432
• Publication Number:
  US 20180160194A1
• Time in Patent Office: Days
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/858 Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot

Abstract

Methods, systems, and media for enhancing two-dimensional video content items with spherical video content are provided. In some embodiments, the method comprises: receiving an indication of a two-dimensional video content item to be presented on a user device; determining image information associated with one or more image frames of the two-dimensional video content item; identifying spherical video content based on the image information associated with the one or more image frames of the two-dimensional video content item, wherein the spherical video content is related to the determined image information and wherein the spherical video content includes a plurality of views; identifying a position corresponding to a first view of the plurality of views within the related spherical video content at which to insert the two-dimensional video content item; and generating a spherical video content item by inserting the two-dimensional video content item within the related spherical video content at the identified position corresponding to the first view for presentation on the user device, wherein, in response to receiving a user input from the user device to change a viewpoint of the spherical video content item, the related spherical video content within the spherical video content item is modified to a second view of the plurality of views while the two-dimensional content item within the spherical video content item is continued to be presented at the identified position.

Claims

1. A method for enhancing video content items, the method comprising:

receiving an indication of a two-dimensional video content item to be presented on a user device;

determining image information associated with one or more image frames of the two-dimensional video content item;

identifying spherical video content based on the image information associated with the one or more image frames of the two-dimensional video content item, wherein the spherical video content is identified based on the determined image information and based on a topic of the two-dimensional video content item, and wherein the spherical video content includes a plurality of views;

identifying a position corresponding to a first view of the plurality of views within the related spherical video content at which to insert the two-dimensional video content item; and

generating a spherical video content item by inserting the two-dimensional video content item within the related spherical video content at the identified position corresponding to the first view for presentation on the user device, wherein, in response to receiving a user input from the user device to change a viewpoint of the spherical video content item, the related spherical video content within the spherical video content item is modified to a second view of the plurality of views while the two-dimensional content item within the spherical video content item is continued to be presented at the identified position.

2. The method of claim 1, wherein the related spherical video content is related to an environment depicted in the one or more image frames of the two-dimensional video content item.

3. The method of claim 1, wherein inserting the two-dimensional video content item within the related spherical video content at the identified position corresponding to the first view for presentation on the user device further comprises transmitting instructions to the user device that include one or more coordinates at which the two-dimensional video item is to be positioned relative to the spherical video content.

4. The method of claim 1, wherein identifying the spherical video content comprises determining an identifier corresponding to the spherical video content that is stored in association with an identifier of the two-dimensional video content item.

5. The method of claim 1, wherein an identity of the spherical video content item is specified by a content creator of the two-dimensional video content item.

6. The method of claim 1, wherein identifying the spherical video content comprises:

identifying a plurality of candidate spherical video content based on first metadata associated with the two-dimensional video content item and second metadata associated with the two-dimensional video content item; and

selecting at least one candidate spherical video content item from the plurality of candidate spherical video content.

7. The method of claim 1, further comprising causing the two-dimensional video content item to be inserted within second spherical video content during presentation of a second portion of the two-dimensional video content item, wherein the second spherical video content is related to the one or more image frames associated with the second portion of the two-dimensional video content item and wherein the two-dimensional video content item is inserted within the related spherical video content during presentation of a first portion of the two-dimensional video content item.

8. The method of claim 1, further comprising modifying at least one visual characteristic of the related spherical video content based on visual characteristics of the two-dimensional video content item.

9. The method of claim 1, further comprising:

identifying one or more portions of the two-dimensional video content item that are unrelated to the spherical video content; and

inhibiting presentation of the spherical video content during presentations of the one or more portions of the two-dimensional video content item that are unrelated to the spherical video content.

10. The method of claim 1, wherein presentation of the spherical video content item is performed in a full-screen mode.

11. The method of claim 1, further comprising causing a notification related to the two-dimensional video content item to be presented on the user device in response to determining that presentation of the spherical video content item on the user device has been completed.

12. A system for enhancing video content items, the system comprising:

a hardware processor that is configured to;

receive an indication of a two-dimensional video content item to be presented on a user device;

determine image information associated with one or more image frames of the two-dimensional video content item;

identify spherical video content based on the image information associated with the one or more image frames of the two-dimensional video content item, wherein the spherical video content is identified based on the determined image information and based on a topic of the two-dimensional video content item, and wherein the spherical video content includes a plurality of views;

identify a position corresponding to a first view of the plurality of views within the related spherical video content at which to insert the two-dimensional video content item; and

generate a spherical video content item by inserting the two-dimensional video content item within the related spherical video content at the identified position corresponding to the first view for presentation on the user device, wherein, in response to receiving a user input from the user device to change a viewpoint of the spherical video content item, the related spherical video content within the spherical video content item is modified to a second view of the plurality of views while the two-dimensional content item within the spherical video content item is continued to be presented at the identified position.

13. The system of claim 12, wherein the related spherical video content is related to an environment depicted in the one or more image frames of the two-dimensional video content item.

14. The system of claim 12, wherein inserting the two-dimensional video content item within the related spherical video content at the identified position corresponding to the first view for presentation on the user device further comprises transmitting instructions to the user device that include one or more coordinates at which the two-dimensional video item is to be positioned relative to the spherical video content.

15. The system of claim 12, wherein the hardware processor is further configured to determine an identifier corresponding to the spherical video content that is stored in association with an identifier of the two-dimensional video content item.

16. The system of claim 12, wherein an identity of the spherical video content item is specified by a content creator of the two-dimensional video content item.

17. The system of claim 12, wherein the hardware processor is further configured to:

identify a plurality of candidate spherical video content based on first metadata associated with the two-dimensional video content item and second metadata associated with the two-dimensional video content item; and

select at least one candidate spherical video content item from the plurality of candidate spherical video content.

18. The system of claim 12, wherein the hardware processor is further configured to cause the two-dimensional video content item to be inserted within second spherical video content during presentation of a second portion of the two-dimensional video content item, wherein the second spherical video content is related to the one or more image frames associated with the second portion of the two-dimensional video content item and wherein the two-dimensional video content item is inserted within the related spherical video content during presentation of a first portion of the two-dimensional video content item.

19. The system of claim 12, wherein the hardware processor is further configured to modify at least one visual characteristic of the related spherical video content based on visual characteristics of the two-dimensional video content item.

20. The system of claim 12, wherein the hardware processor is further configured to:

identify one or more portions of the two-dimensional video content item that are unrelated to the spherical video content; and

inhibit presentation of the spherical video content during presentations of the one or more portions of the two-dimensional video content item that are unrelated to the spherical video content.

21. The system of claim 12, wherein presentation of the spherical video content item is performed in a full-screen mode.

22. The system of claim 12, wherein the hardware processor is further configured to cause a notification related to the two-dimensional video content item to be presented on the user device in response to determining that presentation of the spherical video content item on the user device has been completed.

23. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for enhancing two-dimensional video content items is provided, the method comprising:

receiving an indication of a two-dimensional video content item to be presented on a user device;

determining image information associated with one or more image frames of the two-dimensional video content item;

identifying spherical video content based on the image information associated with the one or more image frames of the two-dimensional video content item, wherein the spherical video content is identified based on the determined image information and based on a topic of the two-dimensional video content item, and wherein the spherical video content includes a plurality of views;

identifying a position corresponding to a first view of the plurality of views within the related spherical video content at which to insert the two-dimensional video content item; and

generating a spherical video content item by inserting the two-dimensional video content item within the related spherical video content at the identified position corresponding to the first view for presentation on the user device, wherein, in response to receiving a user input from the user device to change a viewpoint of the spherical video content item, the related spherical video content within the spherical video content item is modified to a second view of the plurality of views while the two-dimensional content item within the spherical video content item is continued to be presented at the identified position.