Server-based conversion of autoplay content to click-to-play content

• US 10,289,732 B2
• Filed: 06/13/2016
• Issued: 05/14/2019
• Est. Priority Date: 06/13/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Marchiori, Eugenio Jorge, Warriner, Michael Francis
• Primary Examiner(s): Mackes, Kris E
• Assistant Examiner(s): Htay, Lin Lin M
• Application Number:
  US15/180,749
• Publication Number:
  US 20170357655A1
• Time in Patent Office: 1,065 Days
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating and providing converted content. In one aspect, a system includes a content database that receives content from content providers and stores original content comprising animating content and converted content associated with the original content; a converter system that: receives the original content from the content database; generates the converted content, comprising: for a particular original content, identifying and extracting, from the particular original content, a static representation; overlaying the static representation with UI elements; and storing a particular converted content that comprises the static representation overlaid with the UI elements; and transmits the converted content to the content database; a content distribution system that: receives a request for content; identifies a first original content from the content database; receives a first converted content associated with the first original content; and provides the first converted content.

Claims

1. A system comprising:

a content database, in communication with one or more content providers, that receives content from the one or more content providers and stores a plurality of original content items comprising animating content that is automatically played when rendered at client devices and a plurality of converted content items that (i) are generated from the plurality of original content items and that (ii) are not played at the client devices until interaction with a particular user interface element that is overlaid on a static image of the converted content items;

a converter system, including one or more processors, in communication with the content database that;

receives the plurality of original content items from the content database, wherein each of the original contents items is automatically played when rendered at the client devices;

generates the plurality of converted content items from the plurality of original content items, wherein the plurality of converted content items require user interaction with the particular user interface element to be played, and wherein the converter system performs the generation of the plurality of converted content items by performing operations comprising;

for a particular original content item, identifying, from the particular original content item, a relevant static image;

extracting, from the particular original content item, the relevant static image from the particular original content item;

creating a particular converted content item by overlaying the relevant static image with the particular user interface element that initiates playback of the particular converted content item in response to interaction with the particular user interface element; and

storing the particular converted content item that includes the relevant static image overlaid with the particular user interface element in the content database;

a content distribution system, including one or more processors, in communication with the content database, that;

receives, from a remote client device, multiple requests for content;

in response to each request for content, identifies the particular original content item from the plurality of original content items stored on the content database;

determines whether to provide the particular converted content item created using the particular original content item or the particular original content item based on the determination; and

provides, to the remote client device, one of the particular converted content item or the particular original content item based on the determination, wherein the particular original content item is provided for at least one of the multiple requests, and the particular converted content item is provided for one or more of the multiple requests.

2. The system of claim 1, wherein the content distribution system further:

receives, from the remote client device, a user request to view animated content related to the particular converted content item that was generated by user interaction with the particular user interface element included in the first converted content item; and

in response to receiving the user request to view animated content, provides, to the remote client device, the particular original content item.

3. The system of claim 1, wherein the plurality of original content items comprise autoplay HTML content and the plurality of converted content items comprise click-to-play content.

4. The system of claim 1, wherein the converter system further analyzes original content items in the content database and identifies original content items that are eligible for conversion.

5. The system of claim 4, wherein identifying original content items that are eligible for conversion comprises identifying original content items that are larger than a threshold file size.

6. The system of claim 1, wherein overlaying the relevant static image with one or more user interface elements comprises:

identifying a template that defines the one or more user interface elements and relative positions of the one or more interface elements.

7. The system of claim 6, wherein the template further defines at least one of a level of grayscale or level of opacity.

8. The system of claim 1, wherein the particular converted content has a smaller file size than the particular original content item.

9. The system of claim 1, wherein the content distribution system receives the request for content and provides the particular converted content item to one of a web browser or native application on the client device.

10. The system of claim 1, wherein the content database stores each of the plurality of converted content items in association with a corresponding original content item.

11. The system of claim 1, wherein the plurality of converted content items comprise substantially static content.

12. The system of claim 1, wherein the request for content from the remote client device comprises a request for animating content.

13. The system of claim 1, wherein determining whether to provide to the remote client device the particular original content item or the particular converted content item comprises:

determining a file size of the particular original content item and a file size of the particular converted content item; and

based on a comparison of the file size of the particular original content item and the file size of the particular converted content item with a threshold file size, selecting the particular converted content item.

14. A computer-implemented method comprising:

receiving, by a content database and from one or more content providers, a plurality of original content items comprising animating content;

generating, by one or more processors, a plurality of converted content items from the plurality of original content items, the generating comprising;

for a particular original content item, identifying, from the particular original content item, a relevant static image;

extracting, from the particular original content item, the relevant static image from the particular original content item;

creating a particular converted content item by overlaying the relevant static image with the particular user interface element that initiates playback of the particular converted content item in response to interaction with the particular user interface element; and

storing the particular converted content item that includes the relevant static image overlaid with the particular user interface element in the content database;

storing, by the one or more processors, each of the plurality of converted content items in the content database in association with a corresponding original content item;

receiving, from a remote client, multiple requests for content;

in response to each request for content, identifying the particular original content item from the plurality of original content items stored on the content database;

determining whether to provide the particular converted content item created using the particular original content item or the particular original content item based on the determination; and

providing, to the remote client device, one of the particular converted content item or the particular original content item based on the determination, wherein the particular original content item is provided for at least one of the multiple requests, and the particular converted content item is provided for one or more of the multiple requests.

15. The computer-implemented method of claim 14, further comprising:

receiving, from the remote client device, a user request to view animated content related to the particular converted content item that was generated by user interaction with the particular user interface element included in the first converted content item; and

in response to receiving the user request to view animated content, providing, to the remote client device, the particular original content item.

16. The computer-implemented method of claim 14, wherein the plurality of original content items comprise autoplay HTML content and the plurality of converted content items comprise click-to-play content.

17. The computer-implemented method of claim 14, wherein determining whether to provide to the remote client device the particular original content item or the particular converted content item, comprising:

determining a file size of the first particular original content item and a file size of the particular converted content item; and

based on a comparison of the file size of the particular original content item and the file size of the particular converted content item with a threshold file size, selecting the particular converted content item.

18. One or more non-transitory computer-readable media having instructions stored thereon that, when executed by one or more processors, cause performance of operations comprising:

receiving, from one or more content providers, a plurality of original content items comprising animating content;

generating a plurality of converted content items from the plurality of original content items, the generating comprising;

for a particular original content item, identifying, from the particular original content item, a relevant static image;

extracting, from the particular original content item, the relevant static image from the particular original content item;

creating a particular converted content item by overlaying the relevant static image with the particular user interface element that initiates playback of the particular converted content item in response to interaction with the particular user interface element; and

storing the particular converted content item that includes the relevant static image overlaid with the particular user interface element in the content database;

storing each of the plurality of converted content items in the content database in association with a corresponding original content item;

receiving, from a remote client, multiple requests for content;

in response to each request for content, identifying the particular original content item from the plurality of original content items stored on the content database; and

determining whether to provide the particular converted content item created using the particular original content item or the particular original content item based on the determination; and

providing, to the remote client device, one of the particular converted content item or the particular original content item based on the determination, wherein the particular original content item is provided for at least one of the multiple requests, and the particular converted content item is provided for one or more of the multiple requests.