SYSTEMS AND METHODS FOR AUTOMATED CONTENT GENERATION

• US 20180203832A1
• Filed: 03/15/2018
• Published: 07/19/2018
• Est. Priority Date: 02/22/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Zhang, Guannan, Ye, Kai, Zhu, Yongtai, Yan, Zuo, Foster, Andrew, Bayliss-McCulloch, Jordan, Chang, Daly, Nonaka, Ayaka
• Granted Patent: US 10,235,349 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/345 Summarisation for human users
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/131 Fragmentation of text files, e.g. creating reusable text-blocks; Linking to fragments, e.g. using XInclude; Namespaces
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06T 1/00 General purpose image data processing
• CPC Class Codes: G06T 7/00 Image analysis

Abstract

A computerized method for automatically generating display content includes receiving a uniform resource locator, wherein the uniform resource locator specifies a landing resource and extracting visual information from the landing resource, wherein the visual information defines one or more images, texts, and colors displayed on the landing resource. The method further includes selecting one or more images, one or more text snippets, and one or more colors based on the visual information extracted from the landing resource, generating a layout for a content item based on one or more of the selected images or selected text snippets, and assembling the content item by applying the selected images, the selected text snippets, and the selected colors to the generated layout.

Claims

1-20. -20. (canceled)

21. A method for generating a layout for a content item, the method comprising:

obtaining a plurality of images and a plurality of text snippets;

creating, by one or more processors, a frame for the content item;

calculating automatically, by the one or more processors, a score for each of the plurality of images;

selecting, by the one or more processors, an image of the plurality of images having a highest score;

placing, by the one or more processors, the selected image having the highest score in a starting location within the frame of the content item;

dividing, by the one or more processors, a remaining unused space within the frame into a plurality of rectangles, at least one of the plurality of rectangles having a dimension corresponding to a dimension of the placed image;

combining, by the one or more processors, two or more rectangles of the plurality of rectangles in the remaining unused space to create a combined rectangle having a dimension accommodating a dimension of an unplaced image or text snippet of the obtained images and text snippets; and

placing, by the one or more processors, the unplaced image or text snippet into the combined rectangle.

22. The method of claim 21, wherein combining the two or more rectangles further comprises:

combining a first rectangle that is either horizontally adjacent or vertically adjacent to the location of the placed image with a second rectangle that is diagonally adjacent to the location of the placed image.

23. The method of claim 21, wherein obtaining the plurality of images and the plurality of text snippets further comprises:

receiving a uniform resource locator specifying a landing resource; and

extracting the plurality of images and the plurality of text snippets from the landing resource.

24. The method of claim 23, wherein extracting the plurality of images and the plurality of text snippets from the landing resource further comprises rendering the landing resource and generating a document object model tree based on the rendered resource.

25. The method of claim 21, wherein obtaining the plurality of images and the plurality of text snippets further comprises retrieving the plurality of images and the plurality of text snippets from a database.

26. The method of claim 21, wherein each of the plurality of images has respective associated metadata, and wherein calculating the score of each of the plurality of images further comprises calculating each score based on predetermined scores corresponding to each keyword in the metadata associated with the respective image.

27. The method of claim 26, wherein the metadata includes at least one of a URL, a display position, a display size, or alt text.

28. The method of claim 21, wherein calculating the score of each of the plurality of images further comprises calculating each score based on a value proportional to a distance between a center of the respective image and a horizontal center of a landing resource.

29. The method of claim 21, wherein calculating the score of each of the plurality of images further comprises calculating each score based on a display size of the respective image and a vertical placement of the respective image on a landing resource.

30. The method of claim 21, wherein placing the unplaced image or text snippet into the combined rectangle further comprises:

resizing the unplaced image or text snippet to fit the combined rectangle.

31. A system for generating a layout for a content item, the system comprising:

an image extractor, executed by a processor of a computing device, configured to obtain a plurality of images and a plurality of text snippets; and

a layout module, executed by the processor, configured to;

create a frame for the content item,

calculate automatically a score for each of the plurality of images,

select an image of the plurality of images having a highest score,

place the selected image having the highest score in a starting location within the frame of the content item,

divide a remaining unused space within the frame into a plurality of rectangles such that at least one rectangle of the plurality of rectangles has a dimension equal to a dimension of the placed image;

combine two or more rectangles of the plurality of rectangles in the remaining unused space to create a combined rectangle having a dimension accommodating a dimension of an unplaced image or text snippet of the obtained images and text snippets, and

place the unplaced image or text snippet into the combined rectangle.

32. The system of claim 31, wherein the layout module is further configured to:

combine a first rectangle that is either horizontally adjacent or vertically adjacent to the location of the placed image with a second rectangle that is diagonally adjacent to the location of the placed image.

33. The system of claim 31, wherein the image extractor is further configured to:

receive a uniform resource locator specifying a landing resource; and

extract the plurality of images and the plurality of text snippets from the landing resource.

34. The system of claim 31, further comprising a resource renderer configured to:

render the landing resource and generate a document object model tree based on the rendered resource.

35. The system of claim 31, wherein the image extractor is further configured to retrieve the plurality of images and the plurality of text snippets from a database.

36. The system of claim 31, wherein each of the plurality of images has respective associated metadata, and wherein the layout module is further configured to calculate the score of each of the plurality of images based on predetermined scores corresponding to each keyword in the metadata associated with the respective image.

37. The system of claim 36, wherein the metadata includes at least one of a URL, a display position, a display size, or alt text.

38. The system of claim 31, wherein the layout module is further configured to calculate the score of each of the plurality of images based on a value proportional to a distance between a center of the respective image and a horizontal center of a landing resource.

39. The system of claim 31, wherein the layout module is further configured to calculate the score of each of the plurality of images based on a display size of the respective image and a vertical placement of the respective image on a landing resource.

40. The system of claim 31, wherein the layout module is further configured to resize the unplaced image or text snippet to fit the combined rectangle.