Generating a collage for rendering on a client computing device

• US 9,552,342 B2
• Filed: 01/09/2014
• Issued: 01/24/2017
• Est. Priority Date: 01/09/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Portnoy, Will, Jensen, Craig, Laird-McConnell, Tom, Lewallen, James H.
• Primary Examiner(s): RIES, LAURIE ANNE
• Application Number:
  US14/151,710
• Publication Number:
  US 20150193409A1
• Time in Patent Office: 1,111 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

Various technologies pertaining to generation of a client collage are described herein. A creator can construct a computer-implemented collage by selecting a plurality of computer-implemented objects from a respective plurality of network-accessible storage locations, and arranging the computer-implemented objects in a desired manner. Responsive to receiving an indication that the computer-implemented collage is suitable for publication, a server can render the collage and capture a backdrop image of the rendered collage. The server can further generate metadata that are packaged with the backdrop image as a client collage. When a client computing device requests the collage, the client collage is provided to the client computing device, which renders the backdrop image and processes the metadata. The metadata causes a click overlay to be placed upon the backdrop image, wherein functionality of the click overlay is defined by the metadata.

Claims

1. A method, comprising:

receiving a computer-implemented collage, the collage comprising objects from respective source locations on a network, the objects having a spatial arrangement in the collage;

responsive to receiving the computer-implemented collage, generating a client collage, wherein generating the client collage comprises;

generating a computer-implemented backdrop image, the backdrop image comprising portions that are respectively representative of the objects, the portions arranged in the spatial arrangement; and

generating metadata for the backdrop image, the metadata identifying;

boundaries of the portions of the objects in the image; and

respective locations of the objects on the network, the client collage comprising the backdrop image and the metadata; and

storing the client collage at a network-accessible storage location, the client collage servable to a client computing device responsive to receipt of a request for the collage from the client computing device.

2. The method of claim 1, the objects comprising a video from a first source location, the collage comprising the video at a first position therein, and generating the client collage comprises:

receiving, from the first source location, a frame of the video; and

generating the backdrop image based upon the frame of the video, the backdrop image comprising an image of the frame of the video at a position therein that spatially corresponds to the first position in the collage, the metadata comprising data that identifies the first source location.

3. The method of claim 2, the video composed of a plurality of frames that are arranged in a sequence, the frame being a first frame in the sequence.

4. The method of claim 1, the objects comprising an animated image from a first source location, the collage comprising the animated image at a first position therein, and generating the client collage comprises:

obtaining, from the first source location, a frame of the animated image; and

generating the backdrop image based upon the frame of the animated image, the backdrop image comprising an image of the frame of the animated image at a position therein that spatially corresponds to the first position in the collage, the metadata comprising data that identifies the first source location.

5. The method of claim 1, the objects comprising a plurality of images, generating the client collage further comprises:

retrieving the plurality of images from their respective locations on the network;

downsampling each image in the plurality of images to generate a respective plurality of downsampled images; and

generating the backdrop image based upon the respective plurality of downsampled images.

6. The method of claim 1, the objects being of respective different media types.

7. The method of claim 1, further comprising:

receiving, from the client computing device, a request for a web page that comprises the collage; and

responsive to receiving the request, serving the web page to the client computing device, the web page comprising data that identifies the network-accessible location of the client collage.

8. The method of claim 1, further comprising:

receiving, from the client computing device, a request for the collage; and

responsive to receiving the request for the collage, transmitting the client collage to the client computing device.

9. The method of claim 1, further comprising:

subsequent to the client collage being generated, re-generating the client collage, wherein re-generating the client collage comprises;

requesting an object in the objects from its respective source location in the source locations;

receiving an indication that the object is no longer accessible at the source location; and

generating an updated backdrop image based upon the indication that the object is no longer accessible at the source location, the updated backdrop image comprising a blank space at a position in the backdrop image that corresponds to a position of the object in the collage.

10. The method of claim 1, the collage comprises text, and generating the client collage comprises:

identifying a position of the text in collage;

extracting the text from the collage; and

generating the metadata to include;

the text extracted from the collage; and

the position of the text in the collage, wherein when the client collage is rendered at the client computing device, the text extracted from the collage is overlaid on the backdrop image at a position thereon that corresponds to the position of the text in the collage.

11. The method of claim 1, further comprising:

expiring the client collage responsive to a threshold amount of time passing from the generating of the client collage.

12. A system comprising:

a processor; and

a memory that comprises a client collage generator component that is executed by the processor, the client collage generator component configured to;

receive a computer-implemented collage, the computer-implemented collage comprising a plurality of objects from a respective plurality of network-accessible source locations, the plurality of objects arranged in the collage in a spatial arrangement;

responsive to receipt of the computer-implemented collage, generating a client collage, the client collage comprising;

a backdrop image that comprises a plurality of portions, the portions respectively corresponding to the objects in the computer-implemented collage, the portions arranged in the spatial arrangement; and

metadata that identifies;

boundaries of the portions in the backdrop image; and

the network-accessible source locations of the objects that respectively correspond to the portions; and

responsive to generating the client collage, storing the client collage in computer-readable data storage at a network location that is accessible to a client computing device that issues a request for the computer-implemented collage.

13. The system of claim 12, the plurality of objects comprising at least one image and at least one video, wherein the client collage generator component generates the client collage such that a portion in the plurality of portions that corresponds to the at least one video includes a frame that is representative of content of the at least one video.

14. The system of claim 13, the metadata further comprising:

graphical data that, when interpreted at the client computing device, is overlaid on the portion that corresponds to the video, the graphical data indicating that the portion represents the video; and

a link to a network-accessible source location of the video, the link overlaying the portion of the backdrop image that corresponds to the video when the client collage is rendered at the client computing device.

15. The system of claim 12, the metadata written in conformance with a scripting language.

16. The system of claim 15, the metadata, when processed by the client computing device, configured to cause the client computing device to retrieve dynamic content responsive to receiving user input with respect to content rendered on a display screen of the client computing device.

17. The system of claim 12, the plurality of objects being of a plurality of different respective media types.

18. The system of claim 17, the media types comprising an image type, a video type, or an animated image type.

19. The system of claim 12, wherein the client collage generator component is further configured to:

extract text from the computer-implemented collage; and

include instructions in the client collage that cause the client computing device to overlay the text extracted from the object onto the backdrop image when rendered at the client computing device.

20. A computer-readable storage medium comprising instructions that, when executed by a processor, cause the processor to perform acts comprising:

receiving a collage, the collage comprising a plurality of objects of a respective plurality of different types, the plurality of objects retrievable from a respective plurality of network-accessible data stores, the plurality of objects arranged in a spatial arrangement in the collage;

receiving a request to publish the collage as at least a portion of a post by way of a social media application;

responsive to receiving the collage and the request, generating a client collage, wherein generating the client collage comprises;

generating a backdrop image that comprises a plurality of portions that are respectively representative of the plurality of objects, the plurality of portions arranged in the spatial arrangement in the backdrop image;

generating metadata, the metadata, when processed at a client computing device, causing an interactive overlay to be placed over the backdrop image; and

storing the client collage in a network-accessible location, wherein the client collage is retrieved responsive to the client computing device accessing the post.