Context Aware Image Representation

• US 20100332958A1
• Filed: 06/24/2009
• Published: 12/30/2010
• Est. Priority Date: 06/24/2009
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Slaney, Malcolm, Weinberger, Kilian Quirin
• Granted Patent: US 8,433,993 B2
• Time in Patent Office: Days
• US Class Current: 715/201
• CPC Class Codes: G06F 16/4387 by the use of playlists

Abstract

Methods and system for rendering context aware multimedia content include identifying a plurality of multimedia content that is uploaded for rendering. The uploaded multimedia content is examined to determine metadata associated with each of the plurality of multimedia contents. Contextual information associated with the metadata is identified and a grouping of the multimedia content into a plurality of groups is performed based on the contextual information. Each of the plurality of groups is then integrated into one or more photo stories. The photo stories are defined and rendered as content rich documents.

Claims

1. A method for rendering context aware multimedia content, comprising:

identifying a plurality of multimedia content uploaded for rendering;

examining the uploaded multimedia content to determine metadata associated with each of the plurality of multimedia content;

identifying contextual information associated with the multimedia content from the metadata;

performing a grouping of the multimedia content into a plurality of groups based on the contextual information; and

integrating the one or more groups into one or more photo stories, wherein the one or more photo stories are defined as content rich documents for rendering the groups of multimedia content.

2. The method of claim 1, wherein the metadata is embedded within the multimedia content, wherein the metadata encompasses one or more of social, temporal, geographical and spatial aspect of the multimedia content.

3. The method of claim 1, wherein examining the uploaded multimedia content further includes analyzing one of a textual content or characteristics of an image to obtain contextual information of the multimedia content, wherein the contextual information is used in categorizing the multimedia content into corresponding one or more categories when generating a photo story.

4. The method of claim 1, wherein integrating the one or more groups further includes,

identifying a pre-defined photo story with contextual information that matches the contextual information associated with a group of the multimedia content;

and

updating the identified pre-defined photo story with the multimedia content from the group of multimedia content.

5. The method of claim 4, further includes,

obtaining additional contextual information associated with each of the multimedia content at the content rich document upon rendering the photo story of multimedia content;

and

updating the metadata associated with each of the multimedia content within the rendered photo story with the additional contextual information, the updated metadata providing increased contextual information for subsequent grouping of the multimedia content.

6. The method of claim 4, wherein when the contextual information associated with a group of multimedia content does not match a pre-defined story, the method further includes,

examining the metadata associated with the multimedia content to determine a type of event and category associated with the multimedia content;

and

generating a new photo story for rendering the multimedia content based on the type of event and category.

7. The method of claim 6, wherein the new photo story is stored in a media story repository along with the pre-defined photo stories for sharing with other users.

8. The method of claim 1, wherein integrating the one or more groups into one or more photo stories further includes integrating any one or more of a minimap identifying geo-location associated with the multimedia content, a timeline map identifying the time period associated with the multimedia content or other contextual map related to one or more multimedia content.

9. The method of claim 1, further includes,

rendering one or more photo stories as content rich documents in response to a user'"'"'s request;

receiving one or more changes to a multimedia content in response to the rendered photo story;

analyzing the one or more changes to identify metadata associated with the multimedia content;

automatically updating the change to the rendered photo story when the one or more changes include metadata with contextual information that match the contextual information associated with the rendered photo story for a user, the updated multimedia content stored in a media story repository and a multimedia repository for future rendering.

10. The method of claim 9, wherein updating the change further includes generating of sub-groupings and sub-photo stories within the corresponding groupings and photo stories.

11. The method of claim 9, further includes,

when the contextual information of the multimedia content associated with the change does not match the contextual information associated with the photo story,

searching the media story repository to determine if contextual information associated with other photo stories of the user matches the contextual information associated with the change;

identifying a new photo story of the user with contextual information matching the contextual information of the multimedia content, wherein the new photo story is different from the photo story currently associated with the multimedia content with the change; and

regrouping the multimedia content so as to be integrated into the identified new photo story, the regrouping removing the multimedia content from the current photo story.

12. The method of claim 11, wherein when the searching of the media story repository does not find a match of any photo story, generating a new photo story using the contextual information associated with the multimedia content having the change.

13. The method of claim 1, wherein integrating the one or more groups further includes providing permission to a group of users to access the multimedia content rendered in the photo stories, the permission based on status of a user within the group of users.

14. The method of claim 1, further includes,

identifying video component of the multimedia content;

and

converting the video component of the multimedia content to individual pictures by determining shot boundaries, the individual pictures being rendered along with the video component in the mini-webpages.

15. A system for rendering context aware multimedia content on a client, comprising:

a content classifier and management module disposed on a server, the content classifier and management module having code which when executed by the server provides logic to manage multimedia content for rendering on a client including,

an upload detector logic to identify a plurality of multimedia content uploaded for rendering;

a metadata handler logic to,

examine the uploaded multimedia content to determine metadata associated with each of the plurality of multimedia content;

detect contextual information associated with the multimedia content from the metadata;

perform a grouping of the multimedia content into a plurality of groups based on the contextual information, each of the plurality of groups defining a distinct category;

a media update agent logic to integrate the one or more groups into one or more photo stories based on the metadata, the one or more photo stories defined as mini-webpages for rendering the groups of multimedia content.

16. The system of claim 15, wherein the content classification and management module further includes a media story generator logic to create a new photo story when the one or more photo stories do not match the contextual information associated with a group of the multimedia content.

17. The system of claim 15, wherein the content classification and management module further includes a media story manager logic to manage the contents of the one or more photo stories based on updates received from the client.

18. The system of claim 15, further includes a media storage repository for storing the distinct categories, multimedia content and one or more photo stories for future mining, wherein the content classification and management module further includes a media storage manager logic to interact with the media storage repository to store and retrieve multimedia content.

19. The system of claim 15, further includes a video converter module to convert video component of the multimedia content to individual digital images, the video converter module having logic to identify the individual digital images by determining boundaries encompassing each digital image, the individual digital images being rendered along with the video component in the mini-webpages.