Context aware image representation

• US 8,433,993 B2
• Filed: 06/24/2009
• Issued: 04/30/2013
• Est. Priority Date: 06/24/2009
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Slaney, Malcolm, Weinberger, Kilian Quirin
• Primary Examiner(s): HUYNH, CONG LAC T
• Application Number:
  US12/491,217
• Publication Number:
  US 20100332958A1
• Time in Patent Office: 1,406 Days
• Field of Search: 715/202, 715/201, 715/204
• US Class Current: 715/202
• CPC Class Codes: G06F 16/4387 by the use of playlists

Abstract

Methods and system for rendering context aware multimedia content include identifying a plurality of multimedia content that is uploaded for rendering. The uploaded multimedia content is examined to determine metadata associated with each of the plurality of multimedia contents. Contextual information associated with the metadata is identified and a grouping of the multimedia content into a plurality of groups is performed based on the contextual information. Each of the plurality of groups is then integrated into one or more photo stories. The photo stories are defined and rendered as content rich documents.

Claims

1. A method for rendering context aware multimedia content, comprising:

identifying a plurality of multimedia content uploaded for rendering;

examining the uploaded multimedia content to determine metadata associated with each of the plurality of multimedia content;

identifying contextual information associated with the multimedia content from the metadata;

performing a grouping of the multimedia content into a plurality of groups based on the contextual information; and

integrating the one or more groups into one or more photo stories, wherein the one or more photo stories are defined as content rich documents for rendering the groups of multimedia content, wherein the integrating further includes identifying and integrating a theme for rendering each of the photo stories based on the contextual information of the multimedia content in the respective group, and integrating one or more of a timeline map, a minimap, one or more of other photo stories and other contextual map, the timeline map, minimap, other photo stories and contextual map configured to be rendered alongside the one or more photo stories and are interactive so as to provide additional information related to temporal, geographical, contextual and social aspect related to the one or more events captured within the multimedia content or the one or more photo stories.

2. The method of claim 1, wherein the metadata is embedded within the multimedia content, wherein the metadata encompasses one or more of social, temporal, geographical and spatial aspect of the multimedia content.

3. The method of claim 1, wherein examining the uploaded multimedia content further includes analyzing one of a textual content or characteristics of an image to obtain contextual information of the multimedia content, wherein the contextual information is used in categorizing the multimedia content into corresponding one or more categories when generating a photo story.

4. The method of claim 1, wherein integrating the one or more groups further includes,

identifying a pre-defined photo story with contextual information that matches the contextual information associated with a group of the multimedia content;

and

updating the identified pre-defined photo story with the multimedia content from the group of multimedia content.

5. The method of claim 4, further includes,

obtaining additional contextual information associated with each of the multimedia content at the content rich document upon rendering the photo story of multimedia content;

and

updating the metadata associated with each of the multimedia content within the rendered photo story with the additional contextual information, the updated metadata providing increased contextual information for subsequent grouping of the multimedia content.

6. The method of claim 4, wherein when the contextual information associated with a group of multimedia content does not match a pre-defined story, the method further includes,

examining the metadata associated with the multimedia content to determine a type of event and category associated with the multimedia content;

and

generating a new photo story for rendering the multimedia content based on the type of event and category.

7. The method of claim 6, wherein the new photo story is stored in a media story repository along with the pre-defined photo stories for sharing with other users.

8. The method of claim 1, further includes,

rendering one or more photo stories as content rich documents in response to a user'"'"'s request;

receiving one or more changes to a multimedia content in response to the rendered photo story;

analyzing the one or more changes to identify metadata associated with the multimedia content;

automatically updating the change to the rendered photo story when the one or more changes include metadata with contextual information that match the contextual information associated with the rendered photo story for a user, the updated multimedia content stored in a media story repository and a multimedia repository for future rendering.

9. The method of claim 8, wherein updating the change further includes generating of sub-groupings and sub-photo stories within the corresponding groupings and photo stories.

10. The method of claim 8, further includes,

when the contextual information of the multimedia content associated with the change does not match the contextual information associated with the photo story,

searching the media story repository to determine if contextual information associated with other photo stories of the user matches the contextual information associated with the change;

identifying a new photo story of the user with contextual information matching the contextual information of the multimedia content, wherein the new photo story is different from the photo story currently associated with the multimedia content with the change; and

regrouping the multimedia content so as to be integrated into the identified new photo story, the regrouping removing the multimedia content from the current photo story.

11. The method of claim 10, wherein when the searching of the media story repository does not find a match of any photo story, generating a new photo story using the contextual information associated with the multimedia content having the change.

12. The method of claim 1, wherein integrating the one or more groups further includes providing permission to a group of users to access the multimedia content rendered in the photo stories, the permission based on status of a user within the group of users.

13. The method of claim 1, further includes,

when the multimedia content is one of a video clip or a film,

converting the video clip or the film into individual pictures by determining shot boundaries, the individual pictures being rendered along with the video clip or the film in the mini-webpages.

14. A system for rendering context aware multimedia content on a client, comprising:

a server,

a content classifier and management module disposed on the server, the content classifier and management module having code logic which when executed by the server enables management of multimedia content for rendering on a client including,

an upload detector logic to identify a plurality of multimedia content uploaded for rendering;

a metadata handler logic to,

examine the uploaded multimedia content to determine metadata associated with each of the plurality of multimedia content;

detect contextual information associated with the multimedia content from the metadata;

perform a grouping of the multimedia content into a plurality of groups based on the contextual information, each of the plurality of groups defining a distinct category;

define a theme for each of the plurality of groups based on the contextual information associated with the respective group;

a media update agent logic to integrate the one or more groups into one or more photo stories based on the metadata, wherein the integration includes integrating one or more of a timeline map, a minimap, one or more of other photo stories and other contextual map for rendering alongside the one or more photo stories, the timeline map, minimap, other photo stories and contextual map are interactive and provide additional information related to temporal, geographical, contextual and social aspect related to the one or more events captured within the multimedia content included in the one or more photo stories and a corresponding theme defined for the respective group, the one or more photo stories defined as mini-webpages for rendering the groups of multimedia content.

15. The system of claim 14, wherein the content classification and management module further includes,

a media story generator logic to create a new photo story when the one or more photo stories do not match the contextual information associated with a group of the multimedia content;

and

a media story manager logic to manage the contents of the one or more photo stories based on updates received from the client.

16. The system of claim 14, further includes a media storage repository for storing the distinct categories, multimedia content and one or more photo stories for future mining, wherein the content classification and management module further includes a media storage manager logic to interact with the media storage repository to store and retrieve multimedia content.

17. The system of claim 14, further includes a video converter module to convert video clip or film of the multimedia content to individual digital images, the video converter module having logic to identify the individual digital images by determining boundaries encompassing each digital image, the individual digital images being rendered along with the video clip or the film in the mini-webpages.

18. A method for rendering context aware multimedia content, comprising:

identifying a plurality of multimedia content uploaded for rendering;

examining the uploaded multimedia content to determine metadata associated with each of the plurality of multimedia content;

identifying contextual information associated with the multimedia content from the metadata;

performing a grouping of the multimedia content into a plurality of groups based on the contextual information; and

integrating the one or more groups into one or more photo stories, wherein the one or more photo stories are defined as content rich documents for rendering the groups of multimedia content,

wherein the integrating further includes identifying and integrating one or more interactive maps related to the groups of multimedia content, the interactive maps rendered with the photo stories and includes links to information for one or more events associated with the one or more photo stories.

19. The method of claim 18, wherein the link is one of an internal link or an external link, wherein the internal link provides access to metadata information associated with the one or more events and the external link provides access to one or more related webpages for obtaining additional aspects of the photo stories.