Template-based multimedia authoring and sharing

• US 8,196,032 B2
• Filed: 11/01/2005
• Issued: 06/05/2012
• Est. Priority Date: 11/01/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hua, Xian-Sheng, Li, Shipeng
• Primary Examiner(s): NGUYEN, CHAU T
• Application Number:
  US11/263,718
• Publication Number:
  US 20070101271A1
• Time in Patent Office: 2,408 Days
• Field of Search: 715/731, 715/200, 715202-203, 715/234, 715723-726
• US Class Current: 715/202
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence

Abstract

Systems and methods for template-based multimedia authoring and sharing are described. In one aspect, media content is selectively applied to a content description template to author media in a content description. The content description template provides a temporal structure for the applied media content. A content representation template is selected and combined with the temporally structured media in the content description to specify rendering criteria and generate a content description and representation for one or more of rendering, sharing, and exporting the temporally structured authored media.

Claims

1. A computer-implemented method comprising:

receiving raw media content;

generating analyzed input media by parsing the raw media content, the parsing comprising an online filter that parses an entire stream of the raw media content to extract basic metadata and an offline filter that extracts additional metadata directly from the basic metadata without parsing the raw media content;

applying the analyzed input media, based at least in part on the basic metadata and the additional metadata, to a content description template to author media in a content description, the content description template providing a temporal structure, composition methods, rules, and preferences for the analyzed input media; and

applying, by a processing unit, a content representation template to the content description template, based at least in part on the basic metadata and the additional metadata, to specify output rendering criteria for the raw media content and generate a content description and representation, wherein the output rendering criteria specify output to a specific media, wherein the content description and representation provides for rendering, sharing, and exporting authored media content.

2. The method of claim 1, wherein the temporal structure represents one or more hierarchical storyline chapters and scenes.

3. The method of claim 1, wherein rendering criteria comprises specification of a target rendering, the target rendering comprising one or more rendering destinations of a DVD, a web site, slides, video, still images.

4. The method of claim 1, wherein the content description template, the content description, the content representation template, and the content description and representation are Extended Markup Language files.

5. The method of claim 1, wherein selectively applying further comprises selecting one or more of video, still images, and audio for placement into the temporal structure to generate a storyline.

6. The method of claim 1, wherein selectively applying further comprises displaying a media browsing interface for a user to assign respective portions of the media content to the temporal structure.

7. The method of claim 6, wherein displaying the media browsing interface includes displaying a set of lattices corresponding to respective segments of the temporal structure, each lattice representing a respective portion of the media content.

8. The method of claim 1, further comprising selecting one or more of the content description template and the content representation template from respective local or remote template libraries.

9. The method of claim 1, further comprising adding one or more of a caption, a credit, a transition, and a video effect to media content assigned to one or more portions of the temporal structure.

10. The method of claim 1, further comprising creating one or more of the content description template and the content representation template.

11. The method of claim 1, further comprising one or more of rendering and sharing media content associated with the content description and representation.

12. The method of claim 1, further comprising exporting authored media content associated with a first content representation template to a target representation associated with a second content representation template, the first content representation template not being the same as the second content representation template.

17. The method of claim 1, wherein the online filter comprises at least one of a shot detection filter, a timestamp extraction filter, or a histogram extraction filter.

18. The method of claim 1, wherein the offline filter comprises at least one of a scene detection filter or a quality assessment filter.

19. The method of claim 7, wherein the content description template for one of the sets of lattices is inherited from a parent lattice.

13. A computer-implemented method comprising:

filtering multimedia content using a multimedia filtering device to identify media content appropriate for both a content description template and a user-modifiable content representation template, the filtering comprising using each of an online filter and an offline filter, wherein the online filter filters the multimedia content by parsing the multimedia content, and wherein the online filter comprises;

a shot detection filter to detect shot boundaries,

a timestamp extraction filter, and

a histogram extraction filter to extract a color histogram; and

wherein the offline filter filters the multimedia content without parsing the multimedia content to extract additional metadata directly;

selectively applying the identified media content to the content description template to author media in a content description, the content description template providing a temporal structure for the identified media content, the content description template being associated with one or more of an editing method and corresponding editing parameters, a rule, and a preference within which a user can organize and edit the identified media content with respect to the temporal structure;

applying, by a processing unit, the user-modifiable content representation template to the content description to specify rendering representation criteria for the identified media content and to generate a content description and representation, the content representation template comprising;

an XML template definition scheme,

a template rendering engine, and

a content rendering engine, wherein the content rendering engine renders the identified media content according to the specified representation criteria, and wherein the specified representation criteria specify output to a website; and

wherein the content description and representation provides for rendering, sharing, and exporting authored media content.

14. The method of claim 13, wherein selectively applying further comprises displaying a media browsing interface for a user to assign respective portions of the media content to the temporal structure.

15. The method of claim 13, further comprising providing one or more independent template editors to create the content description template and the content representation template.

16. The method of claim 13, further comprising one or more of rendering, sharing, and exporting media content associated with the content description and representation.

20. Computer-readable storage media storing computer-readable instructions that direct a template-based-multimedia authoring and sharing device to perform acts comprising:

selectively applying media content to a content description template to author media in a content description, the content description template providing a temporal structure for the media content and being associated with one or more of an editing method and corresponding editing parameters, a rule, and a preference within which a user can organize and edit the media content with respect to the temporal structure, wherein the content description template and the content description are Extended Markup Language (XML) files;

displaying a media browsing interface that includes a set of lattices corresponding to respective portions of the media content, each lattice representing a respective portion of the media content, the media browsing interface for a user to assign the respective portions of the media content to the temporal structure;

applying, by a processing unit, a content representation template to the content description template to specify output rendering criteria for the media content and generate a content description and representation, wherein the output rendering criteria specify output to a specific media, wherein the content description and representation provides for rendering, sharing, and exporting authored media content, wherein the content representation template, and the content description and representation are XML files;

filtering multimedia content to identify the media content appropriate for one or both of the content description template and the content representation template, the filtering comprising one or more video, photo, and music content filtering operations and further comprising using each of (i) an online filter comprising a shot detection filter to detect shot boundaries, a timestamp extraction filter, and a histogram extraction filter to extract a color histogram and (ii) an offline filter that filters the multimedia content without parsing the multimedia content to extract additional metadata directly; and

exporting authored media content associated with a first content representation template to a target representation associated with a second content representation template, the first content representation template not being the same as the second content representation template.