Synchronization aspects of interactive multimedia presentation management

• US 20070006063A1
• Filed: 02/15/2006
• Published: 01/04/2007
• Est. Priority Date: 07/01/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hughes, Robert, Colle, Olivier, Jewsbury, Andrew, Finger, James
• Granted Patent: US 8,799,757 B2
• Time in Patent Office: Days
• US Class Current: 715/255
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G11B 2220/2541 Blu-ray discs; Blue laser DVR discs
• CPC Class Codes: G11B 2220/2579 HD-DVDs [high definition DVDs]; AODs [advanced optical discs]
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: H04N 5/04 Synchronising for television systems using pulse code modulation H04N7/56
• CPC Class Codes: H04N 5/85 on discs or drums

Abstract

An interactive multimedia presentation has a predetermined presentation play duration, a video content component (which may include video, audio, data, or any combination thereof), and an interactive content component. Methods and systems for playing the presentation include specifying a time when a particular media object is renderable. The time is specifiable using an application instruction that references either a first timing signal having a rate that is based on the play speed of the presentation, or a second timing signal having a continuous rate. One example of an application instruction usable as described above is an element associated with an XML data structure. An attribute of the element, such as the clock attribute, may be used to provide time values for the element that reference either timing signal. The attribute is used to maintain frame-accurate synchronization between the video and the interactive content components of the presentation.

Claims

1. A method for playing an interactive multimedia presentation having a play speed, a video content component and an interactive content component, the interactive content component comprising an application having instructions for rendering a plurality of media objects, the method comprising:

producing a first timing signal at a rate based on the play speed;

producing a second timing signal at a continuous predetermined rate;

accessing an instruction specifying a time when a media object is renderable, the instruction specifying the time based on one of the first timing signal and the second timing signal; and

arranging for rendering the media object at the time.

2. The method according to claim 1, wherein when the instruction specifies the time based on the first timing signal, the step of arranging for rendering comprises arranging for rendering the media object synchronously with the video content component, and wherein the video content component comprises samples selected from the group consisting of video, audio, and data.

3. The method according to claim 1, wherein when the instruction specifies the time based on the second timing signal, the step of arranging for rendering comprises arranging for rendering the media object independent of the video content component.

4. The method according to claim 1, wherein the instruction comprises an application instruction.

5. The method according to claim 4, wherein the application instruction is in a declarative form.

6. The method according to claim 5, wherein the application instruction comprises an element associated with an extensible markup language (“

XML”

) data structure.

7. The method according to claim 6, wherein the time is specified using an attribute of the element.

8. The method according to claim 7, wherein the attribute comprises a clock attribute.

9. The method according to claim 6, wherein a syntax of the XML data structure complies with specifications for high definition video published by the DVD Forum.

10. The method according to claim 4, wherein the application instruction is in a script form.

11. The method according to claim 1, wherein the first timing signal comprises a clock input used to coordinate a rate at which the video content component is received from a video source, and wherein the video content component comprises samples selected from the group consisting of video, audio, and data.

12. The method according to claim 1, wherein the second timing signal comprises a wall clock signal.

13. The method according to claim 1, wherein the first timing signal and the second timing signal are derived from the same clock signal.

14. The method according to claim 1, wherein the play speed comprises one of a zero speed, a slow-forward speed, a fast-forward speed, a slow-reverse speed, and a fast-reverse speed.

15. A computer-readable medium encoded with computer-executable instructions for performing the steps recited in claim 1.

16. An apparatus for playing an interactive multimedia presentation having a play speed, a video content component and an interactive content component, the interactive content component comprising an application having instructions for rendering a plurality of media objects, the apparatus comprising:

a computer-readable storage medium; and

a processor responsive to the computer-readable storage medium and to a computer program, the computer program, when loaded into the processor, operable to

access a first timing signal having a rate based on the play speed,

access a second timing signal having a continuous predetermined rate,

access an instruction specifying a time when a media object is renderable, the instruction specifying the time based on one of the first timing signal and the second timing signal, and

based on the instruction, arrange for rendering the media object at the time.

17. The apparatus according to claim 16, wherein when the instruction specifies the time based on the first timing signal, the computer program is operable to arrange for rendering of the media object synchronously with the video component, and wherein when the instruction specifies the time based on the second timing signal, the computer program is operable to arrange for rendering of the media object independent of the video content component, and wherein the video content component comprises samples selected from the group consisting of video, audio, and data.

18. The apparatus according to claim 16, wherein the processor is associated with an optical disc player.

19. The apparatus according to claim 18, wherein the optical disc player complies with specifications for high definition video published by the DVD Forum.

20. The apparatus according to claim 18, wherein the processor is associated with an electronic device.