Declarative markup for scoring multiple time-based assets and events within a scene composition system

• US 6,707,456 B1
• Filed: 08/03/2000
• Issued: 03/16/2004
• Est. Priority Date: 08/03/1999
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Broadwell, Peter G., Marrin, Christopher F., Kent, James R., Myeb, Robert K.
• Primary Examiner(s): Nguyen, Phu K.
• Application Number:
  US09/632,351
• Time in Patent Office: 1,321 Days
• Field of Search: 345/473, 345/474, 345/475, 711/158, 715/500.1
• US Class Current: 345/473
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums

Abstract

A system and method for declarative markup that allows temporal manipulation of media assets. The media assets can be audio media, video media, animations, audio-visual media, images or events. Using the present invention a media sequence can be formed by playing more than one medium in series, in parallel or in any other temporal combination wherein a medium is cued to another medium. A media sequence created using the present invention can become part of a new media sequence, and the rate of playing the media sequence can be controlled by fields associated with the new media sequence. Also, using present invention, a media sequence can be cued to start playing at a fixed time before the end of a first media sequence, and in this instance the length of the first media sequence can be varied while still maintaining the fixed time from the end of the first media sequence.

Claims

1. A computer readable medium comprises computer instructions for:

declaratively composing a first time-based media sequence from a first media sequence and a second media sequence, wherein the second media sequence follows the first media sequence; and

initiating the second media sequence at a predetermined time prior to an end point of the first media sequence regardless of a play rate of the first media sequence.

2. The computer readable medium of claim 1, further comprising computer instructions for declaratively controlling an animation.

3. The computer readable medium of claim 1, further comprising computer instructions for composing the first time-based media sequence wherein events can be integrated in the first time-based sequence in real time.

4. The computer system of claim 1, further comprising:

computer instructions for receiving a first rate value which controls the rate of playing of the first time-based media sequence,

wherein the rate of playing of the first time-based media sequence is changed in accordance with a change in the first rate value.

5. The computer system of claim 1, further comprising:

computer instructions for composing a second time-based media sequence; and

computer instructions for receiving a second rate value which controls the rate of playing of the first time-based media sequence;

wherein

the first time-based media sequence is part of the second time-based media sequence, and the rate of playing of the first time-based media sequence is changed in accordance with a change in the second rate value.

6. The computer readable medium of claim 1, further comprising:

computer instructions for receiving a third rate value, which controls the rate of playing of the second media sequence;

wherein the rate of playing of the second media sequence is changed in accordance with a change in the third rate value.

7. The computer readable medium of claim 1, wherein the first media sequence is played over a subset of its duration.

8. The computer readable medium of claim 1, wherein the playing of the second media sequence is delayed from the end of the playing of the first media sequence.

9. The computer readable medium of claim 1, wherein the time-base sequence can be played either in forward direction or in backward direction.

10. The computer readable medium of claim 1, further comprising:

computer instructions for declaratively receiving instructions to initiate a third media sequence a time before the end of the second media sequence.

11. The computer readable medium of claim 10, wherein the length of the second media sequence is not specified by the user.

12. The computer readable medium of claim 1, further comprising:

computer instructions for jumping from a first location on the first time-based media sequence to a second location on the first time based media sequence.

13. The computer readable medium of claim 12, wherein the first location is on the first media sequence and the second location is on the second media sequence.

14. The computer readable medium of claim 1, wherein the computer instructions for initiating loads the second media sequence.

15. The computer readable medium of claim 1, wherein the computer instructions for initiating plays the second media sequence.

16. A method of declaratively composing a first time-based sequence, the method comprising:

declaratively composing a first time-based media sequence from a first media sequence and a second media sequence, wherein the second media sequence follows the first media sequence; and

wherein the second media sequence is declaratively cued to the first media sequence and wherein the second media sequence is initiated at a predetermined time prior to an end point of the first media sequence regardless of a play rate of the first media sequence.

17. The method of claim 16, wherein the first media sequence and the second media sequence are selected from a group consisting of a video sequence, an audio sequence, an animation or an audio-visual sequence.

18. The method of claim 16, wherein the first media sequence and the second media sequence are preloaded so that each of the preloaded media can start instantly.

19. The method of claim 16, wherein the second media sequence is cued with a variable time relative to the first media sequence.

20. A method of declaratively composing a first time-based media sequence, the method comprising:

playing a first media sequence and a second media sequence to form the first time-based media sequence;

playing a third media sequence in parallel with the first time-based sequence,

wherein the second media sequence is initiated at a time prior to an end point of the first media sequence regardless of a play rate of the first media sequence.

21. The method of claim 20, further comprising:

controlling declaratively a visible image that is part of the media sequence selected from a group consisting of the first media sequence, the second media sequence and the third media sequence.

22. The method of claim 21, further comprising:

providing a first rate value which controls the rate of playing of the first time-based media sequence; and

changing the rate of playing of the first time-based media sequence in accordance with a change in the first rate value.

23. The method of claim 21, further comprising:

providing a second rate value associated with a second time-based media sequence, the second rate value controlling the rate of playing of the first time-based media sequence; and

changing the rate of playing of the first time-based media sequence in accordance with a change in the second rate value;

wherein

the first time-based media sequence is part of the second time-based media sequence.

24. The method of claim 21, further comprising:

providing a third rate value which controls the rate of playing of the second media sequence; and

changing the rate of playing of the second media sequence in accordance with a change in the third rate value.

25. The method of claim 21, further comprising:

playing the first media sequence over a subset of its duration.

26. The method of claim 21, further comprising:

delaying the playing of the second media sequence from the end of the playing of the first media sequence.

27. The method of claim 21, further comprising:

playing the first time-based media sequence in backward direction.

28. The method of claim 21, further comprising:

providing a fourth media sequence; and

loading the fourth media sequence at a time before the end of the third media sequence;

wherein

the fourth media sequence is loaded at the time before the end of the third media sequence for any length of the third media sequence.

29. The computer system of claim 21, further comprising:

jumping from a first location on the first time-based media sequence to a second location on the first time based media sequence.

30. The method of claim 29, wherein the first location is on the first media sequence and the second location is on the second media sequence.

31. A method of composing a media presentation, the method comprising:

providing a first media sequence and a second media sequence; and

providing at least one declaration defining a timing relationship which defines how the playing of each of the first media sequence and the second media sequence is related in a variable time wherein the variable time is based on an endpoint of the first media sequence regardless of a play rate of the first media sequence.

32. The method of claim 31, wherein the first media sequence and the second media sequence are selected from a group consisting of a video sequence, an audio sequence, an animation or an audio-visual sequence.