Media System with Integrated Clip Views

• US 20110016395A1
• Filed: 09/23/2010
• Published: 01/20/2011
• Est. Priority Date: 09/20/2006
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Margulis, Vlad
• Granted Patent: US 8,543,918 B2
• Time in Patent Office: Days
• US Class Current: 715/716
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Systems and methods for presenting audio data involve obtaining audio data that includes audio clips, and presenting the audio data for a first audio clip in a user interface having an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the audio clips, and a timeline element configured to present both chronological and durational information for the first audio clip or the audio segment on a defined time scale. Techniques involve adjusting the defined time scale in the timeline element based on durational information of a selected second audio clip, and presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element. Animation is used in the timeline element for presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element.

Claims

1. A system comprising:

a processor to process audio;

a memory to store the audio;

a graphical user interface configured to play and edit the audio, the graphical user interface comprising;

an audio segment user interface element configured to play an audio segment, wherein the audio segment comprises a plurality of selectable audio clips;

an audio clip user interface element configured to present a chronological representation of the plurality of selectable audio clips; and

a timeline configured to present timing data associated with the audio segment; and

a time scaler configured to remove a representation of the timing data associated with the audio segment or timing data for a displayed audio clip in the timeline, and scale a representation of timing data associated with a selected audio clip,

wherein the graphical user interface is configured to present the representation of the timing data associated with the selected audio clip within a defined time scale in the timeline, and

wherein the system is configured to animate the removal of the representation of the timing data associated with the audio segment or timing data for the displayed audio clip in the timeline, and animate the scaling of the representation of timing data associated with the selected audio clip.

2. The system in accordance with claim 1, wherein the chronological representation comprises thumbnail representations of the plurality of selectable audio clips.

3. The system in accordance with claim 1, wherein the timeline is further configured to present chronological and durational information about the plurality of selectable audio clips on the defined time scale.

4. The system in accordance with claim 1, wherein the system is configured to select a most recently-played audio clip for the selected audio clip.

5. The system in accordance with claim 1, wherein the graphical user interface is configured to concurrently present the selected audio clip presented in the audio segment user interface element and a chronological representation of at least one of the plurality of selectable audio clips that is chronologically adjacent to the selected audio clip.

6. The system in accordance with claim 1, wherein the graphical user interface further comprises a control panel for audio playback, wherein the control panel comprises controls for playing, stopping, pausing, fast forwarding, rewinding, and skipping audio.

7. The system in accordance with claim 1, wherein the graphical user interface further comprises a media bin panel comprising audio data for playing in the audio segment user interface element, wherein the audio data in the media bin panel comprises one or more audio clips, and audio segments.

8. The system in accordance with claim 7, wherein the graphical user interface further comprises a properties panel to present properties for media selected from the media bin panel, wherein the properties panel comprises volume controls.

9. The system in accordance with claim 1, wherein the system is configured to:

detect when the animation of the removal and scaling has been completed; and

upon detecting that the animation of the removal and scaling has been completed, present the representation of the timing data associated with the selected audio clip within the defined time scale in the timeline at a location that is underneath the selected audio clip.

10. The system in accordance with claim 1, wherein the time scaler is further configured to scale a representation of the timing data associated with a selected audio clip when an audio segment ceases playing in the audio segment user interface element.

11. A computer program product, encoded on a computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

obtaining audio data comprising a plurality of audio clips;

presenting the audio data in a user interface comprising an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the audio clips, and a timeline element configured to present both chronological and durational information about a first audio clip on a defined time scale;

receiving a selection for a second audio clip from one of the audio clips through the clip selection element;

adjusting, in response to the selection, the defined time scale in the timeline element based on durational information of the second audio clip; and

presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element, wherein an animation is used in the timeline element for presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element.

12. The computer program product in accordance with claim 11, the operations further comprising:

determining a duration of the first audio clip and a duration of the second audio clip; and

comparing the duration of the first audio clip and the duration of the second audio clip,

wherein if the duration of the first audio clip is less than the duration of the second audio clip, the animation illustrates a stretching of the durational information of the first audio clip to the durational information of the second audio clip to illustrate that the duration of the second audio clip is longer than the duration of the first audio clip, and

wherein if the duration of the first audio clip is greater than the duration of the second audio clip, the animation illustrates a compression of the durational information of the first audio clip to the durational information of the second audio clip to illustrate that the duration of the second audio clip is shorter than the duration of the first audio clip.

13. The computer program product in accordance with claim 11, wherein the selection of one of the audio clips comprises:

detecting when audio data in the user interface stops playing; and

selecting a most recently-played audio clip for the adjusting of the defined time scale.

14. The computer program product in accordance with claim 11, wherein the selection of the second audio clip comprises a selection from an audio clip user interface element configured to present a chronological representation of audio clips in the audio data.

15. A method for presenting audio data comprising:

obtaining audio data comprising plurality of audio clips;

presenting the audio data for a first audio clip in a user interface comprising an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the plurality of audio clips, and a timeline element configured to present both chronological and durational information for the first audio clip or an audio segment on a defined time scale;

receiving a selection for a second audio clip from one of the plurality of audio clips through the clip selection element;

adjusting, in response to the selection, the defined time scale in the timeline element based on durational information of the second audio clip; and

presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element, wherein an animation is used in the timeline element for presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element.

16. The method in accordance with claim 15, further comprising presenting

determining a duration of the first audio clip and a duration of the second audio clip;

and

comparing the duration of the first audio clip and the duration of the second audio clip,

wherein if the duration of the first audio clip is less than the duration of the second audio clip, the animation illustrates a stretching of the durational information of the first audio clip to the durational information of the second audio clip to illustrate that the duration of the second audio clip is longer than the duration of the first audio clip, and

wherein if the duration of the first audio clip is greater than the duration of the second audio clip, the animation illustrates a compression of the durational information of the first audio clip to the durational information of the second audio clip to illustrate that the duration of the second audio clip is shorter than the duration of the first audio clip.

17. The method in accordance with claim 15, wherein the selection of one of the plurality of audio clips comprises a selection from an audio clip user interface element configured to present a chronological representation of audio clips in the audio data.

18. The method in accordance with claim 15, wherein the selection of one of the plurality of audio clips comprises:

detecting when audio data in the user interface stops playing; and

selecting a most recently-played audio clip for the second audio clip.

19. The method in accordance with claim 18, further comprising:

detecting an initiation to play the audio data;

presenting the audio data in the audio play element; and

presenting the durational information for the audio data in the timeline element.

20. The method in accordance with claim 15, further comprising presenting a chronological representation of the plurality of audio clips that are chronologically adjacent to the one of the audio clips selected.

21. A computer program product, encoded on a computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

presenting an audio segment or a first audio clip of the audio segment in an audio segment user interface element, wherein the audio segment comprises one of a plurality of audio clips, wherein the audio segment user interface element is configured to play the audio segment or one of the plurality of audio clips from the audio segment;

presenting a first representation of a first time duration in a timeline corresponding to the audio segment or the first audio clip;

receiving a selection of a second audio clip from the plurality of audio clips to present in the audio segment user interface element;

replacing the first representation of the first time duration in the timeline with a second representation of a second time duration corresponding to the second audio clip, wherein the replacing comprises adjusting the first representation to the second time duration in a defined time scale in the timeline;

presenting the second representation associated with the second audio clip in the timeline by animating the adjusting of the first representation to the second time duration; and

presenting the second audio clip in the audio segment user interface element.

22. The computer program product in accordance with claim 21, the operations further comprising:

presenting a chronological representation of a plurality of audio clips that are chronologically adjacent to the audio clip.

23. The computer program product in accordance with claim 22, wherein the presenting the chronological representation of the plurality of audio clips comprises presenting the chronological representation of the plurality of audio clips that are chronologically adjacent to the audio clip when the audio clip is selected for presentation in the audio segment user interface element.

24. The computer program product in accordance with claim 21, wherein the animating of the adjusting of the first representation to the second time duration comprises operations for providing the animation by stretching or compressing the representations of the first or second time durations as a factor of whether the first time duration is longer or shorter than the second time duration.

25. The computer program product in accordance with claim 24, the operations further comprising:

detecting when the audio segment or the first audio clip stops playing; and

triggering the selection of the second audio clip to present in the audio segment user interface.

26. The computer program product in accordance with claim 25, the operations further comprising:

prior to receiving the selection of the second audio clip,

detecting an initiation to play the audio segment or the first audio clip;

presenting the audio segment or the first audio clip in the audio segment user interface element; and

presenting a representation of the first time duration of the audio segment in the

27. A method comprising:

obtaining audio data comprising a plurality of audio clips;

presenting the audio data in a user interface comprising an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the audio clips, and a timeline element configured to present both chronological and durational information about a first audio clip on a defined time scale;

receiving a selection for a second audio clip from one of the audio clips through the clip selection element;

adjusting, in response to the selection, the defined time scale in the timeline element based on durational information of the second audio clip; and

presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element by animating the adjusting of the defined time scale in the timeline element.

28. The method in accordance with claim 27, wherein the animating of the adjusting of the defined time scale comprises animating by stretching or compressing representations of time durations of the first or second audio clips as a factor of whether the first audio clip has a longer duration or a shorter duration than the second audio clip.

29. The method in accordance with claim 27, wherein the selection of one of the audio clips comprises:

detecting when audio data in the user interface stops playing; and

selecting a most recently-played audio clip for the adjusting of the defined time scale.

30. The method in accordance with claim 27, wherein the selection of the second audio clip comprises a selection from an audio clip user interface element configured to present a chronological representation of audio clips in the audio data.

31. A computer program product, encoded on a computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

obtaining audio data comprising an audio segment, the audio segment comprising a plurality of audio clips;

presenting the audio data in a user interface comprising an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the audio clips, and a timeline element configured to present both chronological and durational information for a first audio clip or the audio segment on a defined time scale;

receiving a selection for a second audio clip from one of the plurality of audio clips through the clip selection element;

adjusting, in response to the selection, the defined time scale in the timeline element based on durational information of the second audio clip; and

presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element by animating the adjusting of the defined time scale in the timeline element.

32. The computer program product in accordance with claim 31, wherein the operations for the animating of the adjusting of the defined time scale comprises operations for animating by stretching or compressing representations of time durations of the first or second audio clips as a factor of whether the first audio clip has a longer duration or a shorter duration than the second audio clip.

33. The computer program product in accordance with claim 31, wherein the selection of one of the plurality of audio clips comprises a selection from an audio clip user interface element configured to present a chronological representation of audio clips in the audio data.

34. The computer program product in accordance with claim 31, wherein the selection for a second audio clip comprises:

detecting when audio data in the user interface stops playing; and

selecting a most recently-played audio clip for the second audio clip.

35. The computer program product in accordance with claim 34, the operations further comprising:

detecting an initiation to play the audio data;

presenting the audio data in the audio play element; and

presenting the durational information for the audio data in the timeline element.

36. The computer program product in accordance with claim 31, the operations further comprising presenting a chronological representation of the plurality of audio clips that are chronologically adjacent to the one of the audio clips selected.

37. A method comprising:

presenting an audio segment or a first audio clip of the audio segment in an audio segment user interface element, wherein the audio segment comprises one of a plurality of audio clips, wherein the audio segment user interface element is configured to play the audio segment or one of the plurality of audio clips from the audio segment;

presenting a first representation of a first time duration in a timeline corresponding to the audio segment or the first audio clip;

receiving a selection of a second audio clip from the plurality of audio clips to present in the audio segment user interface element;

replacing the first representation of the first time duration in the timeline with a second representation of a second time duration corresponding to the second audio clip, wherein the replacing comprises adjusting the first representation to the second time duration in a defined time scale in the timeline;

presenting the second representation associated with the second audio clip in the timeline by animating the adjusting of the first representation to the second time duration; and

presenting the second audio clip in the audio segment user interface element.

38. The method in accordance with claim 37, further comprising:

presenting a chronological representation of a plurality of audio clips that are chronologically adjacent to the audio clip.

39. The method in accordance with claim 38, wherein the presenting the chronological representation of the plurality of audio clips comprises presenting the chronological representation of the plurality of audio clips that are chronologically adjacent to the audio clip when the audio clip is selected for presentation in the audio segment user interface element.

40. The method in accordance with claim 37, wherein the animating of the adjusting of the first representation to the second time duration comprises operations for providing the animation by stretching or compressing the representations of the first or second time durations as a factor of whether the first time duration is longer or shorter than the second time duration.

41. The method in accordance with claim 40, further comprising:

detecting when the audio segment or the first audio clip stops playing; and

triggering the selection of the second audio clip to present in the audio segment user interface.

42. The method in accordance with claim 41, further comprising:

prior to receiving the selection of the second audio clip,

detecting an initiation to play the audio segment or the first audio clip;

presenting the audio segment or the first audio clip in the audio segment user interface element; and

presenting a representation of the first time duration of the audio segment in the timeline.

43. A system comprising:

a processor to process audio;

a memory to store the audio;

a graphical user interface to present audio data, wherein the audio data comprises an audio segment comprising a plurality of audio clips, wherein the graphical user interface comprises an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the audio clips, and a timeline element configured to present both chronological and durational information for a first audio clip or the audio segment on a defined time scale;

wherein the clip selection element is configured to receive a selection for a second audio clip from one of the plurality of audio clips,

wherein the timeline element is configured to adjust, in response to the selection, the defined time scale based on durational information of the second audio clip, and

wherein the graphical user interface is configured to present the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element by animating the adjusting of the defined time scale.

44. The system in accordance with claim 43, wherein the graphical user interface is configured to present animation in the timeline element to indicate the adjusting of the defined time scale by stretching or compressing representations of time durations of the first or second audio clips as a factor of whether the first audio clip has a longer duration or a shorter duration than the second audio clip.

45. The system in accordance with claim 43, wherein the audio clip user interface element is configured to present a chronological representation of audio clips in the audio data.

46. The system in accordance with claim 43, wherein the system is configured to detect when audio data in the user interface stops playing and select a most recently-played audio clip for the second audio clip.

47. The system in accordance with claim 46, wherein the system is configured to detect an initiation to play the audio data, present the audio data in the audio play element, and present the durational information for the audio data in the timeline element.

48. The system in accordance with claim 43, wherein the system is configured to present a chronological representation of the plurality of audio clips that are chronologically adjacent to the one of the audio clips selected.

49. A system comprising:

a processor to process audio;

a memory to store the audio;

a graphical user interface comprising an audio segment user interface element, wherein the graphical user interface is configured to;

present an audio segment or a first audio clip of the audio segment in the audio segment user interface element, wherein the audio segment comprises one of a plurality of audio clips, wherein the audio segment user interface element is configured to play the audio segment or one of the plurality of audio clips from the audio segment;

present a first representation of a first time duration in a timeline corresponding to the audio segment or the first audio clip;

receive a selection of a second audio clip from the plurality of audio clips to present in the audio segment user interface element;

replace the first representation of the first time duration in the timeline with a second representation of a second time duration corresponding to the second audio clip, wherein the replacing comprises adjusting the first representation to the second time duration in a defined time scale in the timeline;

present the second representation associated with the second audio clip in the timeline by animating the adjusting of the first representation to the second time duration; and

present the second audio clip in the audio segment user interface element.

50. The system in accordance with claim 49, wherein the system is configured to present a chronological representation of a plurality of audio clips that are chronologically adjacent to the audio clip.

51. The system in accordance with claim 50, wherein the system is configured to present the chronological representation of the plurality of audio clips that are chronologically adjacent to the audio clip when the audio clip is selected for presentation in the audio segment user interface element.

52. The system in accordance with claim 49, wherein the system is configured to animate the adjusting of the first representation to the second time duration by stretching or compressing the representations of the first or second time durations as a factor of whether the first time duration is longer or shorter than the second time duration.

53. The system in accordance with claim 52, wherein the system is configured to detect when the audio segment or the first audio clip stops playing and trigger the selection of the second audio clip to present in the audio segment user interface.

54. The system in accordance with claim 53, wherein the system is configured to, prior to receiving the selection of the second audio clip, detect an initiation to play the audio segment or the first audio clip, present the audio segment or the first audio clip in the audio segment user interface element, and present a representation of the first time duration of the audio segment in the timeline.