AUDIO/VISUAL EDITING TOOL
First Claim
Patent Images
1. A user interface for integrating visual data and audio data together for creating an audio-visual work, said user interface comprising:
- a visual timeline associated with a visual data sequence comprising one or more visual elements, said visual timeline depicting the beginning and end of each of said one or more visual elements, said visual timeline further including visual event markers indicating the corresponding time on the timeline of a particular visual event in the visual data sequence; and
an audio timeline associated with an audio data sequence comprising one or more audio elements, said audio timeline corresponding to the same time scale and position in time as the visual timeline, said audio timeline depicting at least one audio characteristic of the audio data sequence over time, said audio timeline further including audio event markers indicating the corresponding time on the timeline of a particular audio event in the audio data sequence;
said visual event markers and audio event markers providing visual indications regarding events within the respective visual data sequence and audio data sequence.
2 Assignments
0 Petitions
Accused Products
Abstract
Analyzing data sequences, such as video and audio segments, and extracting metadata from the data sequences for providing information related to events of the data sequences. The metadata extracted is used for making editing decisions, such as for an audio-visual production comprised of a collection of video and audio segments. The metadata identifies events of importance in the video and audio segments, which may then be applied to the editing process. A user interface including the extracted metadata in a timeline format facilitates editing the audio-visual production.
143 Citations
20 Claims
-
1. A user interface for integrating visual data and audio data together for creating an audio-visual work, said user interface comprising:
-
a visual timeline associated with a visual data sequence comprising one or more visual elements, said visual timeline depicting the beginning and end of each of said one or more visual elements, said visual timeline further including visual event markers indicating the corresponding time on the timeline of a particular visual event in the visual data sequence; and an audio timeline associated with an audio data sequence comprising one or more audio elements, said audio timeline corresponding to the same time scale and position in time as the visual timeline, said audio timeline depicting at least one audio characteristic of the audio data sequence over time, said audio timeline further including audio event markers indicating the corresponding time on the timeline of a particular audio event in the audio data sequence; said visual event markers and audio event markers providing visual indications regarding events within the respective visual data sequence and audio data sequence. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method for generating a user interface for an audio-visual work, said method comprising:
-
extracting metadata associated with a visual data sequence according to at least one characteristic of said visual data sequence; extracting metadata associated with an audio data sequence according to at least one characteristic of said audio data sequence; determining intersections of metadata from two or more of said extracted metadata occurring at substantially the same time; associating metadata and metadata intersections with a visual timeline associated with the visual data sequence; associating metadata and metadata intersections with an audio timeline associated with the audio data sequence; and integrating the visual timeline and the audio timelines onto a user interface. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19)
-
-
20. A system for generating a user interface for creating an audio-visual work, said system comprising:
-
a metadata extraction module for extracting metadata associated with a visual data sequence according to at least one characteristic of said visual data sequence and for extracting metadata associated with an audio data sequence according to at least one characteristic of said audio data sequence, wherein an intersection of metadata from two or more of said extracted metadata occurs at substantially the same time and wherein each metadata and the intersection of metadata is associated with a timeline location corresponding to a timeline relating the data sequences; and a user interface metadata association module for associating metadata and metadata intersections with a visual timeline associated with the visual data sequence and an audio timeline associated with the audio data sequence, said user interface metadata association module integrating the visual timeline and the audio timelines onto a user interface.
-
Specification