Iconic audiovisual data editing environment

• US 5,664,216 A
• Filed: 05/28/1996
• Issued: 09/02/1997
• Est. Priority Date: 03/22/1994
• Status: Expired due to Fees

• Current Assignee: Trevor Blumenau
• Original Assignee: Trevor Blumenau
• Inventors: Blumenau, Trevor
• Primary Examiner(s): Powell, Mark R.
• Assistant Examiner(s): dela Torre, Crescelle N.
• Application Number:
  US08/653,830
• Time in Patent Office: 462 Days
• Field of Search: 395/328, 395/327, 395/348, 395/967, 395/972, 395/978, 395/806, 395/807
• US Class Current: 715/234
• CPC Class Codes: G06F 8/34 Graphical or visual programming

Abstract

An iconic data editing environment and a method of editing data in such an environment. The environment includes: (1) a working area capable of receiving icons and symbols thereon, (2) a first icon capable of being placed on the working surface and symbolizing a data transformation process, the first icon having a first input portion representing a first process input and an output portion representing a process output and (3) a first data flow symbol capable of being placed on the working surface, symbolizing a communication of data between icons, the first icon and the first symbol freely movable on the working area to symbolize a flow of the first datum as a function of a relative location of the first icon and the first symbol on the working area. A user may therefore establish a process for transforming data by manipulating symbols. In one embodiment, the first datum is a portion of a single frame of a video stream.

Claims

1. An iconic audiovisual data editing system operable in conjunction with a general purpose computer, comprising:

a visual display providing a working area capable of receiving icons and symbols thereon;

a first icon generated by said system and capable of being placed on said working area and symbolizing an audiovisual data transformation process performable by said system, said first icon having a first input portion representing a first process input and an output portion representing a process output, said first process input capable of receiving a first electrical input signal representing a first audiovisual datum, said process transforming said first input signal to produce an electrical output signal at said process output representing a transformation of said first audiovisual datum, said first icon further having synchronization data associated therewith to allow said process input to be synchronized independent of an operation of said process; and

a first audiovisual data flow symbol generated by said system and capable of being placed on said working area, symbolizing a communication of audiovisual data between icons and thereby representing a communication of an electrical signal between audiovisual data transformation processes performable by said system, said first icon and said first symbol freely movable on said working area to symbolize a flow of said first audiovisual datum as a function of a relative location of said first icon and said first symbol on said working area.

2. The system as recited in claim 1 further comprising a second icon capable of being placed on said working area, said audiovisual data flow symbol capable of symbolically joining said output portion of said first icon to a first input portion of said second icon.

3. The system as recited in claim 1 wherein said first icon has a second input portion representing a second process input, said second process input capable of receiving a second electrical input signal representing a second audiovisual datum, said process combining and transforming said first and second input signals to produce said electrical output signal at said process output representing a combination and transformation of said first and second audiovisual data.

4. The system as recited in claim 1 wherein said first audiovisual datum is a portion of audio data.

5. The system as recited in claim 1 wherein said first audiovisual datum is a portion of a visual image.

6. The system as recited in claim 1 wherein said first audiovisual datum is a portion of a single frame of a video stream.

7. The system as recited in claim 1 wherein said audiovisual data flow symbol is a line capable of joining said icons.

8. The system as recited in claim 1 wherein said first icon symbolizes a plurality of audiovisual data transformation processes.

9. The system as recited in claim 1 wherein said first icon is initially located in an icon selection area proximate said working area.

10. The system as recited in claim 1 wherein said audiovisual data transformation process is a filter.

11. The system as recited in claim 1 wherein said audiovisual data transformation process is an effect.

12. The system as recited in claim 1 further comprising a source icon capable of being placed on said working area and only having an output.

13. The system as recited in claim 1 further comprising a sink icon capable of being placed on said working area and only having an input.

14. The system as recited in claim 2 further comprising a single hierarchical icon designating said flow and a synchronization of said first and second icons as represented by said relative location of said first and second icons and said first audiovisual data flow symbol.

15. A method of editing an audiovisual datum in an iconic system operable in conjunction with a general purpose computer, comprising the steps of:

providing a working area on a visual display of said system, said working area capable of receiving icons and symbols thereon;

placing a first icon generated by said system on said working area, said first icon symbolizing an audiovisual data transformation process performable by said system, said first icon having a first input portion representing a first process input and an output portion representing a process output, said first process input capable of receiving a first electrical input signal representing a first audiovisual datum, said process transforming said first input signal to produce an electrical output signal at said process output representing a transformation of said first audiovisual datum, said first icon further having synchronization data associated therewith to allow said process input to be synchronized independent of an operation of said process; and

placing a first audiovisual data flow symbol on said working area, said first symbol symbolizing a communication of audiovisual data between icons and thereby representing a communication of an electrical signal between audiovisual data transformation processes performable by said system, said first icon and said first symbol freely movable on said working area to symbolize a flow of said first audiovisual datum as a function of a relative location of said first icon and said first symbol on said working area.

16. The method as recited in claim 15 further comprising the step of placing a second icon on said working area, said audiovisual data flow symbol capable of symbolically joining said output portion of said first icon to a first input portion of said second icon.

17. The method as recited in claim 15 wherein said first icon has a second input portion representing a second process input, said second process input capable of receiving a second electrical input signal representing a second audiovisual datum, said process combining and transforming said first and second input signals to produce said electrical output signal at said process output representing a combination and transformation of said first and second audiovisual data.

18. The method as recited in claim 15 wherein said first audiovisual datum is a portion of audio data.

19. The method as recited in claim 15 wherein said first audiovisual datum is a portion of a visual image.

20. The method as recited in claim 15 wherein said first audiovisual datum is a single frame of a video stream.

21. The method as recited in claim 15 further comprising the step of joining said icons with said audiovisual data flow symbol, said audiovisual data flow symbol being a line.

22. The method as recited in claim 15 wherein said first icon symbolizes a plurality of audiovisual data transformation processes.

23. The method as recited in claim 15 wherein said step of placing comprises the step of dragging said first icon from an icon selection area proximate said working area.

24. The method as recited in claim 15 wherein said audiovisual data transformation process is a filter.

25. The method as recited in claim 15 wherein said audiovisual data transformation process is an effect.

26. The method as recited in claim 15 further comprising the step of placing a source icon on said working area, said source icon only having an output.

27. The method as recited in claim 15 further comprising the step of placing a sink icon on said working area, said sink icon only having an input.

28. The method as recited in claim 16 further comprising the step of designating a single hierarchical icon to represent said flow and a synchronization of said first and second icons as represented by said relative location of said first and second icons and said first audiovisual data flow symbol.

29. An iconic audiovisual data editing system operable in conjunction with a general purpose computer, comprising:

a visual display providing a working area capable of receiving icons and symbols thereon;

a first icon generated by said system and capable of being placed on said working area and symbolizing a first audiovisual data transformation process performable by said system, said first icon having a first input portion representing a first process input and a first output portion representing a first process output, said first process input capable of receiving a first electrical input signal representing a first audiovisual datum, said process transforming said first input signal to produce a first electrical output signal at said first process output representing a transformation of said first audiovisual datum;

a second icon capable of being placed on said working area and symbolizing a second audiovisual data transformation process performable by said system, said second icon having a second input portion representing a second process input and a second output portion representing a second process output, said second process input capable of receiving a second electrical input signal representing a second audiovisual datum, said process transforming said second input signal to produce a second electrical output signal at said second process output representing a transformation of said second audiovisual datum; and

means, associated with one of said first and second icons, for establishing a synchronization of said first and second inputs of said first and second icons.

30. The system as recited in claim 29 wherein each of said first and second icons has a configuration window associated therewith, said configuration window containing said syncrhonization establishing means.

31. The system as recited in claim 29 further comprising an audiovisual data flow symbol generated by said system and capable of being placed on said working area, symbolizing a communication of audiovisual data between said first and second icons and thereby representing a communication of an electrical signal between said first and second audiovisual data transformation processes performable by said system, said first and second icons and said symbol freely movable on said working area to symbolize a flow of said first and second audiovisual data as a function of a relative location of said first and second icons and said first symbol on said working area.

32. The system as recited in claim 29 wherein a configuration window associated with each of said first and second icons includes a frame counter and start time and end time counters.

33. The system as recited in claim 29 wherein said first and second audiovisual data are portions of audio data.

34. The system as recited in claim 29 wherein said first and second audiovisual data are portions of visual images.

35. The system as recited in claim 29 wherein said first and second audiovisual data are single frames of video streams.

36. The system as recited in claim 29 wherein said first icon symbolizes a plurality of audiovisual data transformation processes.

37. The system as recited in claim 29 wherein said first and second icons are initially located in an icon selection area proximate said working area.

38. The system as recited in claim 29 wherein said first audiovisual data transformation process is a filter.

39. The system as recited in claim 29 wherein said first audiovisual data transformation process is an effect.

40. The system as recited in claim 29 wherein a configuration window associated with said first icon contains a representation of said first output signal to thereby allow viewing of said first output signal.

41. The system as recited in claim 29 further comprising a single hierarchical icon designating said flow and said synchronization of said first and second icons as represented by said relative location of said first and second icons and an associated audiovisual data flow symbol.

42. A method of editing audiovisual data in an iconic system operable in conjunction with a general purpose computer, comprising the steps of:

providing a working area on a visual display of said system, said working area capable of receiving icons and symbols thereon;

placing a first icon generated by said system on said working area, said first icon symbolizing a first audiovisual data transformation process performable by said system, said first icon having a first input portion representing a first process input and a first output portion representing a first process output, said first process input capable of receiving a first electrical input signal representing a first audiovisual datum, said process transforming said first input signal to produce a first electrical output signal at said first process output representing a transformation of said first audiovisual datum;

placing a second icon on said working area, said second icon symbolizing a second audiovisual data transformation process performable by said system, said second icon having a second input portion representing a second process input and a second output portion representing a second process output, said second process input capable of receiving a second electrical input signal representing a second audiovisual datum, said process transforming said second input signal to produce a second electrical output signal at said second process output representing a transformation of said second audiovisual datum; and

establishing a synchronization between said first and second inputs of said first and second icons to thereby control a flow of said first and second audiovisual data.

43. The method as recited in claim 42 wherein said step of establishing comprises the step of placing a synchronization indicator within a configuration window associated with each of said first and second icons.

44. The method as recited in claim 42 further comprising the step of placing an audiovisual data flow symbol generated by said system on said working area, said symbol symbolizing a communication of audiovisual data between said first and second icons and thereby representing a communication of an electrical signal between said first and second audiovisual data transformation processes performable by said system, said first and second icons and said symbol freely movable on said working area to symbolize a flow of said first and second audiovisual data as a function of a relative location of said first and second icons and said first symbol on said working area.

45. The method as recited in claim 42 further comprising the step of setting a counter within a configuration window associated with each of said first and second icons, said counter selected from the group consisting of:

a frame counter,

a start time counter, and

an end time counter.

46. The method as recited in claim 42 wherein said first and second audiovisual data are portions of audio data.

47. The method as recited in claim 42 wherein said first and second audiovisual data are portions of visual images.

48. The method as recited in claim 42 wherein said first and second audiovisual data are single frames of video streams.

49. The method as recited in claim 42 wherein said first icon symbolizes a plurality of audiovisual data transformation processes.

50. The method as recited in claim 42 wherein said steps of placing comprise the step of dragging said first and second icons from an icon selection area proximate said working area.

51. The method as recited in claim 42 wherein said first audiovisual data transformation process is a filter.

52. The method as recited in claim 42 wherein said first audiovisual data transformation process is an effect.

53. The method as recited in claim 42 further comprising the step of viewing a representation of said first output signal in a configuration window associated with said first icon.

54. The method as recited in claim 42 further comprising the step of designating a single hierarchical icon to represent said flow and said synchronization of said first and second icons as represented by said relative location of said first and second icons and said audiovisual data flow symbol.

55. An iconic audiovisual data editing system operable in conjunction with a general purpose computer, comprising:

a visual display providing a working area capable of receiving icons and symbols thereon;

an icon selection area proximate said working area;

a source icon generated by said system and located in said icon selection area, capable of being placed on said working area and symbolizing an audiovisual data source, said source icon having an output portion representing a source output, said source icon having a configuration window associated therewith;

a filter icon generated by said system and located in said icon selection area, capable of being placed on said working area and symbolizing a single source audiovisual data transformation process performable by said system, said filter icon having a single input portion representing a single source process input and an output portion representing a single source process output, said filter icon having a configuration window associated therewith;

an effect icon generated by said system and located in said icon selection area, capable of being placed on said working area and symbolizing a multiple source audiovisual data transformation process performable by said system, said effect icon having multiple input portions representing multiple source process inputs and an output portion representing a multiple source process output, said effect icon having a configuration window associated therewith;

a hierarchical icon generated by said system and located in said icon selection area, capable of being placed on said working area and configurable to symbolize multiple audiovisual data transformation processes as a single audiovisual data transformation process performable by said system, said hierarchical icon having an input portion representing a process input and an output portion representing a process output, said hierarchical icon having a configuration window associated therewith;

a sink icon generated by said system and located in said icon selection area, capable of being placed on said working area and symbolizing an audiovisual data destination, said sink icon having an input portion representing a destination input, said sink icon having a configuration window associated therewith;

means for placing selectable ones of said icons at selected locations on said working area, said selected locations representing a relationship between said selected icons and a flow of audiovisual data, said audiovisual data selected from the group consisting of;

audio data,

graphical data,

a visual image, and

a single frame of a video stream;

a plurality of audiovisual data flow symbols generated by said system and capable of being placed on said working area to link said selected ones of said icons together to symbolize a communication of audiovisual data between icons, said icons and said symbols freely movable on said working area to symbolize said flow of audiovisual data as a function of a relative location of said icons and said symbols on said working area; and

means, associated with each of said configuration windows, for establishing a synchronization among said inputs of ones of said icons, said configuration windows containing a counter selected from the group consisting of;

an input synchronization counter,

a frame counter,

a start time counter, and

an end time counter.

56. The system as recited in claim 55 wherein said input synchronization counter allows synchronization of multiple inputs of said icons.