Video composition method and apparatus

• US 4,538,188 A
• Filed: 12/22/1982
• Issued: 08/27/1985
• Est. Priority Date: 12/22/1982
• Status: Expired due to Term

• Current Assignee: Lex Computer and Management Corp.
• Original Assignee: Montage Computer Corporation
• Inventors: Schuler, Chester L., Barker, Ronald C.
• Primary Examiner(s): Faber, Alan
• Application Number:
  US06/452,287
• Time in Patent Office: 979 Days
• Field of Search: 360/14.1, 360/14.2, 360/14.3, 360/722, 360/33.1, 369/30, 369/32, 369/83
• US Class Current: 386/282
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/024 on tapes G11B27/028, G11B27/029 take precedence
• CPC Class Codes: G11B 27/028 with computer assistance
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/323 Time code signal, e.g. on a cue track as SMPTE- or EBU-time code
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: G11B 27/36 Monitoring, i.e. supervising the progress of recording or reproducing for digital recording G11B20/00 and s.gr.; for monitoring, testing or measuring of TV recorders of the type covered by H04N5/76 and subgroups, see H04N17/06

Abstract

A video composition apparatus and method select segments from image source material stored on at least one storage media and denote serially connected sequences of the segments to thereby form a composition sequence. The apparatus and method employ pictorial labels associated with each segment for ease of manipulating the segments to form the composition sequence. The labels are displayed on an ordered spatial array of display monitors to simulate the temporal relationship between the segments in what is typically a "snapshot" non-temporal display. The composition control function is highly user interactive and responds to user commands for selectively displaying segments from the source material on a pictorial display. The control function allows the user to denote a start and end of each of a plurality of selected segments to form defined segments, identify each selected segment by a pictorial image segment label which is displayed as described above, and assemble the selected and defined segments, and the corresponding labels, into a serially connected image sequence and a serially connected label sequence corresponding to the image sequence. The composition mode of operation employs continuous looping of the displayed segment(s) to aid in the composing process.

Claims

1. Composing apparatus for selecting segments from image source material stored in at least one storage medium and for denoting serially connected sequences of said segments, said apparatus comprising

a pictorial display means,

an operator control means, and

a composing control means responsive to said operator control means for controlling said storage media and said pictorial display means, said composing control means comprising

means for denoting a start and an end of each of a plurality of segments of said source material,

means for identifying each said segment by a pictorial image segment label,

means for selectively displaying segments of said image source material on said pictorial display means,

means for assembling at least a plurality of said labels into a serially connected label sequence,

operator responsive means for locating any said segment by displaying said pictorial labels in said label sequence, and

said displaying means being further adapted for displaying the segment identified by a selected label.

2. The composing apparatus of claim 1 wherein said composing control means further comprises

means for grouping serially connected ones of said connected segments into segment groups, said segments in said segment groups having the same connected serial relationship as in said connected image sequence,

in which

said identifying means are further selectively operable for identifying each segment group by a pictorial group label,

said operator responsive locating means are further selectively operable for locating any said segment group by displaying said pictorial group labels in a group label sequence corresponding to said segment group sequence relationship, and

means responsive to said operator control means for selectively operating upon said segments and said segment groups using said labels and label groups.

3. The composing apparatus of claim 1

further wherein said pictorial display means comprises a plurality of pictorial display screens arranged in an ordered array, and

wherein said operator responsive locating means further comprises

means for providing said display screens with electrical signals pictorially representing a selected limited number of said sequence of said labels;

and

operator responsive means for changing the displayed labels.

4. The composing apparatus of claim 3 further wherein said pictorial display means comprises

a plurality of display processors, each processor being responsive to said composing control means for receiving electrical signals representing an image to be displayed and for repeatedly providing said received image to be displayed on pictorial display screens associated therewith.

5. The composing apparatus of claim 3 further wherein

said operator responsive changing means selectively sequences said labels on said plural display screens according to said label sequence for searching for a labeled segment of said image source.

6. The composing apparatus of claim 1 wherein said identifying means includes means for labeling each segment by two pictorial images, a first label image corresponding to a beginning frame of said segment and a second label image corresponding to an ending frame of said segment.

7. The composing apparatus of claim 1 wherein said apparatus comprises at least a first and a second serial storage medium, each storing a representation of said segment to be displayed, and

wherein said selectively displaying means comprises

means for selectively controlling image information retrieval from said first and second storage media for repetitively cycling said first and second storage media for alternate image information retrieval whereby a continuous loop presentation of said segment can be displayed.

8. The composing apparatus of claim 7 wherein said composing control means further comprises

means for inserting an interruption display image on said display means between repetitions of said repeating segment.

9. The composing apparatus of claim 1 wherein said apparatus comprises

a first serial storage memory for storing a representation of a first segment to be displayed,

a second serial storage memory for storing a representation of a second segment to be displayed, and

wherein said composing control means further comprises means for selectively controlling image information retrieval from said first and second serial memories for repetitively and alternately displaying said first and second segments whereby a continuous loop alternating presentation of said first and second segments is displayed.

10. The composing apparatus of claim 9 wherein said composing control means further comprises

operator responsive means for varying a transition between said first and second segments.

11. The composing apparatus of claim 10 wherein said composing control means further comprises

means for generating a transition display segment for insertion between said first and second segments, and

means for inserting said transition segment into the serially connected image sequence between said first and second segments.

12. The composing apparatus of claim 9 wherein said denoting means further comprises

means for dynamically changing the start and end of each of said first and second segments.

13. The composing apparatus of claim 1 further comprising

a plurality of video tape recorders each having a video output,

a plurality of video tape recorder interfaces, each said interface being associated with one of said recorders,

each said interface being further connected to said composing control means,

whereby said composing control means operates and controls each said video tape recorder through its associated interface.

14. The composing apparatus of claim 13 wherein said display means further comprises

a plurality of display screens, and

an output video switch means responsive to said composing control means for connecting the video outputs of selected ones of said recorders to selected ones of said display screens.

15. The composing apparatus of claim 14 further comprising

a video digitizing means having an analog-to-digital converter and a read/write digital storage memory,

means for connecting said digitizing means to said output video switch means and to said composing control means, and

further wherein said pictorial display means comprises

a plurality of display processors, each processor being responsive to said composing control means for receiving electrical signals representing an image to be displayed and for repeatedly providing said received image to be displayed on pictorial display screens associated therewith, and

means responsive to said composing control means for converting a video input from said switch means into digital data and for storing said data in a digital memory, and

means responsive to said composing means for making said data in said digital memory available to said display processors.

16. The composing apparatus of claim 14 further comprising

a plurality of video input lines,

an input video switch means responsive to said composing control means for connecting selected ones of said video input lines to selected ones of said video tape recorders.

17. The composing apparatus of claim 16 further comprising

a video clock generation means for generating clock signals including field address signals, and

said composing control means further comprising

means for selectively adding said address signals to video image data generated within said apparatus.

18. The composing apparatus of claim 13 further comprising

a video clock generation means for generating clock signals including field address signals, and

said composing control means further comprising

means for selectively adding said address signals to video image data generated within said apparatus, and

means for connecting said clock signals to each said recorder interface.

19. Apparatus for composing image source material stored on at least one image storage medium, said source material being composed of a sequence of serially stored fields representing a time sequential visual image, sequences of said fields being associated to form visual segments, said apparatus comprising

a pictorial display means for providing a pictorial representation of a selected current segment of interest,

an operator control means,

a composing control means operative with said medium and said operator control means and comprising

means responsive to said operator control means for repetitively selecting successive current segments,

means for repetitively making available to said display means electrical signals pictorially representing a then selected current segment,

means for selecting from the then current segment, at least one labeling field for identifying said segment,

operator responsive means for defining said current segment to form a current defined segment by denoting a new beginning and ending of said segment,

means for maintaining a record of said sequences of defined segments in accordance with the label selecting and defining means, and

means responsive to said operator control means for selectively providing electrical signals to said display means for pictorially representing at least a labeling field.

20. Apparatus for composing image source material stored on at least one image storage medium, said source material being composed of a sequence of stored fields representing a time sequential visual image, sequences of said fields being associated to form a visual segment, said apparatus comprising

an active pictorial display means for providing a temporal pictorial presentation of a selected segment, designated the current segment,

a plurality of passive pictorial display means, each for providing a visual presentation of a selected field of a sequence of fields forming a said visual segment, each said selected field thereby labeling one said visual segment,

a plurality of storage memories,

operator control means, and

a composing control means operative with said medium and said operator control means, said composing control means comprising

means responsive to said operator control means for repeatedly selecting among said sequences of fields for editing said sequences, a last selected sequence being the segment designated the current segment,

means for repetitively providing said active display with electrical signals from said at least one storage medium pictorially representing said current segment in a repeating display,

means for selectively supplying each said passive display means with electrical data signals representing a selected one of a sequence of said labeling fields,

means for associating with each said current segment at least one current label field, and

means for maintaining a record of the sequence of current segments.

21. The composing apparatus according to claim 20 wherein said control means further comprises

means for manipulating said label fields representing said segments for forming a composed medium representation.

22. The composing apparatus according to claim 20 further comprising

a system clock,

a plurality of video tape recording means, each having a video output line and a video input line,

a plurality of recording means interface units connected to said composing control means and each unit having

means for operating an associated recorder in a forward mode and in a reverse mode,

means for controlling the timing of forward and reverse operation of each said recording means, and

said repetitively providing means further comprising

means for selectively and repetitively switching between said video output of at least two of said recording means for repetitively providing said current segment in a continuous loop format to said active display means.

23. The composing apparatus of claim 22 wherein said repetitively providing means further comprises

an operator responsive means for varying the segment playback rate of the current segment being displayed by said active pictorial display, and

an operator responsive designation control for designating from a current segment a beginning field label and an ending field label.

24. The composing apparatus of claim 20 wherein said display means further comprises

an ordered plurality of pictorial display means pairs, each pair having a first display screen for providing a visual presentation of a beginning label and a second display screen for providing a visual presentation of an ending label, each said pair of beginning and ending labels being associated with a segment of the sequence of current segments, and

said repetitively providing means further comprising means for selecting a segment corresponding to a selected label for display by said active display means.

25. The composing apparatus of claim 20 further comprising

an operator console,

said active display means being adapted to provide at least one display screen on said console,

each said passive display means being adapted to provide a plurality of display screens on said console, said screens being positioned in an ordered spatial array,

said selectively supplying means being further adapted to provide said passive display means with electrical signals representing a sequence of said pictorial labels, and

said passive display means further comprising

a display interface for receiving instructions from said composing control means and video data representing pictorial labels and for effecting an ordered pictorial presentation of said labels on said screens,

whereby the spatial display on said screens provides in effect a temporal snapshot representation of a sequence of said segments.

26. The composing apparatus of claim 25 further comprising

means for mounting said screens in a two row ordered array, each column of screens being adapted to display a label pair associated with a defined segment, and

said composing control means further comprising

means for dynamically searching through said labels by shifting said labels in the direction of an array row,

whereby a search through said sequence of segments can be effected.

27. The composing apparatus of claim 25 further wherein

said composing control means comprises means for adding text material to said pictorial label representing electrical signals, and

switch means for selectively displaying said text material on said passive display screens.

28. The composing apparatus of claim 20 further comprising

a system clock means,

means for writing a clocked identification tag to be associated with each said field, each identification tag for a field associated with one storage medium being uniquely identifiable from the identification tag associated with any other field associated with said one storage medium,

a controlling interface associated with each said storage medium, said controller including means for receiving instructions from said composing control means and clock signals from said clock means,

said instructions including at least a playback start time relative to said system clock means, a starting field identification, and a display time duration, and

said interface means being further adapted for retrieving data from said storage medium in accordance with said instructions.

29. The composing apparatus of claim 28 wherein each said storage medium is a video tape recorder, and

further comprising

means for recording on said recorder a video input signal, and

means for recording with said signal said clocked identification tags.

30. The composing apparatus of claim 20 wherein said composing control means further comprises

a central digital processor,

a digital bus connected to said processor, and said passive display means further comprising

a plurality of display maintaining interface means being connected to passive display screens, and

each display maintaining means comprising

a display storage element for storing a digital representation of a label to be displayed,

bus means for communicating with said digital bus, and

display screen interface means for providing analog signals to said display screens for providing said visual presentation.

31. The composing apparatus of claim 30 further comprising

a plurality of media playback devices, each having a video output line,

device interface means for controlling the data retrieving playback operation of said playback devices in response to said composing control means,

switch means for selectively switching, under control of the composing control means, between said playback device video output lines for connecting a selected one video output line as the switch means output line, and

an analog-to-digital converter connected to the switch means output line, and connected to the digital bus for providing a digital output video signal thereto.

32. The composing apparatus of claim 20 wherein said composing control means further comprises

means for automatically dividing said source material into segments according to a predetermined selection method, and

operator controlled means for changing said beginning and ending fields of said segments whereby the segment presentations displayed by said active display are dynamically updated to visually represent said new beginning and ending field.

33. The composing apparatus of claim 20 further comprising

a printer connected to said composing control means,

an alphanumeric input keyboard for inputting textual material associated with a labeled scene, to said composing control means, and

said composing control means further comprising

means for printing a storyboard, said storyboard representing thereon a series of scenes, each represented by at least one pictorial label and the previously input textual material associated therewith.

34. The composing apparatus of claim 20 wherein said composing control means further comprises

means for simultaneously controlling the playback operation of a plurality of video tape recorders for selectively providing the video signal data to the passive and active display means in response to instructions from an operator control panel.

35. The composing apparatus of claim 20 further comprising

means for supplying a video independent audio signal, and

means for synchronizing said audio signal with a current video segment, said synchronizing means comprising

means for time shifting said audio signal relative to said video segment, and

means for varying the rate of said time shifting.

36. A composing method for selecting segments from image source material stored in at least one storage medium and for denoting serially connected sequences of said segments, said method comprising the steps of:

denoting a start and an end of each of a plurality of segments of said source material,

identifying each said segment by a pictorial image segment label,

selectively displaying segments of said image source material on a pictorial display means,

assembling at least a plurality of said segment labels into a serially connected label sequence,

locating any segment by displaying said pictorial labels in said label sequence, and

displaying the segment identified by a selected label.

37. The composing method of claim 36 wherein said composing control means further comprises the steps of

grouping serially connected ones of said connected segments into segment groups, said segments in said segment groups having the same connected serial relationship as in said connected image sequence,

identifying each segment group by a pictorial group label,

locating any said segment group by displaying said pictorial group labels in a group label sequence corresponding to said segment group sequence relationship, and

selectively operating upon said segments and said segment groups using said labels and label groups.

38. The composing method of claim 36 further comprising the steps of

providing a plurality of pictorial display screens arranged in an ordered array,

providing said display screens with electrical signals pictorially representing a selected limited number of said sequence of said labels, and

changing the displayed labels.

39. The composing method of claim 38 further comprising the step of

receiving electrical signals representing an image to be displayed, and

repeatedly displaying said received image on a pictorial display screen associated with a display processor.

40. The composing method of claim 38 further comprising the step of

selectively sequencing said labels on plural display screens according to said label sequence for searching for a labeled segment of said image source.

41. The composing method of claim 36 further comprising the step of

labeling each defined segment by two pictorial images, a first label image corresponding to a beginning frame of said segment and a second label image corresponding to an ending frame of said segment.

42. The composing method of claim 36 comprising the steps of

storing a representation of said segment to be displayed in at least a first and a second serial storage medium,

selectively controlling image information retrieval from said first and second storage media,

repetitively cycling said first and second storage media for alternate image information retrieval, and

thereby displaying a continuous loop presentation of said segment.

43. The composing method of claim 42 further comprising the step of

inserting an interruption display image between repetitions of said repeating segment.

44. The composing method of claim 42 further comprising the step of

dynamically changing the start and end of said segment.

45. The composing method of claim 44 further comprising the steps of

switchably connecting video outputs of selected ones of a plurality of video tape recorders to selected ones of a plurality of display screens,

digitizing a switched recorder video output,

directing said digitized video output to a display processor, and

displaying said received digitized video image on a said pictorial display screen associated therewith.

46. The composing method of claim 45 further comprising the steps of

connecting selected ones of a plurality of video input lines to selected ones of said video tape recorders,

generating clock signals including field address signals, and

selectively adding said address signals to video image data generated within said apparatus.

47. The composing method of claim 44 further comprising the steps of

generating clock signals including field address signals,

selectively adding said address signals to video image data generated within said apparatus, and

connecting said clock signals to each of a plurality of said recorder interfaces.

48. The composing method of claim 36 further comprising the steps of

storing a representation of a first segment to be displayed in a first serial storage memory,

storing a representation of a second segment to be displayed in a second serial storage memory,

selectively controlling image information retrieval from said first and second serial memories, and

repetitively and alternately displaying said first and second segments in a continuous loop alternating presentation.

49. The composing method of claim 48 further comprising the step of

varying a transition between said first and second segments.

50. The composing method of claim 49 further comprising the steps of

generating a transition display between said first and second segments, and

inserting said transition into the serially connected image sequence between said first and second segments.

51. A method for composing image source material stored on at least one image storage medium, said source material being composed of a sequence of serially stored fields representing a time sequential visual image, sequences of said fields being associated to form visual segments, said method comprising the steps of

providing a pictorial representation of selected current segment of interest,

providing an operator control means,

repetitively selecting successive current segments,

repetitively making available for display electrical signals pictorially representing a then selected current segment,

selecting from the then current segment at least one labeling field for identifying said segment,

delimiting said current segment to form a current defined segment by denoting the beginning and ending of said segment,

maintaining a record of said sequences of defined segments in accordance with the label selecting and delimiting steps, and

selectively providing electrical signals for pictorially representing and displaying at least a labeling field.

52. A method for composing image source material stored on at least one image storage medium, said source material being composed of a sequence of serially stored fields representing a time sequential visual image, sequences of said fields being associated to form a visual segment, said method comprising the steps of

providing a temporal pictorial presentation of a selected segment, designated the current segment, on an active pictorial display,

providing on each of a plurality of passive pictorial displays a visual presentation of a selected field of a sequence of fields forming a said visual segment, each said selected field thereby labeling one said visual segment,

repeatedly selecting among said sequences of selected label fields for composing said segment sequences, a segment associated with a last selected label field being the segment designated the current segment,

repetitively providing said active display with electrical signals from memories for pictorially representing said current segment in a repeating display,

selectively supplying each said passive display with electrical data signals representing a selected one of a sequence of said labeling fields,

associating with each current segment at least one current label field, and

maintaining a record of the sequence of current segments.

53. The composing method according to claim 52 further comprising the step of

manipulating said label fields representing said segments for forming a composed medium representation.

54. The composing method according to claim 52 further comprising the step of

selectively and repetitively switching between said video output of at least two recording means for repetitively providing said current segment in a continuous loop format to said active display means.

55. The composing method of claim 54 further comprising the steps of

varying the segment playback rate of the current segment being displayed by said active pictorial display, and

designating for a current segment a beginning field label and an ending field label.

56. The composing method of claim 52 further comprising the steps of

ordering in a regular spatial array a plurality of pictorial display pairs, each pair having a first display screen for providing a visual presentation of a beginning label and a second display screen for providing a visual presentation of an ending label, each said pair of beginning and ending labels being associated with a segment of the sequence of current segments, and

selecting a segment corresponding to a selected label for display by said active display.

57. The composing method of claim 52 further comprising the step of

receiving instructions and video data representing pictorial labels on a display interface for effecting an ordered pictorial presentation of said labels on display screens,

whereby the spatial display on said screens provides in effect a temporal snapshot representation of a sequence of said segments.

58. The composing method of claim 57 further comprising the steps of

mounting said display screens in a two row ordered array on a console, each column of screens being adapted to display a label pair associated with a visual segment, and

dynamically searching through said labels by shifting said labels in the direction of an array row,

whereby a search through said sequence of segments can be effected.

59. The composing method of claim 52 further comprising the steps of

writing a clocked identification tag to be associated with each said field, each identification tag for a field associated with one storage medium being uniquely identifiable from the identification tag associated with any other field associated with said one storage medium,

receiving instructions including at least a playback start time relative to a system clock, a starting field identification, and an ending field identification, and

retrieving data from said storage medium in accordance with said instructions.

60. The composing method of claim 59 wherein each said storage medium is a video tape recorder, and

comprising the steps of

recording on said recorder a video input signal, and

recording with said video signal said clocked identification tags.

61. The composing method of claim 52 further comprising the steps of

storing a digital representation of a label to be displayed,

communicating said digital representation along a digital bus, and

providing said digital representation from said bus to a display screen for providing a visual presentation.

62. The composing method of claim 60 further comprising the steps of

controlling the data retrieving playback operation of a plurality of playback devices,

selectively switching between playback device video output lines for connecting a selected one video output line as a switch means output line, and

providing a digital output video signal for said selected video output.

63. The composing method of claim 52 further comprising the steps of

automatically dividing said source material into segments according to a predetermined selection method and

changing said beginning and ending fields of said segments whereby the segment presentation displayed by said active display is dynamically updated to visually represent said new beginning and ending fields.

64. The composing method of claim 52 further comprising the steps of

inputting textual material associated with a labeled scene,

printing a storyboard, said storyboard representing thereon a series of scenes, each represented by at least one pictorial label and the previously input textual material associated therewith.

65. The composing method of claim 52 further comprising the step of

simultaneously controlling the playback operation of a plurality of video tape recorders for selectively providing the video signal data to the passive and active displays in response to instructions from an operator control panel.

66. The composing method of claim 52 further comprising the step of

shifting, in time, an audio signal independently of a video signal for synchronizing said audio and video signals.

67. The composing method of claim 52 further comprising the step of

selectively switching said passive pictorial display for presenting text material for display with said visual presentation by shifting the pictorial display in a vertical direction.