Interactive video production system

• US 4,357,624 A
• Filed: 03/20/1981
• Issued: 11/02/1982
• Est. Priority Date: 05/15/1979
• Status: Expired due to Fees

• Current Assignee: Combined Logic Company
• Original Assignee: Combined Logic Company
• Inventors: Greenberg, George A.
• Primary Examiner(s): Masinick, Michael A.
• Application Number:
  US06/246,014
• Time in Patent Office: 592 Days
• Field of Search: 358/4, 358/8, 358/22, 358/30, 358/78, 358/80, 358/81, 358/82, 358/54
• US Class Current: 348/578
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 5/84 using optical recording H04N5/80, H04N5/89, H04N5/91 take precedence
• CPC Class Codes: H04N 9/76 for mixing of colour signals H04N9/75 takes precedence

Abstract

An improved interactive image processing system (200,300) is provided which is capable of simultaneous processing of at least two different digitized composite color images to provide a displayable resultant composite color image. Each of the digitized composite color images have separate digitized red, blue and green image components and have an associated image information content. The system (200,300) includes separate image storage planes (246,346,70'"'"',72'"'"',74'"'"',70",72",74",70"'"'"',72'"'"'", 74"'"'"',370,372,374,370'"'"',372'"'"',374'"'"',370",372",374) for retrievably storing each of the digitized red, blue and green image components or other image data as well as graphic planes (78'"'"',378) for storing graphic control data for processing of the images. The digital image processing of the image components is accomplished in a digital image processing portion (208,308) which includes an image processor (210,310) which contains the various storage planes in a refresh memory (246,346) which cooperates with a pipeline processor configuration (86'"'"'), image combine circuitry (270,272,274,270'"'"',272'"'"',274'"'"') and other control circuitry to enable the simultaneous processing between each of the corresponding image planes on a pixel by pixel basis under interactive control of a keyboard (50'"'"'), data tablet (54'"'"') or other interactive device. The system may be employed for interactive video processing (200) or as an interactive film printing system (300) in which the simultaneous processing of the two different images, which may be iterative, can be monitored in real time on a television monitor (44'"'"',315). In the video system (200), the combining format of the image planes may be interactively varied on a pixel-by-pixel basis by creating different digital control masks for each pixel which are stored in refresh memory (246,346). In either system (200,300), the interactive simultaneous digital processing of the images is accomplished in an RGB format.

Claims

1. An interactive image processing system capable of simultaneously processing a plurality of digitized composite color images to provide a displayable resultant composite color image therefrom, each of said digitized composite color images having separate digitized red, blue and green image components and having an associated image information content, said system comprising retrievable storage means for retrievably storing each of said digitized red, blue and green image components in separate image storage planes for at least two different composite color images;

digital image processing means operatively connected to each of said image storage planes for enabling separate simultaneous interactive processing between each of said stored red, blue and green image components of said two different composite color images on a pixel-by-pixel basis in accordance with a defined aspect ratio for said resultant composite color image;

interactive means operatively connected to said digital image processing means for enabling said simultaneous interactive controllable digital processing of the associated image information content of said two different digitized composite color images on said pixel-by-pixel basis; and

means operatively connected to said image processing means for providing an output signal corresponding to said resultant color image.

2. An interactive image processing system in accordance with claim 1 wherein said retrievable storage means further comprises at least three other separate image storage planes capable of separately storing digitized image dates, said digital image processing means being further operatively connected to each of said three other separate image storage planes for further enabling said simultaneous interactive image processing.

3. An interactive image processing system in accordance with claim 2 wherein said three other separate image storage planes comprise red, blue and green image storage planes, respectively, operatively connected to said output signal providing means for retrievably storing the digitized red, blue and green image components of said resultant color image for enabling further simultaneous image processing thereof by said image processing means for providing iterative processing of said resultant color image.

4. An interactive image processing system in accordance with claim 3 wherein siad digital image processing means further comprises means for combining each of said red, blue and green image components of said two different color images on a pixel-by-pixel basis in accordance with a combining format.

5. An interactive image processing system in accordance with claim 4 wherein said retreivable storage means further comprises a graphic plane storage means for retrievably storing graphic control information for said simultaneous pixel-by-pixel processing of said two different composite color images, said graphic storage means comprising a separate single graphic storage plane for each of said two different composite color images, each of said single graphic storage planes retrievably storing said graphic control information for each of said red, blue nad green image components of one of said two different composite color images, said digital image processing means being further operatively connected to each of said graphic storage planes.

6. An interactive image processing system in accordance with claim 5 wherein said interactive means comprises means for providing said graphic control information to said graphic storage means for interactively controlling said simultaneous pixel-by-pixel processing in accordance therewith, said combining means being capable of varying said combining format on a pixel-by-pixel basis in accordance with said graphic control information.

7. An interactive image processing system in accordance with claim 6 wherein said system further comprises means operatively connected to said output signal for converting said output signal to a displayable color video signal for enabling monitoring of said image processing during said processing.

8. In accordance with claim 1 wherein said digital image processing means further comprises means for combining each of said red, blue and green image components of said two different color images on a pixel-by-pixel basis, in accordance with a combining format.

9. In accordance with claim 8 wherein said retreivable storage means further comprises a graphic plane storage means for retrievably storing graphic control information for said simultaneous pixel-by-pixel processing of said two different composite color images, said graphic storage means comprising a separate single graphic storage plane for each of said two different composite color images, each of said single graphic storage planes retrievably storing said graphic control information for each of said red, blue and green image components of one of said two different composite color images, said digital image processing means being further operatively connected to each of said graphic storage planes.

10. In accordance with claim 9 wherein said interactive means comprises means for providing said graphic control information to send graphic storage means for interactively controlling said simultaneous pixel-by-pixel processing in accordance therewith, said combining means being capable of varying said combining format on a pixel-by-pixel basis in accordance with said graphic control information.

11. In accordance with claim 1 wherein said retreivable storage means further comprises a graphic plane storage means for retrievably storing graphic control information for said simultaneous pixel-by-pixel processing of said two different composite color images, said graphic storage means comprising a separate single graphic storage plane for each of said two different composite color images, each of said single graphic storage planes retrievably storing said graphic control information for each of said red, blue and green image components of one of said two different composite color images, said digital image processing means being further operatively connected to each of said graphic storage planes.

12. In accordance with claim 2 wherein said retreivable storage means further comprises a graphic plane storage means for retrievably storing graphic control information for said simultaneous pixel-by-pixel processing of said two different composite color images, said graphic storage means comprising a separate single graphic storage plane for each of said two different composite color images, each of said single graphic storage planes retrievably storing said graphic control information for each of said red, blue and green image composites of one of said two different composite color images, said digital image processing means being further operatively connected to each of said graphic storage planes.

13. In accordance with claim 2 wherein said digital image processing means further comprises means for combining each of said red, blue and green image components of said two different color images on a pixel-by-pixel basis, in accordance with a combining format.

14. In accordance with claim 13 wherein said retreivable storage means further comprises a graphic plane storage means for retrievably storing graphic control information for said simultaneous pixel-by-pixel processing of said two different composite color images, said graphic storage means comprising a separate single graphic storage plane for each of said two different composite color images, each of said single graphic storage planes retrievably storing said graphic control information for each of said red, blue and green image components of one of said two different composite color images, said digital image processing means being further operatively connected to each of said graphic storage planes.

15. In accordance with claim 14 wherein said interactive means comprises means for providing said graphic control information to said graphic storage means for interactively controlling said simultaneous pixel-by-pixel processing in accordance therewith, said combining means being capable of varying said combining format on a pixel-by-pixel basis in accordance with said graphic control information.

16. In accordance with claim 1 wherein said system further comprises means operatively connected to said output signal for converting said output signal to a displayable color video signal for enabling monitoring of said image processing during said processing.

17. In accordance with claim 2 wherein said system further comprises means operatively connected to said output signal for converting said output signal to a displayable color video signal for enabling monitoring of said image processing during said processing.

18. In accordance with claim 1 wherein said image processing system comprises a video image production system for providing a displayable resultant composite video signal said color images being color video images comprising color video signals, said red, blue and green component images comprising red, blue and green video components of said color video signal.

19. In accordance with claim 18 wherein said digital image processing means comprises means for enabling real time simultaneous interactive controllable digital processing of said associated video information content of said two different digitized color video signals.

20. In accordance with claim 19 wherein said digital image processing means further comprises means for combining each of said red, blue and green image components of said two different color images on a pixel-by-pixel basis in accordance with a combining format.

21. In accordance with claim 20 wherein said retreivable storage means further comprises a graphic plane storage means for retrivably storing graphic control information for said simultaneous pixel-by-pixel processing of said two different composite color images, said graphic storage means comprising a separate single graphic storage plane for each of said two different composite color images, each of said single graphic storage planes retrievably storing said graphic control information for each of said red, blue and green image components at one of said two different composite color images, said digital image processing means being further operatively connected to each of said graphic storage planes.

22. In accordance with claim 21 wherein said interactive means comprises means for providing said graphic control information to said graphic storage means for interactively controlling said simultaneous pixel-by-pixel processing in accordance therewith, said combining means being capable of varying said combining format on a pixel-by-pixel basis in accordance with said graphic control information.

23. In accordance with claim 22 wherein said graphic control information providing means comprises means for providing a digital control mask for each of said pixels for enabling said varying of said combining format on a pixel-by-pixel basis, whereby interactive chroma keying may be provided.

24. In accordance with claim 19 wherein said retrievable storage means further comprises at least three other separate image storage planes capable of separately storing digitized image data, said digital image processing means being further operatively connected to each of said three other separate image storage planes for further enabling said simultaneous interactive image processing.

25. In accordance with claim 24 wherein said three other separate image storage planes comprise red, blue and green image storage planes, respectively, operatively connected to said output signal providing means for retrievably storing the digitized red, blue and green image components of said resultant color image for enabling further simultaneous image processing thereof by said image processing means for providing iterative processing of said resultant color image.

26. In accordance with claim 18 wherein said system further comprises separate digitizers for each of said red, blue and green video components for each of said two different color video signals, said digitizers being operatively connected to said digital image processing means for receiving the corresponding analog red, blue and green video component signals and for providing said digitized red, blue and green components therefrom directly to said processing means for enabling said simultaneous interactive processing thereof.

27. In accordance with claim 1 wherein said image processing system comprises a film printing system for providing a resultant composite film color image, said digitized composite color images comprising digitized color film images, whereby pixel-by-pixel digital processing of said associated film image information content of said two different digitized composite color film images may be accomplished.

28. In accordance with claim 27 wherein said system further comprises means operatively connected to said output signal for converting said output signal to a displayable color video signal for enabling monitoring of said image processing during said processing.

29. In accordance with claim 27 wherein said retrievable storage means further comprises at least three other separate image storage planes capable of separately storing digitized image data, said digital image processing means being further operatively connected to each of said three other separate image storage planes for further enabling said simultaneous interactive image processing.

30. In accordance with claim 29 wherein said three other separate image storage planes comprise red, blue and green image storage planes, respectively, operatively connected to said output signal providing means for retrievably storing the digitized red, blue and green image components of said resultant color image for enabling further simultaneous image processing thereof by said image processing means for providing iterative processing of said resultant color image.

31. In accordance with claim 29 wherein said digital image processing means further comprises means for combining each of said red, blue and green image components of said two different color images on a pixel-by-pixel basis in accordance with a combining format.

32. In accordance with claim 31 wherein said retreivable storage means further comprises a graphic plane storage means for retrievably storing graphic control information for said simultaneous pixel-by-pixel processing of said two different composite color images said graphic storage means comprising a separate single graphic storage plane for each of said two different composite color images, each of said single graphic storage planes retrievably storing said graphic control information for each of said red, blue and green image components of one of said two different composite color images, said digital image processing means being further operatively connected to each of said graphic storage planes.

33. In accordance with claim 32 wherein said interactive means comprises means for providing said graphic control information to said graphic storage means for interactively controlling said simultaneous pixel-by-pixel processing in accordance therewith, said combining means being capable of varying said combining format on a pixel-by-pixel basis in accordance with said graphic control information.

34. A method of interactively simultaneously processing a plurality of different composite color film images to provide a displayable resultant composite color film image print therefrom, said method comprising the steps of digitizing said composite color film images, each of said digitized composite color images having separate digitized red, blue and green image components and having an associated image information content;

retrievably storing each of said digitized red, blue and green film image components in separate image storage planes for at least two different composite color film images;

digitally processing the image contents of each of said image storage planes by controllable separate simultaneous interactive digital processing between each of said stored red, blue and green film image components of said two different composite color film images on a pixel-by-pixel basis in accordance with a defined aspect ratio for said resultant composite color film image for processing the associated film image information contents of said two different digitized composite color film images on said pixel-by-pixel basis; and

providing an output signal corresponding to said resultant composite color film image print.

35. A method in accordance with claim 34 further comprising the step of converting said output signal to a color video signal for video monitoring of said image processing during said processing.

36. A method in accordance with claim 35 further comprising the step of providing said resultant color film image print from said output signal.

37. A method in accordance with claim 34 further comprising the step of providing said resultant color film image print from said output signal.