Video overlay image processing apparatus

• US 4,954,970 A
• Filed: 04/08/1988
• Issued: 09/04/1990
• Est. Priority Date: 04/08/1988
• Status: Expired due to Fees

• Current Assignee: Kausch, Marvin L., Walker, James T.
• Original Assignee: Kausch, Marvin L., Walker, James T.
• Inventors: Walker, James T., Kausch, Marvin L.
• Primary Examiner(s): Harkcom, Gary V.
• Assistant Examiner(s): Nguyen, Phu K.
• Application Number:
  US07/179,565
• Time in Patent Office: 879 Days
• Field of Search: 364/521, 364/518, 364/522, 340/734, 340/747, 340/731, 340/721, 340/706, 340/703, 358/22, 358/78, 358/81
• US Class Current: 345/639
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G09G 1/16 the pattern of rectangular co-ordinates extending over the whole area of the screen, i.e. television type raster
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels

Abstract

A predominatly hardware-based system for rapidly generating overlay images by painting techniques using a host computer with appropriate graphics-generation operator interface, and for manipulating overlay images with respect to a background image. The system provides for rapid, convenient control of such imaging aspects as color alteration, repositioning the overlays on the background, and predetermining the amount of mask protection to be associated with each image pixel. The system can be readily realized, using available integrated crcuits, in the form of a host-computer plug-in accessory. A bidirectional multiple bus structure serves to interconnect the circuit boards, permitting convenient host-software-controlled configuration of the system.

Claims

1. In a system for producing, controlling and manipulating a background image and a first overlay image for simultaneous display on a raster-type display device,

a first addressable memory means for storing data representing the density pattern of said overlay image at a plurality of points along each of the raster lines of said raster-type display device;

a register means for storing data representing a color to be used in displaying said overlay image;

a proportional mixer means, having a first input coupled to said first memory means to receive said overlay image density data, having a second input coupled to receive said background image as data representing said background image at said plurality of points along each of the raster lines of said raster-type display device, having a register input coupled to receive color data from said register, and having a display output for connection to said display device, for producing in response to said first, second and register inputs a composite display output image having said overlay image in said selected color mixed into said background image at each of said plurality of points in proportion to the density of color represented by said overlay image density data;

a second addressable memory means for storing a second image as data representing said second image at said plurality of points along each of the raster lines of said raster-type display device, said second addressable memory means being coupled to said second mixer input to supply said second image as said background image, and being coupled to said mixer display output to store said output image therefrom as a succeeding second image;

first clock-driven address generator means coupled to each of said memory, register, and mixer means to synchronously cause;

(1) said overlay and background image data to be serially presented at said first and second mixer inputs, respectively, and (2) said display output image data to be serially stored in said second memory means.

2. The apparatus of claim 1 wherein said second addressable memory means comprises a simultaneous read-write memory device having an input terminal connected to said mixer display output for serially receiving and storing data representing said mixer output image, and having an output terminal connected to said mixer background input for serially presenting stored data representing said background image, said memory device responding, at each address generated by said first clock-driven address generator, by first presenting stored data to its output terminal and then storing new data from its input terminal.

3. The apparatus of claim 2 further including:

a third addressable memory means for storing a frisket image as data representing, at each of said plurality of points along each of the raster lines of said raster-type display device, the maximum permissible density of overlay image;

a first multiplier means coupled to receive data from said first and third memory means for generating a binary product therefrom, said multiplier means being further connected to said mixer first input to supply said binary product thereto to control the density of overlay image at each of said plurality of points along each of the raster lines of said raster-type display device.

4. The apparatus according to claim 3 further including a density-mapping memory means coupled between said first memory means and said mixer weight input for converting density data input from said first memory means into density data output to said mixer weight input according to a preselected non-linear relationship.

5. The apparatus according to claim 4 further including three separate bus structures extending between and interconnecting said addressable memory means and said mixer for communicating said overlay, background and display output data therebetween, and a digital delay means coupled between said mixer display output and said second addressable memory means to delay storage of said display output image in said second memory means.

6. The apparatus of claim 3 further including a binary ones complementer, connected between said third addressable memory means and said multiplier means, for deriving the ones complement of said data representing said frisket image and presenting said ones complemented data to said multiplier, whereby at each of said plurality of points frisket data of a zero or minimum magnitude permits maximum overlay density and frisket data of maximum magnitude causes overlay density to be zero.

7. The apparatus of claim 1 wherein said second addressable memory means comprises:

a second addressable memory device for storing said second image as data representing said second image at said plurality of points along each of the raster lines of said raster-type display device;

a third addressable memory device for storing a third image as data representing said third image at said plurality of points along each of the raster lines of said raster-type display device;

switch means connected to said second and third memory devices and to said mixer first input and said mixer output, said switch means being selectively operable between a first state in which said second memory device is connected to said first mixer input to supply said background image thereto and said third memory device is connected to said mixer output to store said display output image, and a second state in which said third memory device is connected to said first mixer input to supply said background image thereto and said second memory device is connected to said mixer output to store said display output image.

8. The apparatus of claim 7 further including:

a third addressable memory means for storing a frisket image as data representing, at each of said plurality of points along each of the raster lines of said raster-type display device, the maximum permissible density of overlay image;

a first multiplier means coupled to receive data from said first and third memory means for generating a binary product therefrom, said multiplier means being further connected to said mixer first input to supply said binary product thereto to control the density of overlay image at each of said plurality of points along each of the raster lines of said raster-type display device.

9. The apparatus according to claim 8 further including a density-mapping memory means coupled between said first memory means and said mixer weight input for converting density data input from said first memory means into density data output to said mixer weight input according to a preselected non-linear relationship.

10. The apparatus of claim 8 further including a binary ones complementer, connected between said third addressable memory means and said multiplier means, for deriving the ones complement of said data representing said frisket image and presenting said ones complemented data to said multiplier, whereby at each of said plurality of points frisket data of a zero or minimum magnitude permits maximum overlay density and frisket data of maximum magnitude causes overlay density to be zero.

11. The apparatus of claim 1 further including:

a third addressable memory means for storing a frisket image as data representing, at each of said plurality of points along each of the raster lines of said raster-type display device, the maximum permissible density of overlay image;

a first multiplier means coupled to receive data from said first and third memory means for generating a binary product therefrom, said multiplier means being further connected to said mixer first input to supply said binary product thereto to control the density of overlay image at each of said plurality of points along each of the raster lines of said raster-type display device.

12. The apparatus of claim 11 further including a binary ones complementer, connected between said third addressable memory means and said multiplier means, for deriving the ones complement of said data representing said frisket image and presenting said ones complemented data to said multiplier, whereby at each of said plurality of points frisket data of a zero or minimum magnitude permits maximum overlay density and frisket data of maximum magnitude causes overlay density to be zero.

13. The apparatus according to claim 1 further including a density-mapping memory means coupled between said first memory means and said mixer weight input for converting density data input from said first memory means into density data output to said mixer weight input according to a preselected non-linear relationship.

14. In a system for producing, controlling and manipulating a background image and a first overlay image for simultaneous display on a raster-type display device,

a first addressable memory means for storing data representing said background image at a plurality of points along each of the raster lines of said raster-type display device;

a second addressable memory means for storing data representing said overlay image at said plurality of points along each of the raster lines of said raster-type display device;

a third addressable memory means for storing data representing the density pattern of said overlay image at said plurality of points along each of the raster lines of said raster-type display device;

a proportional mixer means, having a background input coupled to said first memory means to receive said background image data, having an overlay input coupled to said second memory means to receive said overlay image data, having a weight input coupled to said third memory means to receive said overlay-image density pattern data, and having a display output for connection to said display device, for producing in response to said background, overlay and weight inputs a composite display output image having said overlay image mixed into said background image at each of said plurality of points in proportion to the density represented by said overlay-image density pattern data;

said first addressable memory means coupled to said mixer background input is further coupled to said mixer display output to store said output image therefrom as a succeeding background image;

first clock-driven address generator means coupled to each of said memory and mixer means to synchronously cause;

(1) said background and overlay image and density pattern data to be serially presented at said overlay, background, and weight mixer inputs, respectively, and, on user command, (2) said display output image data to be serially stored in said first memory means.

15. The apparatus of claim 14 wherein said first addressable memory means comprises a simultaneous read-write memory device having an input terminal connected to said mixer display output for serially receiving and storing data representing said mixer output image, and having an output terminal connected to said mixer background input for serially presenting stored data representing said background image, said memory device responding, at each address generated by said first clock-driven address generator, by first presenting stored data to its output terminal and then storing new data from its input terminal.

16. The apparatus according to claim 15 further including three separate bus structures extending between and interconnecting said addressable memory means and said mixer for communicating said overlay, background and display output data.

17. The apparatus according to claim 16 wherein each of said bus structures is made up of five groups of data lines for representing five image data components.

18. The apparatus according to claim 17 further including a plurality of data storage registers connected to ones of said five groups for storing constants which can be selectively substituted for corresponding ones of said image data components.

19. The apparatus of claim 14 wherein said first addressable memory means comprises:

a first addressable memory device for storing a first image as data representing said first image at said plurality of points along each of the raster lines of said raster-type display device;

a second addressable memory device for storing a second image as data representing said second image at said plurality of points along each of the raster lines of said raster-type display device;

switch means connected to said first and second memory devices and to said mixer background input and said mixer output, said switch means being selectively operable between a first state in which said first memory device is connected to said mixer background input to supply said background image thereto and said second memory device is connected to said mixer output to store said display output image, and a second state in which said second memory device is connected to said mixer background input to supply said background image thereto and said first memory device is connected to said mixer output to store said display output image.

20. The apparatus of claim 14 further including:

a fourth addressable memory means for storing a frisket image as data representing, at each of said plurality of points along each of the raster lines of said raster-type display device, the maximum permissible density of overlay image;

a first multiplier means coupled to receive data from said third and fourth memory means for generating a binary product therefrom, said multiplier means being further connected to said mixer weight input to supply said binary product thereto to control the density of overlay image at each of said plurality of points along each of the raster lines of said raster-type display device.

21. The apparatus of claim 20 further including scroll-offset means to generate an address which is selectively offset from the address generated by said first clock-driven address generator, said scroll-offset means being coupled to said first and fourth addressable memory means to present said selectively offset address thereto, to thereby permit selective variation of the position of said overlay image relative to said background and output display images.

22. The apparatus of claim 21 wherein said scroll-offset means comprises a second clock-driven address generator independent from said first clock-driven address generator.

23. The apparatus of claim 21 further including a binary ones complementer, connected between said fourth addressable memory means and said multiplier means, for deriving the ones complement of said data representing said frisket image and presenting said ones complemented data to said multiplier, whereby at each of said plurality of points frisket data of a zero or minimum magnitude permits maximum overlay density and frisket data of maximum magnitude causes overlay density to be zero.

24. The apparatus of claim 21 wherein said first addressable memory means comprises a simultaneous read-write memory device having an input terminal connected to said mixer display output for serially receiving and storing data representing said mixer output image, and having an output terminal connected to said mixer background input for serially presenting stored data representing said background image, said memory device responding, at each address generated by said scroll-offset means, by first presenting stored data to its output terminal and then storing new data from its input terminal, and further including a binary ones complementer, connected between said fourth addressable memory means and said multiplier means, for deriving the ones complement of said data representing said frisket image and presenting said ones complemented data to said multiplier, whereby at each of said plurality of points frisket data of a zero or minimum magnitude permits maximum overlay density and frisket data of maximum magnitude causes overlay density to be zero.

25. The apparatus according to claim 20 further including a density-mapping memory means coupled between said third memory means and said multiplier for converting density data input from said third memory means into density data output to said multiplier according to a preselected non-linear relationship.

26. The apparatus according to claim 14 further including a density-mapping memory means coupled between said third memory means and said mixer weight input for converting density data input from said third memory means into density data output to said mixer weight input according to a preselected non-linear relationship.

27. The apparatus according to claim 26 further including a color-mapping memory means coupled between said second memory means and said mixer overlay input for converting color data input from said second memory means into color data output to said mixer overlay input according to a preselected relationship.

28. The apparatus according to claim 27 further including map-code-detecting switch means, coupled to said second memory means and to said mixer overlay input and having a first state in which overlay data from said second memory means is routed to said mixer overlay input and a second state in which color-mapped overlay data from said color-mapping memory means is routed to said mixer overlay input, said map-code-detecting switch means being responsive to a predetermined map code in said overlay image output data by transiting from said first state to said second state.

29. The apparatus according to claim 14 further including a color-mapping memory means coupled between said second memory means and said mixer overlay input for converting color data input from said second memory means into color data output to said mixer overlay input according to a preselected relationship.

30. The apparatus according to claim 29 further including map-code-detecting switch means, coupled to said second memory means and to said mixer overlay input and having a first state in which overlay data from said second memory means is routed to said mixer overlay input and a second state in which color-mapped overlay data from said color-mapping memory means is routed to said mixer overlay input, said map-code-detecting switch means being responsive to a predetermined map code in said overlay image output data by transiting from said first state to said second state.

31. The apparatus according to claim 14 further including a digital delay means coupled between said mixer display output and said first addressable memory means to delay storage of said display output image in said first memory means.