Image generator using a graphical flow diagram with automatic generation of output windows

• US 5,490,246 A
• Filed: 08/23/1994
• Issued: 02/06/1996
• Est. Priority Date: 08/13/1991
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Rabin, Daniel E., Levy, David M.E., Brotsky, Daniel C.
• Primary Examiner(s): Bayerl, Raymond J.
• Assistant Examiner(s): Breene, John E.
• Application Number:
  US08/294,780
• Time in Patent Office: 532 Days
• Field of Search: 395/155-161, 395/152, 395/140, 345/117-120, 358/443
• US Class Current: 715/763
• CPC Class Codes: G06F 8/34 Graphical or visual programming
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 15/503 Blending, e.g. for anti-aliasing
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: Y10S 715/967 Visual or iconic programming

Abstract

A graphics editor generates an Appearance Construction Graph (ACG) which represents an image formation process as a Directed Acyclic Graph (DAG). The ACG image transformation operations (transforms), and outputs (viewable images--sinks) which can be displayed, for example, in a window of a display screen, and manipulated to construct and edit complex images. Accordingly, the displayed ACG is a user interface that permits complex graphics images to be constructed in a straightforward manner, and thus easily understood and manipulated (edited) by an operator. The nodes in the ACG are selectively interconnected by links (edges). The complex image represented by the ACG can be constructed and displayed in a viewer window on the display screen by "running" the ACG. The graphics editor "runs" the ACG by performing operations on the image fragments as defined by the interconnected nodes of the ACG. When the ACG is "run", each output (or viewer) node displays its image in a viewer window which is automatically created.

Claims

1. An electronic image generator for generating electronically manipulatable images, comprising:

means for generating two or more output images capable of being displayed, said output images being generated as a result of performing zero or more operator selected graphics transformation operations on one or more source images;

means for constructing and displaying a graphical flow diagram of an image forming process used to generate said two or more output images from said one or more source images using the selected graphics transformation operations, said graphical flow diagram including;

a plurality of nodes which represent said one or more source images, said zero or more selected transformation operations, and said two or more output images, each of said plurality of nodes representing only a single source image, selected graphics transformation operation, or output image, said graphical flow diagram further including;

interconnections that interconnect said nodes in accordance with said image formation process so that said selected graphics transformation operations are interconnected between said one or more source images and said two or more output images formed from said one or more source images;

means for controlling said graphical display constructing means to form and modify said graphical flow diagram, and

means for automatically generating and displaying an output window for each output node whenever the graphical flow diagram is executed and displaying each output window simultaneously with a window displaying the graphical flow diagram, wherein said means for generating two or more output images is responsive to the graphical flow diagram generated by said graphical display constructing means, as controlled by said means for controlling, so as to generate said two or more output images.

2. The electronic image generator of claim 1, wherein said graphical flow diagram is acrylic.

3. The electronic image generator of claim 1, wherein said graphical flow diagram corresponds to an image formation process having a plurality of said source images in which each source image is interconnected to zero or more of said selected graphics transformation operations, in which an output of at least some of said selected graphics transformation operations are subjected to further graphics transformation operations, in which at least one of said plural source images and the output of at least some of said graphics transformation operations is used as the two or more output images.

4. The electronic image generator of claim 3, wherein said output images result from said selected graphics transformation operations when at least one of said graphics transformation operations is selected.

5. The electronic image generator of claim 3, further comprising means for translating image data defining said source images or outputs of transformation operations into different graphical domains so that said image data is processed by transformation operations operating in different graphical domains.

6. The electronic image generator of claim 5, wherein said means for translating permits translation of image data into a graphical domain for display.

7. The electronic image generator of claim 5, wherein said different graphical domains include at least two-dimensional raster and two-dimensional vector.

8. The electronic image generator of claim 7, wherein said transformation operations selectively operate in a single graphical domain or across different graphical domains so that each transformation operation has input protocols and output protocols, and wherein said means for controlling controls said means for constructing and displaying a graphical flow diagram so that the graphical flow diagram is constructed according to said input and output protocols.

9. The electronic image generator of claim 1, wherein said means for controlling is responsive to operator inputted commands.

10. The electronic image generator of claim 1, wherein said means for controlling causes said means for generating one or more output images to simultaneously display the one or more output images with the displayed graphical flow diagram.

11. The electronic image generator of claim 1, wherein the nodes of the graphical flow diagram are generated and displayed in a vertically-ordered manner, such that the nodes representing transformation operations appear above the nodes representing source images or other transformation operations to which they are being applied, and the nodes representing output images appear above the nodes representing source images or the transformation operations to which they are connected.

12. The electronic image generator of claim 1, wherein said means for controlling permits the source images and the graphics transformation operations to be selected by an operator from a library.

13. The electronic image generator of claim 12, further comprising means for defining and entering additional source images and transformation operations into said library.

14. The electronic image generator of claim 1, wherein said means for generating two or more output images can use source images and results of performing graphics transformation operations on source images as inputs to a plurality of further graphics transformation operations, said means for constructing a graphical flow diagram displays an interconnection between a node associated with said source images and said results of performing graphics transformation operations and nodes representing each of said plurality of said further graphics transformation operations.

15. The electronic image generator of claim 1, further comprising a display screen, wherein said output images and said graphical flow diagram of an image formation sequence used to produce said output images are generated on said display screen.

16. An electronic image generator for generating electronically manipulatable images, comprising:

means for generating, selecting and displaying image source display icons representative of one or more image sources which are used in an image formation process, transformation operation display icons representative of graphics transformation operations which are performed in the image formation process on the image source and on outputs of other graphics transformation operations, and output image display icons representative of two or more output images that are output by said image formation process, each image source display icon representing one image source, each transformation operation display icon representing one graphics transformation operation, each output image display icon representing one output image formed by said image formation process;

means for generating and displaying interconnect display lines which interconnect said image source icons, said transformation operation icons and said output image display icons to form and display a graphical flow diagram in which at least one source image icon is connected either directly or through a sequence of transformation operation icons to at least one output image display icon, wherein said graphical flow diagram represents said image formation process performed on the source images to produce the two or more output images and the graphical flow diagram can be modified by altering at least one of the group including the image source display icons and the interconnect display lines;

means for generating said two or more output images using the image formation process shown in the displayed graphical flow diagram; and

means for automatically generating and displaying an output window for each output image display icon whenever the graphical flow diagram is executed and displaying each output window simultaneously with a window displaying the graphical flow diagram.

17. The electronic image generator of claim 16, wherein said graphical flow diagram is an acrylic graph.

18. The electronic image generator of claim 17, further comprising means for controlling said display icon generating and displaying means and for controlling said means for generating and displaying interconnect display lines responsive to commands input by an operator for forming and modifying a displayed graphical flow diagram.

19. The electronic image generator of claim 16, wherein said image source display icons, said transformation operation display icons, and said output image display icons are generated in a vertically-ordered manner, such that the display icons of all transformation operations appear above the display icons of the source images or other transformation operations to which they are being applied, and the display icons of each output image appears above the display icon of the source image or transformation operation to which it is connected.

20. A method of generating a graphical representation of an image formation process, comprising:

selecting at least one image source used as a component of two or more final output images;

selecting zero or more graphics transformation operations that are performed on said one or more image sources to produce said two or more final output images; and

generating a graphical flow diagram including;

display icons representing said selected image sources, said selected graphics transformation operations, and said selected final output images, each of said display icons representing only a single image source, selected graphics transformation operation, or selected final output image,

display interconnections between said image sources, said selected graphics transformation operations, and said final output images which represent an image formation sequence which is performed to produce said two or more final output images from said at least one image source, and

automatically generating and displaying an output window for each output image display icon whenever the graphical flow diagram is executed and displaying each output window simultaneously with a window displaying the graphical flow diagram.

21. The method of claim 20, further comprising:

defining said display interconnections between said image sources, said graphics transformation operations, and said final output images.

22. The method of claim 21, wherein said selecting and defining steps are performed based upon operator inputted control signals.

23. The method of claim 22, wherein said graphical flow diagram is generated on a display screen, and said operator inputted control signals are input by operator manipulations of a cursor on said display screen.

24. The method of claim 20, wherein said selecting steps are performed based upon operator inputted control signals.

25. The method of claim 24, wherein said graphical flow diagram is generated on a display screen, and said operator inputted control signals are input by operator manipulations of a cursor on said display screen.

26. A method of constructing a graphics image represented by an output image display icon from one or more image sources represented by image source display icons, each of said one or more image sources represented by a single one of said image source display icons, and from zero or more graphics transformation operations represented by transformation operation display icons, each of said zero or more graphics transformation operations represented by a single one of said transformation operation display icons, each graphics transformation operation capable of being performed on at least one of said image sources, said method comprising:

selecting at least one of said image source from a library as a component of a final output image;

selecting zero or more of said graphics transformation operations to be performed on said at least one image source to produce said final output image from a library;

generating a graphical flow diagram of an image formation sequence required to produce said final output image by generating on a display screen the display icons associated with the selected image sources, the selected transformation operations, the final output image, and interconnections extending between said image source display icons, said selected transformation operation display icons, and said output image display icon which represent the image formation sequence which is performed to produce said final output image;

generating the final output image by executing the selected graphics transformation operations on the selected image sources according to said graphical flow diagram, and

automatically generating and displaying an output window for each output image display icon whenever the graphical flow diagram is executed and displaying each output window simultaneously with a window displaying the graphical flow diagram.

27. The method of claim 26, wherein said graphical flow diagram is generated as an acyclic graph.

28. The method of claim 26, wherein said selecting steps are performed based upon operator inputted control signals.

29. The method of claim 28, wherein said operator inputted control signals are input by operator manipulations of a cursor on said display screen.

30. The method of claim 26, wherein said image source display icons, said transformation operation display icons, and said output image display icon are generated in a vertically-ordered manner, such that the display icons of all transformation operations appear above the display icons of the source images and other transformation operations to which they are being applied, and the display icon of said output image appears above the display icon of the source image or transformation operation to which it is connected.

31. An electronic image generator for generating electronically manipulatable images, comprising:

a display that generates two or more output images, said two or more output images being generated as a result of performing zero or more operator selected graphics transformation operations on one or more source images;

a processor constructing and displaying a graphical flow diagram of an image forming process used to generate said two or more output images from said one or more source images using the selected graphics transformation operations; and

a memory that stores data, the data including plurality of nodes which represent said one or more source images, said zero or more selected transformation operations, and said two or more output images, each of said plurality of nodes representing only a single source image, selected graphics transformation operation, or output image;

wherein said display automatically generates and displays an output window for each output node whenever the graphical flow diagram is executed and displays each output window simultaneously with a window displaying the graphical flow diagram, said processor controls formation and modification of said graphical flow diagram, said display being responsive to the graphical flow diagram generated by said to generate said one or more output images.

32. A generator according to claim 31, further comprising interconnections that connect said plurality of nodes in accordance with said image formation process so that said selected graphics transformation operations are interconnected between said two or more source images and said one or more output images formed from said one or more source images.

33. A generator according to claim 31, further comprising an operator input device that provides operator input to said processor.

34. A generator according to claim 31, wherein the data further includes instruction data that instructs the processor to construct and display the graphical flow diagram.