Representing a region of a color image using a space-color separable model

• US 5,835,099 A
• Filed: 06/26/1996
• Issued: 11/10/1998
• Est. Priority Date: 06/26/1996
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Marimont, David H.
• Primary Examiner(s): Jankus, Almis R.
• Application Number:
  US08/670,978
• Time in Patent Office: 867 Days
• Field of Search: 345/425-432, 345/433
• US Class Current: 345/591
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77

Abstract

A representation of a color image region is called a space-color separable (SCS) model because the spatial structure of the image region is represented separately from that of the color-space structure. The representation uses two functions, one to represent the region'"'"'s spatial structure and another to represent its color-space structure. In one implementation, the spatial structure is represented by polynomials of arbitrary degree to map image locations to the parameter values of the color-space model which in turn maps these parameter values to a zero-, one-, two-, or three-dimensional linear subspace of color space. The representation is resolution-independent and can accommodate both transformations of image coordinates and transformation of color coordinates. In particular, the polynomial-linear implementation can easily accommodate both affine transformations of image coordinates and linear transformations of color coordinates. This flexibility makes it useful for a variety of applications in illustration and image editing systems. The invention combines several features: representing smooth shading or textures in color images; separating the spatial structure of the colors in the image from its color space structure; and enabling transformations of images and their colors by transforming the SCS model itself.

Claims

1. A method for operating a processor-controlled machine to compute a function representing original color values of original image locations in an image region of a color image;

the machine including memory for storing data;

the data including image definition data defining an image and instruction data; and

a processor connected for accessing the image definition data, and for accessing the instruction data stored in the memory for operating the machine;

the method comprising;

obtaining a plurality of image region data items indicating image definition data defining an input color image region;

each image region data item indicating coordinate values of a respective original image location in the input color image region and an original color value of the respective original image location;

computing a first function to represent a spatial image structure of the input color image region;

the first function mapping each coordinate value indicating an original image location in the input color image region to a point in a parameter space;

computing a second function to represent a color space subset of a color space structure of the input color image region;

the second function mapping each point in the parameter space to a color space location in the color space subset; and

computing the composition of the first and second functions to produce a third function, referred to as a space-color separable function, for mapping coordinate values of the input color image region to color values in the color space subset;

the space-color separable function approximating the original color values and the original image locations in the input color image region;

the space-color separable function, when used in place of the image region data items to represent the input color image region, producing a rendered color image region substantially similar in appearance to the input color image region.

2. The method of claim 1 for operating a processor-controlled machine to compute a function representing original color values of original image locations in an input color image region further including, when the original color values are to be represented as modified color values,

applying a color coordinate transformation to the color space subset by applying a color transformation function representing the color coordinate transformation to the second function representing the color space subset to produce a modified second function;

wherein computing the composition of the first and second functions to produce the space-color separable function includes computing the composition of the first function and the modified second function;

the color coordinate transformation being applied to the color space subset independently of the spatial image structure of the input color image region by modifying the second function independently of the first function;

the space-color separable function, when used in place of the image region data items to represent the input color image region, producing a rendered color image region having the modified color values.

3. The method of claim 1 for operating a processor-controlled machine to compute a function representing original color values of original image locations in an input color image region further including, when the original image locations are to be represented as modified image locations,

applying an image coordinate transformation to the input color image region by applying an image transformation function representing the image coordinate transformation to the first function representing the spatial image structure of the input color image region to produce a modified first function;

wherein computing the composition of the first and second functions to produce the space-color separable function includes computing the composition of the modified first function and the second function;

the image coordinate transformation being applied to the spatial structure of the input color image region independently of the color space structure of the input color image region by modifying the first function independently of the second function;

the space-color separable function, when used in place of the image region data items to represent the input color image region, producing a rendered color image region having the modified image locations.

4. The method of claim 1 for operating a processor-controlled machine to compute a function representing original color values of original image locations in an input color image region wherein the first function is a polynomial function, and wherein the second function is a linear function.

5. An article of manufacture for access by a machine that includes a memory device for storing data;

storage medium access circuitry for accessing a medium that stores data; and

a processor connected for accessing the data stored in the memory device and for receiving data from the storage medium access circuitry;

the article comprising;

a data storage medium that can be accessed by the storage medium access circuitry when the article is accessed by the machine; and

data stored in the data storage medium so that the storage medium access circuitry can provide the stored data to the processor when the article is accessed by the machine;

the stored data comprising instruction data indicating instructions the processor can execute;

the processor, in executing the instructions, obtaining a plurality of image region data items indicating image definition data defining an input color image region;

each image region data item indicating coordinate values of a respective original image location in the input color image region and an original color value of the respective original image location;

the processor, further in executing the instructions, computing a first function to represent a spatial image structure of the input color image region;

the first function mapping each coordinate value indicating an original image location in the input color image region to a point in a parameter space;

the processor, further in executing the instructions, computing a second function to represent a color space subset of a color space structure of the input color image region;

the second function mapping each point in the parameter space to a color space location in the color space subset; and

the processor, still further in executing the instructions, computing the composition of the first and second functions to produce a third function, referred to as a space-color separable function, for mapping coordinate values of the input color image region to color values in the color space subset;

the space-color separable function approximating the original color values and the original image locations in the input color image region;

the space-color separable function, when used in place of the image region data items to represent colors in the input color image region, producing a rendered color image region substantially similar in appearance to the input color image region.

6. The article of manufacture of claim 5 wherein the processor, in computing the first function, computes a polynomial function, and wherein the processor, in computing the second function, computes a linear function.

7. The article of manufacture of claim 5 wherein the data storage medium that can be accessed by the storage medium access circuitry included in the machine is a network server device physically distinct from the machine that accesses the article;

the storage medium access circuitry including communications circuitry for accessing the instruction data stored on the network server device.

8. The article of manufacture of claim 5 wherein the data storage medium that can be accessed by the storage medium access circuitry included in the machine is a storage medium device physically connected to the machine that accesses the article;

the storage medium access circuitry being included in the storage medium device.

9. The article of manufacture of claim 5

wherein the processor, still further in executing the instructions, applies a color coordinate transformation to the color space subset by applying a color transformation function representing the color coordinate transformation to the second function representing the color space subset to produce a modified second function;

the processor applying the color coordinate transformation to the color space subset when the original color values are to be represented as modified color values; and

wherein the processor, in computing the composition of the first and second functions to produce the space-color separable function, computes the composition of the first function and the modified second function;

the color coordinate transformation being applied to the color space subset independently of the spatial image structure of the input color image region by modifying the second function independently of the first function;

the space-color separable function, when used in place of the image region data items to represent the input color image region, producing a rendered color image region having the modified color values.

10. The article of manufacture of claim 5

wherein the processor, still further in executing the instructions, applies an image coordinate transformation to the input color image region by applying an image transformation function representing the image coordinate transformation to the first function representing the spatial image structure of the input color image region to produce a modified first function;

the processor applying the image coordinate transformation to the spatial image structure when the original image locations are to be represented as modified image locations; and

wherein the processor, in computing the composition of the first and second functions to produce the space-color separable function, computes the composition of the modified first function and the second function;

the image coordinate transformation being applied to the spatial structure of the input color image region independently of the color space structure of the input color image region by modifying the first function independently of the second function;

the space-color separable function, when used in place of the image region data items to represent the input color image region, producing a rendered color image region having the modified image locations.

11. A data structure stored on a storage medium capable of being accessed and read by a processor-controlled machine;

the data structure representing an original image;

the machine including storage medium access circuitry for accessing and reading the data structure stored in the storage medium;

the data structure comprising a plurality of region data items;

each region data item representing a respective one of a plurality of image regions in the original image;

each image region formed by a set of image region boundaries determined to be included in the original image;

each respective one of the plurality of region data items indicating a space-color separable function representing values of image colors and image locations of a respective image region of the original image represented by the respective region data item;

the space-color separable function approximating original color values and original image locations in the respective image region as a composition of a first function and a second function;

the first function representing a spatial image structure of the image region and mapping each coordinate value indicating an original image location in the image region to a point in a parameter space;

the second function representing a color space subset of a color space structure of the image region and mapping each point in the parameter space to a color space location in the color space subset;

the space-color separable function producing a rendered color image region substantially similar in appearance to the respective image region.

12. The data structure of claim 11 wherein an image region boundary in the original image is determined by a discontinuity in a color value in the original image such that a coherent area of the original image having a substantially similar color value indicates an image region in the original image to be represented in the data structure by a region data item.

13. The data structure of claim 11 wherein the original image represented by the data structure is an image definition data structure representation of a continuous-tone color image.

14. In a processor-based system including a memory having instructions stored therein indicating instructions for a color image editing application program the processor executes, and including a display device having a display area wherein an original color image is presented;

the original color image being represented in memory as an original image definition data structure;

the original color image including a plurality of image regions determined to be included therein;

the improvement wherein the processor, in executing the instructions for performing the color image editing application program, produces, for each respective image region determined to be included in the original color image, a representation of the respective image region as a space-color separable function;

the space-color separable function approximating original color values and original image locations in the respective image region;

the processor, in producing the space-color separable function,

obtaining a plurality of image region data items each indicating image definition data defining the respective image region;

each image region data item indicating coordinate values of a respective original image location in the respective image region and an original color value of the respective original image location;

computing a first function to represent a spatial image structure of the respective image region;

the first function mapping each coordinate value indicating an original image location in the respective image region to a point in a parameter space;

computing a second function to represent a color space subset of a color space structure of the respective image region;

the second function mapping each point in the parameter space to a color space location in the color space subset; and

computing the composition of the first and second functions to produce the space-color separable function for mapping coordinate values of the respective image region to color values in the color space subset;

the space-color separable function, when used in place of the image region data items to represent the respective image region, producing a rendered color image region substantially similar in appearance to the respective image region.

15. The improvement in the processor-based system including the instructions for the color image editing application program of claim 14 wherein the processor, further in executing the instructions for the color image editing application program, performs an editing operation on a respective one of the image regions in the original color image to produce a modified rendered image region in response to a request from a user of the color image editing application program;

the modified image region after the editing operation showing at least one of original image locations and original image colors of the respective image region changed in appearance from the original color image;

the processor, in executing the instructions for performing the editing operation,

applying a transformation function to one of the first and second functions to produce a modified function; and

wherein the processor, in executing the instructions for computing the composition of the first and second functions to produce the space-color separable function, uses the modified function to produce the space-color separable function;

the space-color separable function, when used in place of the image region data items to represent the image region, producing the modified rendered image region;

the transformation function being independently applied to one of the spatial structure and the color space structure of the image region by modifying one function independently of the other function.