Image editing system including masking capability

• US 5,469,536 A
• Filed: 05/21/1993
• Issued: 11/21/1995
• Est. Priority Date: 02/25/1992
• Status: Expired due to Fees

• Current Assignee: BET Funding, LLC
• Original Assignee: Imageware Systems Incorporated
• Inventors: Blank, Arthur M.
• Primary Examiner(s): Nguyen, Phu K.
• Application Number:
  US08/065,750
• Time in Patent Office: 914 Days
• Field of Search: 395/131, 395/129, 358/28, 358/27, 345/22, 345/150, 345/153, 345/154
• US Class Current: 345/594
• CPC Class Codes: H04N 1/3873 defined only by a limited number of coordinate points or parameters, e.g. corners, centre; for trimming
• CPC Class Codes: H04N 1/622 with simulation on a subsidiary picture reproducer
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 9/75 Chroma key

Abstract

A system and method for editing digital images in three dimensions includes a computer for storing a digital image of an object and a background, as well as at least one additional background image. Based upon the difference between the hues of the edge of the object and the surrounding background and a predetermined hue difference, the computer locates the edge of the object and removes portions of the image (i.e., the background) that are outside the edge. Then, the object can be combined with a preselected one of the other background images so as to form a composite image. Components of the preselected background image are assigned relative positions in the X-Y plane, and are also assigned a value defining their location in one of a plurality of layers which form the Z dimension of the image. The object to be combined with the background is also assigned a value defining its location in at least one of those layers. In another embodiment of the invention, colors of either a digital or video image can be selectively assigned to a mask. The colors can be of the entire image or from a selected area of the image. Color manipulation can then be performed on just the colors of the image defined by the mask. The mask may be used with the entire image, with a selected area of the image, or with objects. Alternatively, the colors of the image defined by an inverted mask are affected by color manipulation.

Claims

1. In a computer system having a memory and a visual display, a digital method of editing an image having a plurality of pixels, each pixel having a color, comprising the steps of:

providing an image in digital form;

interactively selecting a plurality of colors from among those present in the image at at least one location on the visual display to form a set of selected colors wherein each color comprises a single discrete hue; and

manipulating, independent of inputs representative of any other image, only those pixels on the visual display having a color defined in the set of selected colors so as to change a visual feature of the image.

2. The method as defined in claim 1, wherein the step of selecting a plurality of colors comprises the steps of:

selecting a first single pixel of the image to identify a first color; and

selecting a second single pixel of the image, of a different color than the first pixel, so as to identify a second color.

3. The method as defined in claim 2, wherein the step of selecting a single pixel includes the step of using a pointing device connected to the computer system to mark one of the pixels.

4. The method as defined in claim 1, wherein the step of selecting a plurality of colors includes the step of selecting a plurality of pixels of the image to form a set of selected pixels that identify the plurality of colors.

5. The method as defined in claim 4, wherein the step of selecting a plurality of pixels includes the step of using a pointing device connected to the computer system to draw a boundary around the pixels.

6. The method as defined in claim 5, wherein the boundary comprises a polygon.

7. The method as defined in claim 4, wherein the step of selecting a plurality of pixels includes the step of using the pointing device as a brush to electronically touch the plurality of pixels.

8. The method as defined in claim 4, wherein the step of selecting a plurality of pixels includes the step of selecting pixels of the image mutually exclusive to the set of selected pixels to form a new set of selected colors.

9. The method as defined in claim 1, further comprising the step of storing data representing the set of selected colors in a list on the memory of the computer system.

10. The method as defined in claim 9, wherein the list is initially empty.

11. The method as defined in claim 9, wherein the list initially includes all the colors of the image.

12. The method as defined in claim 9, wherein the list initially includes at least one of the colors of the image.

13. The method as defined in claim 9, wherein the list is structured to link the colors.

14. The method as defined in claim 13, wherein the step of manipulating pixels includes the steps of:

processing a set of pixels of a color corresponding to a first color in the list; and

processing a set of pixels of another color corresponding to a second color linked to the first color in the list.

15. The method as defined in claim 9, further comprising the step of adding another color to the list by the steps of:

selecting a different color of the image not in the set of selected colors; and

storing data representing the different color in the list.

16. The method as defined in claim 15, wherein the list is structured to link the colors.

17. The method as defined in claim 9, additionally comprising the step of deleting a color that is stored in the list.

18. The method as defined in claim 17, wherein the step of deleting a color further comprises the steps of:

identifying a color of the image that is stored in the list; and

deleting the identified color from the list.

19. The method as defined in claim 17, wherein the list is structured to link the colors.

20. The method as defined in claim 1, wherein the step of selecting a plurality of colors further comprises the steps of:

selecting a plurality of pixels of the image that identify a single color; and

repeating the step of selecting a plurality of pixels for a different color so as to identify a plurality of colors.

21. The method as defined in claim 20, wherein the step of selecting a plurality of pixels further includes the step of using the pointing device to draw a boundary around the pixels.

22. The method as defined in claim 1, wherein following the step of selecting a plurality of colors, the method comprises the step of selecting an area within the image that is smaller than the image.

23. The method as defined in claim 22, wherein the step of manipulating pixels comprises the step of changing the color value of one or more pixels in the selected area in response to the colors defined in the set of selected colors.

24. The method as defined in claim 1, wherein the image comprises at least one object.

25. The method as defined in claim 24, wherein the image comprises a plurality of objects and further wherein following the step of selecting a plurality of colors, the method comprises the step of selecting one of the objects.

26. The method as defined in claim 25, wherein the image has a plurality of X-Y planes located along a Z-axis and the selected object is on one of the X-Y planes.

27. The method as defined in claim 25, wherein the step of manipulating pixels comprises the step of changing the color value of one or more pixels in the selected object in response to the colors defined in the set of selected colors.

28. The method as defined in claim 1, further comprising the steps of:

providing another image having a plurality of pixels; and

repeating the step of manipulating pixels on the new image.

29. The method as defined in claim 28, wherein the new image is one of a sequence of related images.

30. The method as defined in claim 1, wherein the step of manipulating pixels comprises the step of selecting an option to be performed by the computer, and wherein the option is selected from a group consisting of:

area fill;

area sharpen;

area blur;

area adjust color;

area tint;

area posterize;

area gray-scale;

area stamp-into-selection;

object fill;

object sharpen;

object blur;

object adjust color;

object tint;

object posterize;

object gray-scale; and

brush options.

31. The method as defined in claim 1, wherein each color is different from another color by at least one attribute.

32. The method as defined in claim 31, wherein the attributes comprise red, green, blue.

33. The method as defined in claim 31, wherein the attributes comprise hue, saturation, lightness.

34. The method as defined in claim 31, wherein the attributes comprise hue, saturation, contrast.

35. The method as defined in claim 1, wherein the colors include substantially all visible colors.

36. The method as defined in claim 35, wherein all visible colors are represented by a plurality of hues of gray including the absolutes of black and white.

37. In a computer system having a memory and a visual display, a digital method of editing an image having a plurality of pixels, each pixel having a color, comprising the steps of:

providing an image in digital form;

identifying a color of each pixel of the image;

storing data representing each identified color in an original first list on the memory of the computer system;

identifying a user-selected color at a user-selected location on the visual display of the image wherein the selected color comprises a single discrete hue;

deleting the data representing the selected color from the first list; and

manipulating, independent of inputs representative of any other image, pixels of the image on the visual display having colors of a preselected relationship to the colors identified in the first list so as to change a visual feature of the image.

38. The method as defined in claim 37, wherein the preselected relationship is all colors represented by data in the first list.

39. The method as defined in claim 37, wherein the preselected relationship is all colors represented by data that has been deleted from the first list.

40. The method as defined in claim 37, wherein the step of identifying a selected color comprises the step of selecting a single pixel of the image to identify a single color.

41. The method as defined in claim 40, wherein the step of selecting a single pixel comprises the step of using a pointing device connected to the computer system to mark the pixel.

42. The method as defined in claim 40, wherein the step of selecting a single pixel is repeated for a different color so as to identify a plurality of colors.

43. The method as defined in claim 37, wherein the step of identifying a selected color comprises the step of selecting a plurality of pixels of the image to form a set of selected pixels that identify a plurality of colors.

44. The method as defined in claim 43, wherein the step of identifying a selected color further comprises the step of using a pointing device connected to the computer system to draw a boundary around the pixels.

45. The method as defined in claim 44, wherein the boundary comprises a polygon.

46. The method as defined in claim 43, wherein the step of identifying a selected color further comprises the step of using a pointing device connected to the computer system as a brush to electronically touch the plurality of pixels.

47. The method as defined in claim 37, wherein the first list is structured to link the colors.

48. The method as defined in claim 47, wherein the step of manipulating pixels of the image further comprises the steps of:

processing a set of pixels of a color corresponding to a first color in the first list; and

processing a set of pixels of another color corresponding to a second color linked to the first color in the first list.

49. The method as defined in claim 37, additionally comprising the step of storing data representing the selected color in a second list on the memory of the computer system;

50. The method as defined in claim 49, wherein the step of manipulating pixels of the image is performed on the pixels of the image having the colors corresponding to the colors identified in the second list.

51. The method as defined in claim 49, wherein the second list is initially empty.

52. The method as defined in claim 49, wherein the second list initially includes at least one of the colors of the image.

53. The method as defined in claim 49, wherein the second list is structured to link the colors.

54. The method as defined in claim 53, wherein the step of manipulating pixels of the image further comprises the steps of:

processing a set of pixels of a color corresponding to a first color in the second list; and

processing a set of pixels of another color corresponding to a second color linked to the first color in the second list.

55. The method as defined in claim 49, further comprising the step of adding data representing another color to the second list by the steps of:

selecting a different color of the image than was previously represented in the second list; and

storing data representing the different color in the second list.

56. The method as defined in claim 55, wherein the second list is structured to link the colors.

57. The method as defined in claim 49, further comprising the step of deleting data representing a selected color that is stored in the second list.

58. The method as defined in claim 57, wherein the step of deleting data representing a selected color further comprises the steps of:

identifying a color of the image for which data representing such color is stored in the second list; and

deleting data representing the identified color from the second list.

59. The method as defined in claim 57, wherein the second list is structured to link the colors.

60. The method as defined in claim 37, wherein the step of identifying a selected color comprises the step of selecting a plurality of pixels of the image that identify a single color.

61. The method as defined in claim 60, wherein the step of selecting a plurality of pixels further comprises the step of using a pointing device connected to the computer system to draw a boundary around the pixels.

62. The method as defined in claim 37, wherein following the step of deleting the data from the first list, the method comprises the step of selecting an area within the image that is smaller than the image.

63. The method as defined in claim 62, wherein the step of manipulating pixels of the image further comprises the step of changing the color value of one or more pixels in the selected area in response to the colors identified in the first list.

64. The method as defined in claim 62, wherein the step of manipulating pixels of the image further comprises the step of changing the color value of one or more pixels in the selected area in response to the colors identified in the second list.

65. The method as defined in claim 37, wherein the image comprises at least one object.

66. The method as defined in claim 65, wherein the image comprises a plurality of objects and further wherein following the step of deleting the data from the first list, the method comprises the step of selecting one of the objects.

67. The method as defined in claim 66, wherein the image has a plurality of X-Y planes located along a Z-axis and the selected object is on one of the X-Y planes.

68. The method as defined in claim 66, wherein the step of manipulating pixels of the image further comprises the step of changing the color value of one or more pixels in the selected object in response to the colors identified in the first list.

69. The method as defined in claim 66, wherein the step of manipulating pixels of the image further comprises the step of changing the color value of one or more pixels in the selected object in response to the colors identified in the second list.

70. The method as defined in claim 37, further comprising the steps of:

providing another image having a plurality of pixels; and

repeating the step of manipulating pixels on the new image.

71. The method as defined in claim 70, wherein the new image is one of a sequence of related images.

72. The method as defined in claim 37, wherein the step of manipulating pixels of the image further comprises the step of selecting an option to be performed by the computer, wherein the option is selected from a group consisting of:

area fill;

area sharpen;

area blur;

area adjust color;

area tint;

area posterize;

area gray-scale;

area stamp-into-selection;

object fill;

object sharpen;

object blur;

object adjust color;

object tint;

object posterize;

object gray-scale; and

brush options.

73. In a computer system having a memory and a visual display, a digital method of creating a color mask for an image, comprising the steps of:

providing a digital image having a plurality of pixels, each pixel having a color;

interactively selecting a plurality of colors from among those present in the image at at least one location on the visual display to form a set of selected colors wherein each color comprises a single discrete hue; and

storing data representing the colors from the set of selected colors in a list on the memory of the computer system, to thereby define the mask.

74. The method as defined in claim 73, further comprising the step of manipulating only those pixels of the image having colors corresponding to the colors represented in the mask so as to change a visual feature of the image.

75. The method as defined in claim 74, wherein following the step of storing data in a list, the method comprises the step of selecting an area within the image that is smaller than the image.

76. The method as defined in claim 75, wherein the step of manipulating pixels of the image further comprises the step of changing the color value of one or more pixels in the selected area in response to the colors represented in the mask.

77. The method as defined in claim 74, wherein the image comprises at least one object.

78. The method as defined in claim 77, wherein the image comprises a plurality of objects and further wherein following the step of storing data in a list, the method comprises the step of selecting one of the objects.

79. The method as defined in claim 78, wherein the step of manipulating pixels of the image further comprises the step of changing the color value of one or more pixels in the selected object in response to the colors represented in the mask.

80. In a computer system having a memory and a visual display, a digital method of creating an inverted color mask for an image, comprising the steps of:

providing a digital image having a plurality of pixels, each pixel having a color;

identifying the color of each pixel of the image to form a set of identified colors wherein each color comprises a single discrete hue;

interactively selecting a color at an arbitrary location of the image in the visual display; and

deleting the selected color from the colors in the set of identified colors, thereby defining an inverted mask.

81. The method as defined in claim 80, further comprising the step of storing data representing each color from the set of identified colors in a first list on the memory of the computer system.

82. The method as defined in claim 80, further comprising the step of storing data representing the selected color in a second list on the memory.

83. The method as defined in claim 82, wherein the second list defines a noninverted mask.

84. The method as defined in claim 83, additionally comprising the step of manipulating pixels of the image having the colors corresponding to the colors identified in the noninverted mask so as to change a visual feature of the image.

85. The method as defined in claim 84, wherein the image comprises at least one object.

86. The method as defined in claim 85, wherein the image comprises a plurality of objects and further wherein following the step of deleting the selected color, the method comprises the step of selecting one of the objects.

87. The method as defined in claim 86, wherein the step of manipulating pixels of the image further comprises the step of changing the color value of one or more pixels in the selected object in response to the colors represented in the noninverted mask.

88. The method as defined in claim 84, wherein following the step of deleting the selected color, the method comprises the step of selecting an area within the image that is smaller than the image.

89. The method as defined in claim 88, wherein the step of manipulating pixels of the image further comprises the step of changing the color value of one or more pixels in the selected area in response to the colors represented in the noninverted mask.

90. The method as defined in claim 80, additionally comprising the step of manipulating pixels of the image having colors corresponding to the colors represented in the inverted mask so as to change a visual feature of the image.

91. The method as defined in claim 90, wherein following the step of deleting the selected color, the method comprises the step of selecting an area within the image that is smaller than the image.

92. The method as defined in claim 91, wherein the step of manipulating pixels of the image further comprises the step of changing the color value of one or more pixels in the selected area in response to the colors represented in the inverted mask.

93. The method as defined in claim 90, wherein the image comprises at least one object.

94. The method as defined in claim 93, wherein the image comprises a plurality of objects and further wherein following the step of deleting the selected color, the method comprises the step of selecting one of the objects.

95. The method as defined in claim 94, wherein the step of manipulating pixels of the image further comprises the step of changing the color value of one or more pixels in the selected object in response to the colors represented in the inverted mask.

96. A Digital system for editing a digital image having a plurality of pixels, each pixel having a color, comprising:

a computer having a memory and a visual display;

means for providing the image to the computer;

means for identifying a color of each pixel of the image on the visual display wherein each color comprises a single discrete hue;

means for storing data representing each identified color in a first list on the memory of the computer;

interactive means for identifying a selected color at an arbitrary location of the image on the visual display;

means for deleting the data representing the selected color from the first list; and

means for manipulating pixels of the image having colors corresponding to the colors identified in the first list, independent of inputs representative of any other image, so as to change a visual feature of the image.

97. The system as defined in claim 96, further comprising means for storing data representing the selected color in a second list on the memory.

98. The system as defined in claim 97, further comprising means for manipulating pixels of the image having colors corresponding to the colors identified in the second list so as to change a visual feature of the image.

99. In a computer system having a visual display, a digital method of recoloring an object having a plurality of pixels, comprising the steps of:

providing a digital background image having a plurality of pixels;

interactively selecting an area from the background image on the visual display;

determining a hue of a selected pixel in the selected area;

repeating the determining step until the hue of all pixels in the selected area has been determined;

determining an average hue of all the pixels in the selected area;

selecting an object on the visual display to be recolored; and

changing the hue off the selected object to the determined average hue.

100. The method as defined in claim 99, wherein the selected area is a single pixel.

101. The method as defined in claim 99, wherein the step of selecting an object includes the step of selecting a tool defining a brush with which to recolor the selected object.

102. In a computer system having a visual display, a digital method of recoloring an object having a plurality of pixels, comprising the steps of:

providing a background image having a plurality of pixels;

interactively selecting an area from the background image on the visual display;

identifying the selected area as a first object;

determining a hue of a selected pixel of the first object;

repeating the determining step until the hue of all pixels of the first object has been determined;

determining an average hue of all the pixels of the first object;

identifying a second object on the visual display to be recolored; and

changing the hue of the second object to the average hue of the first object.