Generating imitation custom artwork by simulating brush strokes and enhancing edges

• US 5,621,868 A
• Filed: 04/15/1994
• Issued: 04/15/1997
• Est. Priority Date: 04/15/1994
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Mizutani, Masao, Lee, Chuen-Chien
• Primary Examiner(s): Zimmerman, Mark K.
• Application Number:
  US08/228,286
• Time in Patent Office: 1,096 Days
• Field of Search: 395/118, 395/129, 395/131, 395/132, 348/578, 382/274
• US Class Current: 345/595
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 15/02 Non-photorealistic rendering

Abstract

The precision of an initial image is reduced through image automatic processing in a manner simulating techniques used in the production of a custom art work. The resulting image, although generated without human intervention, has a pleasing, customized appearance which can be desirable to consumers seeking decorative art work. One way of reducing the precision of the initial image is modifying portions of the image to have more uniform luminance, color saturation, or color hue, producing a resulting image appearing to contain brush strokes. Alternatively, the precision of the initial image is reduced by locating contrast edges in the image, and modifying the luminance along these edges, producing a resulting image in which objects and features are outlined and have an enhanced definition from the background.

Claims

1. A method for modifying an initial image to produce a resulting image having the appearance of custom art work, comprising

storing a pixellated representation of said initial image in an electronic memory,

inspecting pixels of said pixellated representation of said initial image to derive, without human input, modifications which reduce the precision of said initial image in a manner simulating techniques used by humans to produce custom art work, by selecting locations in said initial image, determining contrast of said initial image at each location in at least two directions, determining a direction of maximum contrast at each location, and selecting elongated portions of said initial image at each location, the elongated portion at each respective location being oriented with its elongated dimension perpendicular to the direction of maximum contrast at said respective location,

automatically applying said modifications to said pixels of said pixellated representation of said initial image to generate a pixellated representation of said resulting image by blurring said initial image to form a background within which said portions are modified, and modifying each selected portion to approximate one or more of uniform luminance, uniform color saturation and uniform color hue as compared to said initial image, whereby said resulting image has the appearance of brush strokes, and

producing a visual output of said resulting image.

2. The method of claim 1 wherein producing a visual output of said resulting image comprises one or more of

printing a copy of said pixellated representation of said resulting image and

generating a display of said pixellated representation of said resulting image on an electronic display device.

3. The method of claim 1 wherein modifying a selected portion comprises

selecting a luminance and color value corresponding to one or more pixels within said selected portion of said initial image,

comparing said selected luminance value to an average luminance value derived from a plurality of pixels of said initial image,

reducing said selected luminance value if said selected luminance value is less than said average luminance value, otherwise increasing said selected luminance value,

deriving pixel luminance and color values from said selected color value and said reduced or increased selected luminance value, and

modifying pixels of said selected portion to approach said derived pixel luminance and color values.

4. The method of claim 3 wherein deriving pixel luminance and color values comprises augmenting said selected color value and said reduced or increased selected luminance value with pseudo-random noise to produce variation in luminance or color of pixels of said selected portion.

5. The method of claim 1 wherein selecting portions of said initial image comprises selecting elongated portions having parabolic curved elongated edges.

6. The method of claim 1 wherein selecting an elongated portion of said initial image at a respective location in said initial image further comprises selecting an elongated portion having a size related to contrast of said initial image in said direction of maximum contrast at said respective location.

7. The method of claim 1 wherein determining contrast at locations in said initial image comprises determining contrast from a blurred version of said initial image, resulting in increased uniformity of orientation of said elongated portions.

8. The method of claim 1 wherein

selecting locations for elongated portions of said initial image comprises selecting a first set of rows of locations extending through said image, and then selecting a second set of rows of locations interleaved with said first set of rows of blocks and extending through said image, and

modifying said elongated portions comprises modifying portions along said first set of rows prior to modifying portions along said second set of rows, whereby modifications of said elongated portions are variably overlapped within said image.

9. The method of claim 1 wherein

selecting elongated portions of said initial image comprises selecting large portions and smaller portions of said image, and

modifying said elongated portions comprises modifying said large portions prior to modifying said smaller portions.

10. The method of claim 9 wherein

selecting locations for large elongated portions of said image comprises selecting large portions along a first set of rows extending through said image, and selecting locations for large elongated portions along a second set of rows interleaved with said first set of rows and extending through said image, and

modifying said elongated portions comprises modifying portions along said first set of rows prior to modifying portions along said second set of rows,

whereby modifications of said large elongated portions are variably overlapped within said image.

11. The method of claim 8 wherein selecting locations for smaller elongated portions of said image comprises selecting locations for smaller portions at locations in said image determined to have high contrast.

12. A method for modifying an initial image to produce a resulting image having the appearance of custom art work by identifying contrast edges in the initial image, comprising

storing a pixellated representation of said initial image in an electronic memory,

generating at each pixel of said initial image a differential measure of luminance contrast by computing a luminance variation between pixels neighboring said pixel, and computing a logarithm of said luminance variation, and

modifying luminance of said initial image by combining the logarithm of each said differential measure with luminance of a corresponding pixel in said initial image, to generate luminance values for said resulting image, whereby objects in said resulting image have enhanced definition from background, and

producing a visual output of said resulting image.

13. The method of claim 12 wherein modifying luminance of said initial image comprises increasing luminance of said image in relatively high luminance areas of said image, and decreasing luminance of said image in relatively low luminance areas of said image.

14. The method of claim 12 wherein combining each said differential measure with a corresponding pixel in said initial image comprises multiplying each said differential measure with luminance of said corresponding pixel in said initial image.

15. The method of claim 12 wherein combining each said differential measure with a corresponding pixel in said initial image comprises

comparing said differential measure to a threshold value, and only if the comparison has a predetermined result, modifying said differential measure by subtracting it from a predetermined maximum value, otherwise not, and

multiplying each thus modified differential measure with luminance of said corresponding pixel in said initial image.

16. The method of claim 15 wherein said threshold value is derived from an average luminance value taken from a plurality of pixels of said initial image.

17. Apparatus for modifying an initial image to produce a resulting image having the appearance of custom art work, comprising

an electronic memory storing a pixellated representation of said initial image,

computing circuitry inspecting pixels of said pixellated representation of said initial image to derive, without human input, modifications which reduce the precision of said initial image in a manner simulating techniques used by humans to produce custom art work, by selecting locations in said initial image, determining contrast of said initial image at each location in at least two directions, determining a direction of maximum contrast at each location, and selecting elongated portions of said initial image at each locations, the elongated portion at each respective location being oriented with its elongated dimension perpendicular to the direction of maximum contrast at said respective location, and automatically applying said modifications to said pixels of said pixellated representation of said initial image to generate a pixellated representation of said resulting image, by blurring said initial image to form a background within which said portions are modified, and modifying each selected portion to approximate one or more of more uniform luminance, uniform color saturation and uniform color hue as compared to said initial image, whereby said resulting image has the appearance of brush strokes, and

an output port for connection to an output device capable of producing a visual output of said resulting image.

18. The apparatus of claim 17 wherein said output port is configured for connection to a printer.

19. The apparatus of claim 17 wherein said output port is configured for connection to an electronic display monitor.

20. The apparatus of claim 17 wherein elongated portions selected by said computing circuitry have a size related to contrast of said initial image in said direction of maximum contrast.

21. The apparatus of claim 17 wherein said computing circuit determines contrast of said initial image from a blurred version of said initial image, resulting in increased uniformity of orientation of said portions.

22. The apparatus of claim 17 wherein

said computing circuit selects portions of said initial image by selecting a first set of rows of blocks extending through said image, and then selecting a second set of rows of blocks interleaved with said first set of rows of blocks and extending through said image, and

said computing circuit modifies portions along said first set of rows prior to modifying portions along said second set of rows,

whereby modifications of said portions are variably overlapped within said image.

23. The apparatus of claim 17 wherein

said computing circuit selects large portions and smaller portions of said image, and

said computing circuit modifies said large portions prior to modifying said smaller portions.

24. The apparatus of claim 23 wherein said computing circuit selects smaller portions of said image in regions of said image having high contrast.

25. The apparatus of claim 17 wherein said computing circuitry modifies each selected portion by the steps of

selecting a luminance and color value corresponding to one or more pixels within said selected portion,

comparing said selected luminance value to an average luminance value derived from a plurality of pixels of said initial image,

reducing said selected luminance value if said selected luminance value is less than said average luminance value, otherwise increasing said selected luminance value,

deriving pixel luminance and color values from said selected color value and said reduced or increased selected luminance value, and

modifying pixels of said selected portion to approach said derived pixel luminance and color values.

26. The apparatus of claim 25 wherein said step of deriving pixel luminance and color values comprises augmenting said selected color value and said reduced or increased selected luminance value with pseudo-random noise to produce variation in luminance or color of pixels of said selected portion.

27. The apparatus of claim 17 wherein said computing circuitry selects elongated portions of said initial image having parabolic curved elongated edges.

28. Apparatus for modifying an initial image to produce a resulting image having the appearance of custom art work by identifying contrast edges in the initial image, comprising

an electronic memory storing a pixellated representation of said initial image,

computing circuitry inspecting pixels of said pixellated representation of said initial image to derive, without human input, modifications which reduce the precision of said initial image in a manner simulating techniques used by humans to produce custom art work, by generating at each pixel of said initial image a differential measure of luminance contrast by computing a luminance variation between pixels neighboring said pixel, and computing a logarithm of said luminance variation, and modifying luminance of said initial image by combining the logarithm of each said differential measure with luminance of a corresponding pixel in said initial image, to generate luminance values for said resulting image, whereby objects in said resulting image have enhanced definition from background, and

an output port for connection to an output device capable of producing a visual output of said resulting image.

29. The apparatus of claim 28 wherein said computing circuitry modifies luminance of said initial image by increasing luminance of said image in relatively high luminance areas of said image, and decreasing luminance of said image in relatively low luminance areas of said image.

30. The apparatus of claim 28 wherein said computing circuitry combines each said differential measure with a corresponding pixel in said initial image by multiplying each said differential measure with luminance of said corresponding pixel in said initial image.

31. The apparatus of claim 28 wherein said computing circuitry combines each said differential measure with a corresponding pixel in said initial image by the steps of

comparing said differential measure to a threshold value, and only if the comparison has a predetermined result, modifying said differential measure by subtracting it from a predetermined maximum value, otherwise not, and

multiplying each thus modified differential measure with luminance of said corresponding pixel in said initial image.

32. The apparatus of claim 31 wherein said computing circuitry derives said threshold value from an average luminance value taken from a plurality of pixels of said initial image.