Image processing apparatus

• US 20060082849A1
• Filed: 10/20/2005
• Published: 04/20/2006
• Est. Priority Date: 10/20/2004
• Status: Abandoned Application

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Photo Film Co Limited (Fujifilm Holdings Corporation)
• Inventors: Kaku, Toshihiko
• Application Number:
  US11/253,718
• Publication Number:
  US 20060082849A1
• Time in Patent Office: Days
• US Class Current: 358/537
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06V 10/273 removing elements interfering with the pattern to be recognised
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: H04N 1/62 Retouching, i.e. modification of isolated colours only or in isolated picture areas only

Abstract

A local region determining section determines a region above a face, detected by a face detecting section, to be a local region, which is a part of a shadowless background region. An extraction executing section extracts regions adjacent to the local region and constituted by pixels of a similar color to that of the local region, as the shadowless background region. A shadow region extracting section extracts a region adjacent to the shadowless background region and constituted by pixels, of which: differences in hue and saturation from the average hue and the average saturation of the local region are within predetermined threshold values; the brightness is lower than the average brightness of the local region; and the difference in the brightnesses exceeds a predetermined threshold value, as a shadow region. A correcting section corrects the brightness of the shadow region to match that of the local region, to remove a shadow.

Claims

1. An image processing apparatus for removing shadows of a main subject, from a photographic image in which the shadows are present within a background having a simple pattern, comprising:

shadowless background region extracting means for extracting a shadowless background region, in which the shadows are not present, from the photographic image;

shadow region extracting means for extracting a shadow region, from regions within the photographic image other than the shadowless background region; and

correcting means, for removing the shadows from the photographic image, by adjusting pixel values of the shadowless background region and/or the shadow region.

2. An image processing apparatus as defined in claim 1, wherein:

the shadow region extracting means extracts the shadow region from regions adjacent to the shadowless background region.

4. An image processing apparatus as defined in claim 1, wherein the shadowless background extracting means comprises:

local region obtaining means for obtaining a local region within the shadowless background region; and

wherein;

the shadowless background region is extracted by obtaining regions adjacent to the obtained local region having pixels of similar colors to that of the local region, and by combining the local region with the adjacent regions.

5. An image processing apparatus as defined in claim 2, wherein the shadowless background extracting means comprises:

local region obtaining means for obtaining a local region within the shadowless background region; and

wherein;

the shadowless background region is extracted by obtaining regions adjacent to the obtained local region having pixels of similar colors to that of the local region, and by combining the local region with the adjacent regions.

7. An image processing apparatus as defined in claim 4, wherein:

the photographic image is an ID photograph of a human;

the local region obtaining means comprises face detecting means; and

wherein;

the local region is obtained based on a facial region detected by the face detecting means.

8. An image processing apparatus as defined in claim 5, wherein:

the photographic image is an ID photograph of a human;

the local region obtaining means comprises face detecting means; and

wherein;

the local region is obtained based on a facial region detected by the face detecting means.

10. An image processing apparatus as defined in claim 4, wherein the local region obtaining means comprises input means, for specifying the local region;

and wherein;

the local region is obtained based on input, which is input via the input means.

11. An image processing apparatus as defined in claim 5, wherein the local region obtaining means comprises input means, for specifying the local region;

and wherein;

the local region is obtained based on input, which is input via the input means.

13. An image processing apparatus as defined in claim 4, wherein:

the shadow region extracting means extracts regions, which have substantially the same hue and/or saturation as the shadowless region, and have lower brightnesses than the shadowless regions, as the shadow region.

14. An image processing apparatus as defined in claim 5, wherein:

the shadow region extracting means extracts regions, which have substantially the same hue and/or saturation as the shadowless region, and have lower brightnesses than the shadowless regions, as the shadow region.

3. An image processing apparatus for removing shadows of a main subject, from a photographic image in which the shadows are present within a background having a simple pattern, comprising:

background region extracting means for extracting a background region, in which the shadows are present, from the photographic image;

shadow region extracting means for separating the extracted background region with shadows therein into a shadowless background region without shadows therein and a shadow region, in which the shadows are present; and

correcting means, for removing the shadows from the photographic image, by adjusting pixel values of the shadowless background region and/or the shadow region.

6. An image processing apparatus as defined in claim 3, wherein the background extracting means comprises:

local region obtaining means for obtaining a local region within a shadowless portion of the background region; and

wherein;

the background region is extracted by obtaining regions adjacent to the obtained local region having pixels of similar colors to that of the local region, and by combining the local region with the adjacent regions.

9. An image processing apparatus as defined in claim 6, wherein:

the photographic image is an ID photograph of a human;

the local region obtaining means comprises face detecting means; and

wherein;

the local region is obtained based on a facial region detected by the face detecting means.

12. An image processing apparatus as defined in claim 6, wherein the local region obtaining means comprises input means, for specifying the local region;

and wherein;

the local region is obtained based on input, which is input via the input means.

15. An image processing apparatus as defined in claim 6, wherein:

the shadow region extracting means extracts regions, which have substantially the same hue and/or saturation as the shadowless region, and have lower brightnesses than the shadowless regions, as the shadow region.

16. A program that causes a computer to execute image processing for removing shadows of a main subject, from a photographic image in which the shadows are present within a background having a simple pattern, comprising the procedures of:

extracting a shadowless background region, in which the shadows are not present, from the photographic image;

extracting a shadow region, from regions within the photographic image other than the shadowless background region; and

removing the shadows from the photographic image, by adjusting pixel values of the shadowless background region and/or the shadow region.

17. A program as defined in claim 16, wherein:

the procedure for extracting the shadow region extracts the shadow region from regions adjacent to the shadowless background region.

18. A program that causes a computer to execute image processing for removing shadows of a main subject, from a photographic image in which the shadows are present within a background having a simple pattern, comprising the procedures of:

extracting a background region, in which the shadows are present, from the photographic image;

separating the extracted background region with shadows therein into a background without shadows therein and a shadow region, in which the shadows are present; and

removing the shadows from the photographic image, by adjusting pixel values of the shadowless background region and/or the shadow region.

19. An image processing apparatus for detecting shadows of a main subject, from a photographic image in which the shadows are present within a background having a simple pattern, comprising:

shadowless background region extracting means for extracting a shadowless background region, in which the shadows are not present, from the photographic image; and

shadow region extracting means for extracting a shadow region, from regions within the photographic image other than the shadowless background region.

20. An image processing apparatus for detecting shadows of a main subject, from a photographic image in which the shadows are present within a background having a simple pattern, comprising:

background region extracting means for extracting a background region, in which the shadows are present, from the photographic image; and

shadow region extracting means for separating the extracted background region with shadows therein into a shadowless background region without shadows therein and a shadow region, in which the shadows are present.

21. A computer readable recording medium, in which a program that causes a computer to execute image processing for removing shadows of a main subject, from a photographic image in which the shadows are present within a background having a simple pattern, the program comprising the procedures of:

extracting a shadowless background region, in which the shadows are not present, from the photographic image;

extracting a shadow region, from regions within the photographic image other than the shadowless background region; and

removing the shadows from the photographic image, by adjusting pixel values of the shadowless background region and/or the shadow region.

22. A computer readable recording medium as defined in claim 21, wherein:

the procedure for extracting the shadow region extracts the shadow region from regions adjacent to the shadowless background region.

23. A computer readable recording medium, in which a program that causes a computer to execute image processing for removing shadows of a main subject, from a photographic image in which the shadows are present within a background having a simple pattern, the program comprising the procedures of:

extracting a background region, in which the shadows are present, from the photographic image;

separating the extracted background region with shadows therein into a background without shadows therein and a shadow region, in which the shadows are present; and

removing the shadows from the photographic image, by adjusting pixel values of the shadowless background region and/or the shadow region.