Red-eye detection/retouch apparatus

• US 5,990,973 A
• Filed: 05/28/1997
• Issued: 11/23/1999
• Est. Priority Date: 05/29/1996
• Status: Expired due to Term

• Current Assignee: Blackberry Limited
• Original Assignee: NEC Corporation
• Inventors: Sakamoto, Shizuo
• Primary Examiner(s): Peng, John K.
• Assistant Examiner(s): Lo, Linus H.
• Application Number:
  US08/864,431
• Time in Patent Office: 909 Days
• Field of Search: 348/576, 348/246, 382/162, 382/163, 382/167, 382/274, 382/275, 382/254, 382/255, 382/115, 382/117, 382/190, 382/195, 382/203, 396/18, 396/51
• US Class Current: 348/576
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction

Abstract

In a red-eye detection/retouch apparatus, a first area extraction unit receives an image including a red eye and a signal representing a small area including the red eye and designated by a user and extracts a first area including the red eye. A first pixel selection unit detects the reddest pixel from the first area and outputs coordinate values and color information of the pixel. A determination unit determines whether the other red eye is present on the basis of the signal representing the small area and the coordinate values of the reddest pixel. The determination unit outputs an instruction signal for extracting a second area where the other red eye is present upon determining that the other red eye is present. A second area extraction unit receives the instruction signal and extracts the second area from the first area. A second pixel selection unit detects the reddest pixel from the second area and outputs coordinate values and color information of the pixel. An area expansion unit receives the coordinate values and color information of the pixels and the first area, detects a red-eye area by area expansion, and outputs the red-eye area. An image synthesis unit receives the red-eye area and the image including the red eye and outputs an image whose red-eye area has been corrected to a natural pupil color.

Claims

1. A red-eye detection/retouch apparatus comprising:

first area extraction means for receiving an image including a red eye and a signal representing a small area including said red eye and designated by a user and extracting a first area including said red eye;

first pixel selection means for detecting the reddest pixel from said first area output from said first area extraction means and outputting coordinate values and color information of said detected pixel;

determination means for determining whether the other red eye is present on the basis of the signal representing said small area including said red eye and designated by the user and the coordinate values of said reddest pixel output from said first pixel selection means, said determination means outputting an instruction signal for extracting a second area where said other red eye is present upon determining that said other red eye is present;

second area extraction means for receiving the instruction signal output from said determination means and extracting said second area from said first area output from said first area extraction means;

second pixel selection means for detecting the reddest pixel from said second area output from said second area extraction means and outputting coordinate values and color information of said detected pixel;

area expansion means for receiving the coordinate values and color information output from said first pixel selection means, the coordinate values and color information output from said second pixel selection means, and said first area output from said first area extraction means, detecting a red-eye area by area expansion, and outputting said red-eye area; and

image synthesis means for receiving said red-eye area output from said area expansion means and the image including said red eye and outputting an image whose red-eye area has been corrected to a natural pupil color.

2. An apparatus according to claim 1, further comprising color conversion means for converting a color expression of said first area output from said first area extraction means into a color expression for easily detecting a red eye, and

wherein said area expansion means receives the coordinate values and color information output from said first pixel selection means, the coordinate values and color information output from said second pixel selection means, and a second area signal color-converted and output from said color conversion means, and detects said red-eye area by area expansion based on an iris shape.

3. An apparatus according to claim 2, wherein said first pixel selection means detects said reddest pixel from said first area color-converted and output from said color conversion means and outputs the coordinate values and color information of said detected pixel, and

said second area extraction means receives the instruction signal output from said determination means and extracts said second area from said first area color-converted and output from said color conversion means.

4. An apparatus according to claim 2, wherein said color conversion means converts an RGB color expression into an HSV color expression.

5. An apparatus according to claim 1, further comprising image input means for receiving an image signal including a red eye and outputting the image signal to said first area extraction means and said image synthesis means, and

coordinate input means for receiving said small area including said red eye and designated by the user and outputting said small area to said first area extraction means and said determination means.

6. A red-eye detection/retouch apparatus comprising:

first area extraction means for receiving an image including a red eye and a signal representing a small area including said red eye and designated by a user and extracting a first area including said red eye;

color conversion means for converting a color expression of said first area output from said first area extraction means into a color expression for easily detecting a red eye;

first pixel selection means for detecting the reddest pixel from said first area output from said color conversion means and outputting coordinate values and color information of said detected pixel;

determination means for determining whether the other red eye is present on the basis of the signal representing said small area including said red eye and designated by the user and the coordinate values of said reddest pixel output from said first pixel selection means, said determination means outputting an instruction signal for extracting a second area where said other red eye is present upon determining that said other red eye is present;

second area extraction means for receiving the instruction signal output from said determination means and extracting said second area from said first area color-converted and output from said color conversion means;

second pixel selection means for detecting the reddest pixel from said second area output from said second area extraction means and outputting coordinate values and color information of said detected pixel;

area expansion means for receiving the coordinate values and color information output from said first pixel selection means, the coordinate values and color information output from said second pixel selection means, and said first area color-converted and output from said color conversion means, detecting a red-eye area by area expansion, and outputting said red-eye area; and

image synthesis means for receiving said red-eye area output from said area expansion means and the image including said red eye and outputting an image whose red-eye area has been corrected to a natural pupil color.

7. A red-eye detection/retouch apparatus comprising:

first area extraction means for receiving an image including a red eye and a signal representing a small area including said red eye and designated by a user and extracting a first area including said red eye;

first threshold processing means for detecting at least one red area from said first area output from said first area extraction means by threshold processing and outputting a position, shape information, and color information of said detected area;

first selection means for selecting an area which is most likely to be a red eye on the basis of the position, shape information, and color information output from said first threshold processing means and outputting a position, shape information, and color information of said selected area;

determination means for determining whether the other red eye is present in said area on the basis of the signal representing said small area including said red eye and designated by the user and the position of said red-eye area output from said first selection means, said determination means outputting an instruction signal for extracting a second area where said other red eye is present upon determining that said other red eye is present;

second area extraction means for receiving the instruction signal output from said determination means and extracting said second area from said first area output from said first area extraction means;

second threshold processing means for detecting at least one red area from said second area output from said second area extraction means by thresh old processing and outputting a position, shape information, and color information of said detected area;

second select io n means for selecting an area which is most likely to beared eye on the basis of the position, shape information, and color information output from said second threshold processing means and outputting a position, shape information, and color information of said selected area; and

image synthesis means for receiving the positions, shape information, and color information output from said first and second selection means and the image including said red eye and outputting an image whose red-eye area has been corrected to a natural pupil color.

8. An apparatus according to claim 7, further comprising color conversion means for converting a color expression of said first area output from said first area extraction means into a color expression for easily detecting a red eye, and

wherein said second area extraction means receives the instruction signal output from said determination means and extracts said second area from said first area color-converted and output from said color conversion means.

9. An apparatus according to claim 8, wherein said color conversion means converts an RGB color expression into an HSV color expression.

10. An apparatus according to claim 7, further comprising image input means for receiving an image signal including a red eye and outputting the image signal to said first area extraction means and said image synthesis means, and

coordinate input means for receiving said small area including said red eye and designated by the user and outputting said small area to said first area extraction means and said determination means.