Image editing apparatus, method for controlling image editing apparatus, and recording medium storing image editing program
First Claim
1. An image editing apparatus comprising:
- an image input unit including an image pickup circuit which takes a picture of a subject to obtain an image of a subject;
a face detection circuit which detects an image of a face of the subject from the image obtained from the image input unit;
a face expression detection circuit which detects a value indicating an extent of a smiling face of the subject as a face expression of the subject, based, at least in part, on (1) the image of the face detected by the face detection circuit, and (2) a sum of a normalized value of a whites of eyes area in the image of the face and a normalized value of a lips area in the image of the face;
a pupil detection circuit which detects images of pupils of the subject, based on the image of the face detected by the face detection circuit; and
a catch-light composition circuit which composes different catch-lights on the images of the pupils detected by the pupil detection circuit, according to any one of the direction and expression of the face detected by the face expression detection circuit, wherein the face expression detection circuit further determines if both (1) teeth are visible in the image of the face and (2) an end of mouth is shaded in the image of the face, and responsive to a determination that both (1) the teeth are visible and (2) the end of the mouth is shaded, increments the value by a predetermined amount, and otherwise, responsive to a determination that (1) the teeth are not visible or (2) the end of the mouth is not shaded, decrements the value by the predetermined amount.
3 Assignments
0 Petitions
Accused Products
Abstract
An image editing apparatus includes an image input unit including an image pickup circuit which takes a picture of a subject to obtain an image of a subject. A face detection circuit detects an image of a face of the subject from the image obtained from the image input unit. A face expression detection circuit detects at least any one of direction and expression of the face of the subject, based on the image of the face detected by the face detection circuit. A pupil detection circuit detects images of pupils of the subject, based on the image of the face detected by the face detection circuit. A catch-light composition circuit composes different catch-lights on the images of the pupils detected by the pupil detection circuit, according to any one of the direction and expression of the face detected by the face expression detection circuit.
15 Citations
25 Claims
-
1. An image editing apparatus comprising:
-
an image input unit including an image pickup circuit which takes a picture of a subject to obtain an image of a subject; a face detection circuit which detects an image of a face of the subject from the image obtained from the image input unit; a face expression detection circuit which detects a value indicating an extent of a smiling face of the subject as a face expression of the subject, based, at least in part, on (1) the image of the face detected by the face detection circuit, and (2) a sum of a normalized value of a whites of eyes area in the image of the face and a normalized value of a lips area in the image of the face; a pupil detection circuit which detects images of pupils of the subject, based on the image of the face detected by the face detection circuit; and a catch-light composition circuit which composes different catch-lights on the images of the pupils detected by the pupil detection circuit, according to any one of the direction and expression of the face detected by the face expression detection circuit, wherein the face expression detection circuit further determines if both (1) teeth are visible in the image of the face and (2) an end of mouth is shaded in the image of the face, and responsive to a determination that both (1) the teeth are visible and (2) the end of the mouth is shaded, increments the value by a predetermined amount, and otherwise, responsive to a determination that (1) the teeth are not visible or (2) the end of the mouth is not shaded, decrements the value by the predetermined amount. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method of controlling an apparatus for editing an image obtained by taking a picture of a subject, comprising:
-
detecting an image of a face of the subject from the obtained image; detecting a value indicating an extent of a smiling face of the subject as a face expression of the subject, based, at least in part, on (1) the detected image of the face, and (2) a sum cf a normalized value of a whites of eyes area in the image of the face and a normalized value of a lips area in the image of the face; detecting images of the pupils of the subject, based on the detected image of the face; composing different catch-lights on the detected images of the pupils, according to any one of the detected direction and expression of the face; determining if both (1) teeth are visible in the image of the face and (2) an end of mouth is shaded in the image of the face; and responsive to a determination that both (1) the teeth are visible and (2) the end of the mouth is shaded, incrementing the value by a predetermined amount, and otherwise, responsive to a determination that (1) the teeth are not visible or (2) the end of the mouth is not shaded, decrementing the value by the predetermined amount. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A method of controlling an apparatus for editing an image obtained by taking a picture of a subject, comprising:
-
detecting an image of a face of the subject from the obtained image; detecting a value indicating an extent of a smiling face of the subject as a face expression of the subject, based, at least in part, on (1) the detected image of the face, and (2) a sum of a normalized value of a whites of eyes area in the image of the face and a normalized value of a lips area in the image of the face; detecting a direction of the eyes of the subject, based on the detected image of the face; detecting images of the pupils of the subject, based on the detected image of the face; composing catch-lights on the detected images of the pupils, according to any one of the detected direction and expression of the face, and the direction of the eyes; determining if both (1) teeth are visible in the image of the face and (2) an end of mouth is shaded in the image of the face; and responsive to a determination that both (1) the teeth are visible and (2) the end of the mouth is shaded, incrementing the value by a predetermined amount, and otherwise, responsive to a determination that (1) the teeth are not visible or (2) the end of the mouth is not shaded, decrementing the value by the predetermined amount. - View Dependent Claims (17)
-
-
18. A non-transitory computer readable recording medium recording a program for editing an image obtained by taking a picture of a subject, the program enabling the computer to perform the following:
-
a function of detecting a value indicating an extent of a smiling face of the subject as a face expression face of the subject, based, at least in part, on (1) the image of the face detected by the face detection circuit, and (2) a sum of a normalized value of a whites of eyes area in the image of the face and a normalized value of a lips area in the image of the face; a function of detecting images of the pupils of the subject, based on the detected image of the face; and a function of composing different catch-lights on the detected images of the pupils, according to any one of the detected direction and expression of the face, wherein the function of detecting a value further determines if both (1) teeth are visible in the image of the face and (2) an end of mouth is shaded in the image of the face, and responsive to a determination that both (1) the teeth are visible and (2) the end of the mouth is shaded, increments the value by a predetermined amount, and otherwise, responsive to a determination that (1) the teeth are not visible or (2) the end of the mouth is not shaded, decrements the value by the predetermined amount. - View Dependent Claims (19, 20, 21)
-
-
22. An image editing apparatus comprising:
-
an image input unit including an image pickup circuit which takes a picture of a subject to obtain an image of a subject; a face expression detection circuit which detects an image of a face of the subject from the image obtained from the image input unit;
detects a value indicating the extent of a smiling face of the subject as a face expression of the subject, based, at least in part, on (1) the image of the face detected by the face detection circuit, and (2) a sum of a normalized value of a whites of eyes area in the image of the face and a normalized value of a lips area in the image of the face; and
detects images of the pupils of the subject, based on the detected image of the face; anda catch-light composition circuit which composes different catch-lights on the detected images of the pupils, according to any one of the direction and expression of the detected face, wherein the face expression detection circuit further determines if both (1) teeth are visible in the image of the face and (2) an end of mouth is shaded in the image of the face, and responsive to a determination that both (1) the teeth are visible and (2) the end of the mouth is shaded, increments the value by a predetermined amount, and otherwise, responsive to a determination that (1) the teeth are not visible, or (2) the end of the mouth is not shaded, decrements the value by the predetermined amount. - View Dependent Claims (23, 24, 25)
-
Specification