Automatic face and skin beautification using face detection
First Claim
Patent Images
1. A method of enhancing an appearance of a face within a digital image, comprisingusing a processor;
- generating in-camera, capturing or otherwise obtaining in-camera a collection of one or more reference images including a face;
identifying the face within the one or more reference images;
segmenting skin tone portions of the face including a forehead, one or two cheeks or a chin, or combinations thereof, from face features including one or two eyes or a mouth or combinations thereof;
within the skin tone portions of the face;
identifying one or more blemish regions that vary in luminance at least a threshold amount from the skin tone portions;
acquiring a main image of a same or higher resolution than the one or more reference images, including capturing the main image using a lens and an image sensor, or receiving said main image following capture by a device that includes a lens and an image sensor, or a combination thereof;
applying one or more localized luminance smoothing kernels each to one of the skin tone portions identified within the face to produce one or more enhanced skin tone portions of the face, wherein the applying comprises applying the one or more localized luminance smoothing kernels to luminance data of the one or more skin tone portions identified within said face;
smoothing certain original color data of one or more regions of the main image that correspond to the same one or more blemish regions identified in the reference images to generate smoothed color data for those one or more blemish regions of the main image;
generating an enhanced version of the main image including an enhanced version of the face that has the luminance data of the one or more skin tone portions replaced with the enhanced skin tone portions of the face, and that also has the certain original color data of the one or more blemish regions replaced with the smoothed color data; and
displaying, transmitting, communicating or digitally storing or otherwise outputting the enhanced image or a further processed version, or combinations thereof.
5 Assignments
0 Petitions
Accused Products
Abstract
Sub-regions within a face image are identified to be enhanced by applying a localized smoothing kernel to luminance data corresponding to the sub-regions of the face image. An enhanced face image is generated including an enhanced version of the face that includes certain original pixels in combination with pixels corresponding to the one or more enhanced sub-regions of the face.
-
Citations
27 Claims
-
1. A method of enhancing an appearance of a face within a digital image, comprising
using a processor; -
generating in-camera, capturing or otherwise obtaining in-camera a collection of one or more reference images including a face; identifying the face within the one or more reference images; segmenting skin tone portions of the face including a forehead, one or two cheeks or a chin, or combinations thereof, from face features including one or two eyes or a mouth or combinations thereof;
within the skin tone portions of the face;identifying one or more blemish regions that vary in luminance at least a threshold amount from the skin tone portions; acquiring a main image of a same or higher resolution than the one or more reference images, including capturing the main image using a lens and an image sensor, or receiving said main image following capture by a device that includes a lens and an image sensor, or a combination thereof; applying one or more localized luminance smoothing kernels each to one of the skin tone portions identified within the face to produce one or more enhanced skin tone portions of the face, wherein the applying comprises applying the one or more localized luminance smoothing kernels to luminance data of the one or more skin tone portions identified within said face; smoothing certain original color data of one or more regions of the main image that correspond to the same one or more blemish regions identified in the reference images to generate smoothed color data for those one or more blemish regions of the main image; generating an enhanced version of the main image including an enhanced version of the face that has the luminance data of the one or more skin tone portions replaced with the enhanced skin tone portions of the face, and that also has the certain original color data of the one or more blemish regions replaced with the smoothed color data; and displaying, transmitting, communicating or digitally storing or otherwise outputting the enhanced image or a further processed version, or combinations thereof. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A digital image acquisition device, comprising
a lens, an image sensor and a processor, and a processor-readable memory having embodied therein processor-readable code for programming the processor to perform a method of enhancing an appearance of a face within a digital image, wherein the method comprises: -
generating in-camera, capturing or otherwise obtaining in-camera a collection of one or more reference images including a face; identifying the face within the one or more reference images; segmenting skin tone portions of the face including a forehead, one or two cheeks or a chin, or combinations thereof, from face features including one or two eyes or a mouth or combinations thereof; within the skin tone portions of the face, identifying one or more blemish regions that vary in luminance at least a threshold amount from the skin tone portions; acquiring a main image of higher resolution than the one or more reference images, including capturing the main image using a lens and an image sensor, or receiving said main image following capture by a device that includes a lens and an image sensor, or a combination thereof; applying one or more localized luminance smoothing kernels each to one of the skin tone portions identified within the face to produce one or more enhanced skin tone portions of the face, wherein the applying comprises applying the one or more localized luminance smoothing kernels only to luminance data of the one or more skin tone portions identified within said face; smoothing certain original color data of one or more regions of the main image that correspond to the same one or more blemish regions identified in the reference images to generate smoothed color data for those one or more blemish regions of the main image; generating an enhanced version of the main image including an enhanced version of the face that has the luminance data of the one or more skin tone portions replaced with the enhanced skin tone portions of the face, and that also has the certain original color data of the one or more blemish regions replaced with the smoothed color data; and displaying, transmitting, communicating or digitally storing or otherwise outputting the enhanced image or a further processed version, or combinations thereof. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. One or more non-transitory processor-readable media having embodied therein code for programming one or more processors to perform a method of enhancing an appearance of a face within an acquired main image by utilizing a collection of one or more reference images that include the face, wherein the method comprises:
-
identifying the face within the one or more reference images; segmenting skin tone portions of the face including a forehead, one or two cheeks or a chin, or combinations thereof, from face features including one or two eyes or a mouth or combinations thereof; within the skin tone portions of the face, identifying one or more blemish regions that vary in luminance at least a threshold amount from the skin tone portions; applying one or more localized luminance smoothing kernels each to one of the skin tone portions identified within the face to produce one or more enhanced skin tone portions of the face, wherein the applying comprises applying the one or more localized luminance smoothing kernels to luminance data of the one or more skin tone portions identified within said face; smoothing certain original color data of one or more regions of the acquired main image that correspond to the same one or more blemish regions identified in the reference images to generate smoothed color data for those one or more blemish regions of the acquired main image; generating an enhanced version of the main image including an enhanced version of the face that has the luminance data of the one or more skin tone portions replaced with the enhanced skin tone portions of the face, and that also has the certain original color data of the one or more blemish regions replaced with the smoothed color data; and displaying, transmitting, communicating or digitally storing or otherwise outputting the enhanced image or a further processed version, or combinations thereof. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26, 27)
-
Specification