Automatic white balance with facial color features as reference color surfaces
First Claim
Patent Images
1. A method of automatic white balance of image and video media in an electronic media device, comprising:
- acquiring one or a plurality of digital images of scenes including a face of a user or users of the device, including;
capturing a digital image or images of a user or users using a lens and image sensor, receiving a digital image or images of a user or users after capturing using a lens and image sensor, or a combination of the capturing and receiving steps;
acquiring a facial color features set of the user or users including intrinsic values and target values of the color profiles of a skin tone portion, eye ball white and teeth by a color profile extraction process;
acquiring a digital image;
conducting face detection, segmentation and recognition on the digital image, wherein if a recognized face is the face of a user matching a user entry in the facial color features set;
conducting illuminant estimation based on segmented facial features and the acquired facial color features set resulting in C2, based on parts of the image other than the segmented facial parts features, resulting in C1, and determining a final estimation, C3, based on C1 and C2; and
conducting automatic white balance gain adjustment and color enhancement based on C1, C2, C3, and the acquired facial color features set of the user or users.
4 Assignments
0 Petitions
Accused Products
Abstract
An automatic white balance method and an electronic media device incorporating the method deploy characterized individual human facial color features set of a user or users of the device as reference color surfaces in automatic white balance illuminant estimation and color adjustments, which could improve illuminant estimation accuracy, provide flexible color adjustment options and render the image color to each user'"'"'s own satisfaction taking into account user preferred rendition as target values through a human-machine interactive interface.
-
Citations
23 Claims
-
1. A method of automatic white balance of image and video media in an electronic media device, comprising:
-
acquiring one or a plurality of digital images of scenes including a face of a user or users of the device, including;
capturing a digital image or images of a user or users using a lens and image sensor, receiving a digital image or images of a user or users after capturing using a lens and image sensor, or a combination of the capturing and receiving steps;acquiring a facial color features set of the user or users including intrinsic values and target values of the color profiles of a skin tone portion, eye ball white and teeth by a color profile extraction process; acquiring a digital image; conducting face detection, segmentation and recognition on the digital image, wherein if a recognized face is the face of a user matching a user entry in the facial color features set;
conducting illuminant estimation based on segmented facial features and the acquired facial color features set resulting in C2, based on parts of the image other than the segmented facial parts features, resulting in C1, and determining a final estimation, C3, based on C1 and C2; andconducting automatic white balance gain adjustment and color enhancement based on C1, C2, C3, and the acquired facial color features set of the user or users. - View Dependent Claims (2, 3, 4, 5, 6, 7, 9, 18)
-
-
8. An electronic media device comprises:
- one or more cameras with at least one camera working in a front-side operational mode;
one or more processors with one working as a system controller controlling system operation of the electronic media device;
non-transitory memory storage media containing instructions readable by the one or more processors;
memory storage media module accessible by the one or more processors to store data and execute the controlling instructions;
an apparatus with mechanisms to receive, store or output images, videos and other data;
a display device being able to display images, videos and graphics content;
a user controllable interactive interface to the electronic media device that takes in the user control input so that the system controller understands and properly responds to the user intention;
an automatic white balance control apparatus in the camera working in the front-side operational mode incorporating an automatic white balance method comprising the steps of;acquiring one or a plurality of digital images of scenes including a face of a user or users of the device, including;
capturing a digital image or images of a user or users using a lens and image sensor, receiving a digital image or images of a user or users after capturing using a lens and image sensor, or a combination of the capturing and receiving steps;acquiring a facial color features set of the user or users including intrinsic values and target values of the color profiles of a skin tone portion, eye ball white and teeth by a color profile extraction process; acquiring a digital image; conducting face detection, segmentation and recognition on the digital image, wherein if a recognized face is the face of a user matching a user entry in the facial color features set, conducting illuminant estimation based on segmented facial features and the acquired facial color features set resulting in C2, based on parts of the image other than the segmented facial parts features, resulting in C1, and determining a final estimation, C3, based on C1 and C2; and conducting automatic white balance gain adjustment and color enhancement based on C1, C2, C3, and the acquired facial color features set of the user or users. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 23)
- one or more cameras with at least one camera working in a front-side operational mode;
-
17. One or more non-transitory program storage devices, containing instructions readable by one or more processors for causing the one or more processors to perform a method of automatic white balance, comprising the steps of:
-
acquiring one or a plurality of digital images of scenes including a face of a user or users of the device, including;
capturing a digital image or images of a user or users using a lens and image sensor, receiving a digital image or images of a user or users after capturing using a lens and image sensor, or a combination of the capturing and receiving steps;acquiring a facial color features set of the user or users including intrinsic values and target values of the color profiles of a skin tone portion, eye ball white and teeth by a color profile extraction process; acquiring a digital image; conducting face detection, segmentation and recognition on the digital image, wherein if a recognized face is the face of a user matching a user entry in the facial color features set, conducting illuminant estimation based on segmented facial features and the acquired facial color features set resulting in C2, based on parts of the image other than the segmented facial parts features, resulting in C1, and determining a final estimation, C3, based on C1 and C2; and conducting automatic white balance gain adjustment and color enhancement based on C1, C2, C3, and the acquired facial color features set of the user or users. - View Dependent Claims (19, 20, 21, 22)
-
Specification