Detecting facial expressions in digital images
First Claim
Patent Images
1. A method of in-camera processing of a still image including one or more faces as part of an acquisition process, comprising:
- identifying a group of pixels that correspond to a face within at least one digitally-acquired image on a portable camera;
acquiring a stream of images including the face;
performing the following steps in real time as the stream of images is acquired by the portable camera;
tracking said face within said stream of images;
for each interval of a plurality of intervals within the stream of images, performing;
determining a smile classification for the interval; and
based on the smile classification, updating a confidence parameter;
after updating the confidence parameter for each of the plurality of intervals, making a smiling decision based, at least in part, on the sign and absolute value of the confidence parameter;
wherein each interval of the plurality of intervals includes one or more imam from the stream of images;
initiating one or more smile state-dependent operations selected based upon results of the smiling decision.
5 Assignments
0 Petitions
Accused Products
Abstract
A method and system for detecting facial expressions in digital images and applications therefore are disclosed. Analysis of a digital image determines whether or not a smile and/or blink is present on a person'"'"'s face. Face recognition, and/or a pose or illumination condition determination, permits application of a specific, relatively small classifier cascade.
-
Citations
59 Claims
-
1. A method of in-camera processing of a still image including one or more faces as part of an acquisition process, comprising:
-
identifying a group of pixels that correspond to a face within at least one digitally-acquired image on a portable camera; acquiring a stream of images including the face; performing the following steps in real time as the stream of images is acquired by the portable camera; tracking said face within said stream of images; for each interval of a plurality of intervals within the stream of images, performing; determining a smile classification for the interval; and based on the smile classification, updating a confidence parameter; after updating the confidence parameter for each of the plurality of intervals, making a smiling decision based, at least in part, on the sign and absolute value of the confidence parameter; wherein each interval of the plurality of intervals includes one or more imam from the stream of images; initiating one or more smile state-dependent operations selected based upon results of the smiling decision. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 51, 52, 53)
-
-
11. A portable digital image acquisition device, including a lens and image sensor for acquiring digital images, a processor, and one or more processor-readable media have code embedded therein for programming the processor to perform a method of in-camera processing of a still image including one or more faces as part of an acquisition process, wherein the method comprises:
-
identifying a group of pixels that correspond to a face within at least one digitally-acquired image on a portable camera; acquiring a stream of images including the face; performing the following steps in real time as the stream of images is acquired by the portable camera; tracking said face within said stream of images; for each interval of a plurality of intervals within the stream of images, performing; determining a smile classification for the interval; and based on the smile classification, updating a confidence parameter; after updating the confidence parameter for each of the plurality of intervals, making a smiling decision based, at least in part, on the sign and absolute value of the confidence parameter; wherein each interval of the plurality of intervals includes one or more imam from the stream of images; initiating one or more smile state-dependent operations selected based upon results of the smiling decision. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 54, 55, 56)
-
-
29. One or more non-transitory processor-readable media having code embedded therein for programming a processor to perform a method of in-camera processing of a still image including one or more faces as part of an acquisition process, wherein the method comprises:
-
identifying a group of pixels that correspond to a face within at least one digitally-acquired image on a portable camera; acquiring a stream of images including the face; performing the following steps in real time as the stream of images is acquired by the portable camera; tracking said face within said stream of images; for each interval of a plurality of intervals within the stream of images, performing; determining a smile classification for the interval; and based on the smile classification, updating a confidence parameter; after updating the confidence parameter for each of the plurality of intervals, making a smiling decision based, at least in part, on the sign and absolute value of the confidence parameter; wherein each interval of the plurality of intervals includes one or more imam from the stream of images; initiating one or more smile state-dependent operations selected based upon results of the smiling decision. - View Dependent Claims (30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 57, 58, 59)
-
Specification