METHOD AND APPARATUS FOR FACE TRACKING UTILIZING INTEGRAL GRADIENT PROJECTIONS

• US 20130004025A1
• Filed: 06/12/2012
• Published: 01/03/2013
• Est. Priority Date: 06/30/2011
• Status: Active Grant

• Current Assignee: WSOU Investments, LLC (WSOU Holdings, LLC)
• Original Assignee: Nokia Corporation
• Inventors: MUNINDER, Veldandi
• Granted Patent: US 8,873,811 B2
• Time in Patent Office: Days
• US Class Current: 382/107
• CPC Class Codes: G06T 2207/20068 Projection on vertical or horizontal image axis
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 10/507 Summing image-intensity values; Histogram projection analysis
• CPC Class Codes: G06V 40/167 using comparisons between temporally consecutive images

Abstract

A method, apparatus and computer program product are provided for estimating and verifying translation motion and/or a scaling factor between face regions in respective frames during face tracking. A method determines translation motion between face regions in two successive frames based upon integral gradient projections of a face region in a first frame and a corresponding window in a second frame. The method also verifies the translation motion between the first and second frames utilizing integral gradient projections. A method also determines a transfer function relating integral projection curves of a face region in a first frame that has a predefined position and a predetermined size and a co-located window of same size in a second frame, determines a scaling factor based upon the transfer function and then verifies the scaling factor utilizing integral gradient projections.

Claims

1. A method comprising:

determining a transfer function relating integral projection curves of a face region in a first frame that has a predefined position and a predetermined size and a co-located window in a second frame;

determining a scaling factor based upon the transfer function;

determining integral gradient projections for the window in the second frame with the window having a size that is based upon the scaling factor and utilized for verification of the scaling factor;

determining a distance between the integral gradient projections of the face region in the first frame and the window in the second frame that has a size that is based upon the scaling factor; and

determining whether the scaling factor is verified based on a relationship between the distance and a predefined threshold.

2. A method according to claim 1 wherein determining the transfer function comprises determining a transfer function line that provides a minimum point-to-point distance between the integral projection curves.

3. A method according to claim 1 wherein determining the scaling factor comprises determining the scaling factor based upon scaling factors in first and second mutually orthogonal directions.

4. A method according to claim 1 further comprising performing a face search using a pattern recognition based face classifier in an instance in which the scaling factor is not verified in that the distance fails to satisfy the predefined threshold.

5. A method according to claim 1 further comprising redefining the predetermined size for other frames based upon the scaling factor in an instance in which the scaling factor is verified.

6. An apparatus comprising:

at least one processor; and

at least one memory including computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following;

determine a transfer function relating integral projection curves of a face region in a first frame that has a predefined position and a predetermined size and a co-located window in a second frame;

determine a scaling factor based upon the transfer function;

determine integral gradient projections for the window in the second frame with the window having a size that is based upon the scaling factor and utilized for verification of the scaling factor;

determine a distance between the integral gradient projections of the face region in the first frame and the window in the second frame that has a size that is based upon the scaling factor; and

determine whether the scaling factor is verified based on a relationship between the distance and a predefined threshold.

7. An apparatus according to claim 6 wherein the at least one memory including the computer program code is configured to, with the at least one processor, cause the apparatus to determine the transfer function based on a transfer function line that provides a minimum point-to-point distance between the integral projection curves.

8. An apparatus according to claim 6 wherein the at least one memory including the computer program code is configured to, with the at least one processor, cause the apparatus to determine the scaling factor based upon scaling factors in first and second mutually orthogonal directions.

9. An apparatus according to claim 6 wherein the at least one memory including the computer program code is further configured to, with the at least one processor, cause the apparatus to perform a face search by using a pattern recognition based face classifier in an instance in which the scaling factor is not verified in that the distance fails to satisfy the predefined threshold.

10. An apparatus according to claim 6 wherein the at least one memory including the computer program code is further configured to, with the at least one processor, cause the apparatus to redefine the predetermined size for other frames based upon the scaling factor in an instance in which the scaling factor is verified.

11. A computer program product comprising at least one tangible computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

program code instructions configured to determine a transfer function relating integral projection curves of a face region in a first frame that has a predefined position and a predetermined size and a co-located window in a second frame;

program code instructions configured to determine a scaling factor based upon the transfer function;

program code instructions configured to determine integral gradient projections for the window in the second frame with the window having a size that is based upon the scaling factor and utilized for verification of the scaling factor;

program code instructions configured to determine a distance between the integral gradient projections of the face region in the first frame and the window in the second frame that has a size that is based upon the scaling factor; and

program code instructions configured to determine whether the scaling factor is verified based on a relationship between the distance and a predefined threshold.

12. A computer program product according to claim 11 wherein the program code instructions configured to determine the transfer function comprise program code instructions configured to determine a transfer function line that provides a minimum point-to-point distance between the integral projection curves.

13. A computer program product according to claim 11 wherein the program code instructions configured to determine the scaling factor comprise program code instructions configured to determine the scaling factor based upon scaling factors in first and second mutually orthogonal directions.

14. A computer program product according to claim 11 wherein the computer-readable program code portions further comprise program code instructions configured to perform a face search using a pattern recognition based face classifier in an instance in which the scaling factor is not verified in that the distance fails to satisfy the predefined threshold.

15. A computer program product according to claim 11 wherein the computer-readable program code portions further comprise program code instructions configured to redefine the predetermined size for other frames based upon the scaling factor in an instance in which the scaling factor is verified.

16. An apparatus comprising:

at least one processor; and

at least one memory including computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following;

determine a translation motion between first and second frames based upon respective integral projections of a face region in the first frame that has a predefined position and a predetermined size and a co-located window in the second frame; and

verify the translation motion between the first and second frames, wherein the at least one memory including the computer program code is configured to, with the at least one processor, cause the apparatus to verify the translation motion by;

determining integral gradient projections for the window in the second frame following movement of the window by the translation motion between the first and second frames;

determining integral gradient projections for a face region in the first frame;

determining a distance between the integral gradient projections of the window, following movement by the translation motion, and the face region; and

determining whether the translation motion is verified based on a relationship between the distance and a predefined threshold.

17. An apparatus according to claim 16 wherein the at least one memory including the computer program code is further configured to, with the at least one processor, cause the apparatus to:

determine the integral projections of the face region in the first frame in first and second mutually orthogonal directions; and

determine the integral projections for the window in the second frame in first and second mutually orthogonal directions.

18. An apparatus according to claim 16 wherein, to determine the translation motion, the at least one memory including the computer program code is configured to, with the at least one processor, cause the apparatus to:

shift respective integral projection curves of the first and second frames; and

determine an amount of shift that creates a minimum distance between the respective integral projection curves of the first and second frames.

19. An apparatus according to claim 16 wherein, to determine integral gradient projections for the window in the second frame following movement of the window by the translation motion, the at least one memory including the computer program code is configured to, with the at least one processor, cause the apparatus to determine integral gradient projections for the window in the second frame in first and second mutually orthogonal directions, and wherein the at least one memory including the computer program code is configured to, with the at least one processor, cause the apparatus to determine integral gradient projections for the face region in the first frame by determining integral gradient projections for the face region in the first frame in the first and second mutually orthogonal directions.

20. An apparatus according to claim 16 wherein the at least one memory including the computer program code is further configured to, with the at least one processor, cause the apparatus to redefine the predefined position for other frames based upon the translation motion in an instance in which the translation motion is verified.

21. An apparatus according to claim 16 wherein the at least one memory including the computer program code is further configured to, with the at least one processor, cause the apparatus to evaluate a scaling factor between the face region of the first frame and the window of the second frame in an instance in which the translation motion is not verified in that the distance fails to satisfy predefined threshold.