Method of tracking the position of the head in real time in a video image stream

• US 8,571,258 B2
• Filed: 01/31/2007
• Issued: 10/29/2013
• Est. Priority Date: 02/07/2006
• Status: Expired due to Fees

• Current Assignee: Orange S.A.
• Original Assignee: Orange S.A.
• Inventors: Faure, Julien, Pallone, Grgory
• Primary Examiner(s): Akhavannik, Hadi
• Assistant Examiner(s): RASHIDIAN, MOHAMMAD M
• Application Number:
  US12/223,536
• Publication Number:
  US 20090129631A1
• Time in Patent Office: 2,463 Days
• Field of Search: 382/100, 382/103, 382/107, 382/115, 382/118, 382/159, 382/168, 382/173, 382/181, 382/190, 382/194, 382/199, 382/203, 382/209, 382/291, 382/104, 342/52, 342/90, 342/176, 345/158, 348152-155, 348169-172, 348/239, 463 36- 39, 702/104, 702/127, 702/150, 702/153, 702/182
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 40/167 using comparisons between temporally consecutive images

Abstract

The invention relates to a method of tracking the position of the bust of a user on the basis of a video image stream, said bus comprising the user'"'"'s torso and head, the method comprising the determination of the position of the torso on a first image, in which method a virtual reference frame is associated with the torso on said first image, and in which method, for a second image, a new position of the virtual reference frame is determined on said second image, and, a relative position of the head with respect to said new position of the virtual reference frame is measured by comparison with the position of the virtual reference frame on said first image, so as to determine independently the movements of the head and the torso.

Claims

1. A method of tracking the position of the upper body of a user from a video image stream, said upper body comprising the torso and the head of the user, said head comprising the face of the user, the method comprising a determination of the position of the torso in a first image, wherein:

a virtual reference frame is associated with the torso in said first image, wherein in order to associate a virtual reference frame with the first image, the position of the face of the user is determined in said first image, and from this the position of the torso in said first image is deduced;

and, for a second image;

a new position of the torso is determined in said second image;

a new position of the virtual reference frame is determined in said second image; and

a relative position of the head relative to said new position of the virtual reference frame is measured by comparison with the position of the virtual reference frame in said first image, wherein the relative position of the head is characterized by a rotation and a translation of the head between the first and the second images and wherein the translation of the head is defined to be identical to the translation of the torso;

wherein the head of the user comprises the face of the user and at least one position of the face is measured relative to the new position of the reference frame in the second image in order to deduce from this the relative position of the head and wherein the relative position of the head is measured from a comparison between the positions of the torso and of the face in the first image, and the new positions of the torso and of the face in said second image.

2. The method as claimed in claim 1, wherein the position of the torso is determined vertically from the position of the face.

3. The method as claimed in claim 1, wherein the head includes the neck, and wherein the relative position of the head is characterized by:

an elevation corresponding to the rotation of the head between the first and the second image, measured in the plane of symmetry of said head;

an azimuth corresponding to the rotation of the head between the first and the second image, measured about an axis defined by the neck of the user; and

a translation of the head between the first and the second image.

4. The method as claimed in claim 3, wherein the relative position of the head is given by the expressions:

5. The method as claimed in claim 4, wherein the coordinates representing the position of the face and of the torso in the first image are the coordinates of the center of gravity of a first cluster of points defined on the face and the coordinates of the center of gravity of a second cluster of points defined on the torso, the coordinates representing the position of the face and of the torso in the second image being the coordinates of the centers of gravity of the first and second clusters of points considered in their new position in said second image.

6. The method as claimed in claim 1, wherein the first image is a calibration image and the second image is a current image from the video image stream.

7. A system for tracking the position of the upper body of a user from a video image stream, the upper body comprising the head and the torso of the user, the system comprising:

a video-image capture system for generating at least one first image and a second image of the upper body of the user;

a memory; and

a processing unit connected with said video-image capture system, said processing unit making use of instructions available in said memory to implement the method according to claim 1.

8. A non-transitory computer program product designed to be executed in a memory of the processing unit of a computer system, the program comprising instructions for the implementation of the method according to claim 1 when it is executed in the processing unit.

9. A method of tracking the position of the upper body of a user from a video image stream, said upper body comprising the torso and the head of the user, the method comprising the steps of:

determining the position of the torso in a first image,

associating a virtual reference frame with the torso in said first image;

obtaining the new position of the torso in a second image,

determining a new position of the virtual reference frame in said second image,

measuring a relative position of the head relative to said new position of the virtual reference frame by comparison with the position of the virtual reference frame in said first image,

determining independently the movements of rotation and translation of the head,

wherein the translation of the head is defined to be identical to the translation of the torso, and wherein the translation of the torso is factored out;

wherein the head of the user comprises the face of the user and at least one position of the face is measured relative to the new position of the reference frame in the second image in order to deduce from this the relative position of the head and wherein the relative position of the head is measured from a comparison between the positions of the torso and of the face in the first image, and the new positions of the torso and of the face in said second image.