Method and system for finding correspondence between face camera views and behavior camera views
First Claim
1. A method for making a correspondence between a face camera track and a behavior camera track, comprising the following steps of:
- a) constructing a database of pairwise person images, where each pairwise person image comprises a person image from a face camera and a person image from a behavior camera,b) annotating the database of pairwise person images based on whether the pair of person images in each pairwise person image belongs to the same person,c) training at least a pairwise person verification machine to estimate appearance match scores between the pair of person images in the pairwise person images from the database,d) acquiring a person image from the face camera track and a person image from the behavior camera track to form a second pairwise person image, ande) estimating an appearance match score between the pair of person images in the second pairwise person image, using the pairwise person verification machines on the second pairwise person image to calculate correspondence between the face camera track and the behavior camera track.
17 Assignments
0 Petitions
Accused Products
Abstract
The present invention is a method and system to provide correspondences between a face camera track and a behavior camera track, for the purpose of making correspondence between the data obtained from each track. First, multiple learning machines are trained so that each of the machines processes pairwise person images from a specific pose region, and estimates the likelihood of two person images belonging to the same person based on image appearances. Then, the system acquires a person image associated with a behavior camera track, determines the pose of the person image based on its floor position, and corrects the pose of the person image. The system also acquires person images from face camera images associated with a face camera track, and combines the images with corrected person images from the previous step to form pairwise person images. The pairwise person image is fed to the trained pose-dependent pairwise person verification machines according to the pose of the person images, to compute the appearance match scores between the pair of person images. Finally, the combination of the appearance match scores and the spatiotemporal match scores of the pair of person images determines whether or not the person images belong to the same person.
84 Citations
20 Claims
-
1. A method for making a correspondence between a face camera track and a behavior camera track, comprising the following steps of:
-
a) constructing a database of pairwise person images, where each pairwise person image comprises a person image from a face camera and a person image from a behavior camera, b) annotating the database of pairwise person images based on whether the pair of person images in each pairwise person image belongs to the same person, c) training at least a pairwise person verification machine to estimate appearance match scores between the pair of person images in the pairwise person images from the database, d) acquiring a person image from the face camera track and a person image from the behavior camera track to form a second pairwise person image, and e) estimating an appearance match score between the pair of person images in the second pairwise person image, using the pairwise person verification machines on the second pairwise person image to calculate correspondence between the face camera track and the behavior camera track. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. An apparatus for making a correspondence between a face camera track and a behavior camera track, comprising:
-
a) means for constructing a database of pairwise person images, where each pairwise person image comprises a person image from a face camera and a person image from a behavior camera, b) means for annotating the database of pairwise person images based on whether the pair of person images in each pairwise person image belongs to the same person, c) means for training at least a pairwise person verification machine to estimate appearance match scores between the pair of person images in the pairwise person images from the database, d) means for acquiring a person image from the face camera track and a person image from the behavior camera track to form a second pairwise person image, and e) means for estimating an appearance match score between the pair of person images in the second pairwise person image, using the pairwise person verification machines on the second pairwise person image to calculate correspondence between the face camera track and the behavior camera track. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
Specification