Interactive system for recognition analysis of multiple streams of video
First Claim
1. A method for maintaining associations between profiles and objects in an object recognition system, wherein a profile comprises a set of identifying information extracted from an image set associated with the profile, comprising the computer-implemented steps of:
- receiving a first image set;
generating a stored profile based on the first image set;
causing to be displayed, to a user, first data that identifies one or more objects that are automatically determined by the object recognition system to be possible matches to the stored profile;
wherein the one or more objects includes a particular object that is associated with a particular stored profile;
after the first data is displayed to the user, receiving, from the user, feedback that indicates that the particular object does not match the stored profile;
in response to receiving the feedback from the user, updating a running score that is (a) maintained for the particular stored profile and (b) based on how often the object recognition system identified the particular object as a possible match but a user indicated the particular object was not a match;
receiving a second image set;
generating a second stored profile based on the second image set;
determining a confidence score in a subsequent possible match that involves the particular stored profile and the second stored profile;
weighting the confidence score based, at least in part, on the running score;
causing to be displayed, to a user, second data that identifies one or more second objects that are automatically determined by the object recognition system to be possible matches to the second stored profile, wherein the object recognition system determines whether to include the particular object in the one or more second objects based on the weighted confidence score;
wherein the method is performed by one or more computing devices.
4 Assignments
0 Petitions
Accused Products
Abstract
A method of identifying an object captured in a video image in a multi-camera video surveillance system is disclosed. Sets of identifying information are stored in profiles, each profile being associated with one object. The disclosed method of identifying an object includes comparing identifying information extracted from images captured by the video surveillance system to one or more stored profiles. A confidence score is calculated for each comparison and used to determine a best match between the extracted set of identifying information and an object. In one embodiment, the method is used as part of a facial recognition system incorporated into a video surveillance system.
-
Citations
34 Claims
-
1. A method for maintaining associations between profiles and objects in an object recognition system, wherein a profile comprises a set of identifying information extracted from an image set associated with the profile, comprising the computer-implemented steps of:
-
receiving a first image set; generating a stored profile based on the first image set; causing to be displayed, to a user, first data that identifies one or more objects that are automatically determined by the object recognition system to be possible matches to the stored profile; wherein the one or more objects includes a particular object that is associated with a particular stored profile; after the first data is displayed to the user, receiving, from the user, feedback that indicates that the particular object does not match the stored profile; in response to receiving the feedback from the user, updating a running score that is (a) maintained for the particular stored profile and (b) based on how often the object recognition system identified the particular object as a possible match but a user indicated the particular object was not a match; receiving a second image set; generating a second stored profile based on the second image set; determining a confidence score in a subsequent possible match that involves the particular stored profile and the second stored profile; weighting the confidence score based, at least in part, on the running score; causing to be displayed, to a user, second data that identifies one or more second objects that are automatically determined by the object recognition system to be possible matches to the second stored profile, wherein the object recognition system determines whether to include the particular object in the one or more second objects based on the weighted confidence score; wherein the method is performed by one or more computing devices. - View Dependent Claims (2, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
3. A method for maintaining associations between profiles and objects in an object recognition system, wherein a profile comprises a set of identifying information extracted from an image set associated with the profile, comprising the computer-implemented steps of:
-
receiving a particular image set; generating a stored profile based on the particular image set; causing to be displayed, to a user, a list of identities of one or more objects that are automatically determined to be possible matches to the stored profile; receiving, from the user, feedback that indicates that a particular object of the one or more objects is not a possible match; in response to receiving the feedback, updating a possible match score that is (a) associated with a particular stored profile of the particular object and (b) based on how often the object recognition system identified the particular stored profile as a possible match but a user indicated the particular stored profile as not a possible match; determining a confidence score in a subsequent possible match that involves the particular stored profile; weighting the confidence score based, at least in part, on the possible match score; receiving a first image set; generating a first stored profile based on the first image set; receiving a second image set; generating a second stored profile based on the second image set; comparing the second stored profile with the first stored profile to generate a second confidence score; determining whether the second confidence score satisfies one or more criteria; in response to determining that the second confidence score satisfies the one or more criteria, causing to be displayed, to a second user, a second list of identities of one or more second objects that includes a first object and the second image set that is associated with the second stored profile; receiving, from the second user, feedback that indicates that the first stored profile and the second stored profile are profiles of the same object; and storing confirmation information that indicates that the second stored profile is of the first object; wherein the method is performed by one or more computing devices.
-
-
18. One or more non-transitory computer-readable media storing instructions for maintaining associations between profiles and objects in an object recognition system, wherein a profile comprises a set of identifying information extracted from an image set associated with the profile, wherein the instructions, when executed by one or more processors, cause:
-
receiving a first image set; generating a stored profile based on the first image set; wherein the one or more objects includes a particular object that is associated with a particular stored profile; causing to be displayed, to a user, first data that identifies one or more objects that are automatically determined by the object recognition system to be possible matches to the stored profile; after the first data is displayed to the user, receiving, from the user, feedback that indicates that the particular object does not match the stored profile; in response to receiving the feedback from the user, updating a running score that is (a) maintained for the particular stored profile and (b) based on how often the object recognition system identified the particular object as a possible match but a user indicated the particular object was not a match; receiving a second image set; generating a second stored profile based on the second image set; determining a confidence score in a subsequent possible match that involves the particular stored profile; weighting the confidence score based, at least in part, on the possible match score; causing to be displayed, to a user, second data that identifies one or more second objects that are automatically determined by the object recognition system to be possible matches to the second stored profile, wherein the object recognition system determines whether to include the particular object in the one or more second objects based on the weighted confidence score. - View Dependent Claims (19, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34)
-
-
20. One or more non-transitory computer-readable media storing instructions for maintaining associations between profiles and objects in an object recognition system, wherein a profile comprises a set of identifying information extracted from an image set associated with the profile, wherein the instructions, when executed by one or more processors, cause:
-
receiving a particular image set; generating a stored profile based on the particular image set; causing to be displayed, to a user, a list of identities of one or more objects that are automatically determined to be possible matches to the stored profile; receiving, from the user, feedback that indicates that a particular object of the one or more objects is not a possible match; in response to receiving the feedback, updating a possible match score that is (a) associated with a particular stored profile of the particular object and (b) based on how often the object recognition system identified the particular stored profile as a possible match but a user indicated the particular stored profile as not a possible match; determining a confidence score in a subsequent possible match that involves the particular stored profile; weighting the confidence score based, at least in part, on the possible match score; receiving a first image set; generating a first stored profile based on the first image set; receiving a second image set; generating a second stored profile based on the second image set; comparing the second stored profile with the first stored profile to generate a second confidence score; determining whether the second confidence score satisfies one or more criteria; in response to determining that the second confidence score satisfies the one or more criteria, causing to be displayed, to a second user, a second list of identities of one or more second objects that includes a first object and the second image set that is associated with the second stored profile; receiving, from the second user, feedback that indicates that the first stored profile and the second stored profile are profiles of the same object; and storing confirmation information that indicates that the second stored profile is of the first object.
-
Specification