OBJECT MATCHING FOR TRACKING, INDEXING, AND SEARCH
First Claim
1. A camera system comprising:
- an image capturing device having a field of view and producing image data representing multiple images of the field of view;
an object detection module connected to the image capturing device and receiving the image data, the object detection module being operable to detect objects appearing in one or more of the multiple images;
an object tracking module connected to the object detection module and operable to temporally associate instances of a first object detected in a first group of the multiple images, the first object having a first signature representing features of the first object derived from the images of the first group; and
a match classifier connected to the object tracking module for matching object instances, the match classifier being operable to match object instances by analyzing data derived from the first signature of the first object and a second signature of a second object, the second object being detected in a second image distinct from the images of the first group, and the second signature representing features of the second object derived from the second image, wherein the match classifier analyzes the first set of data to determine whether or not the second signature matches the first signature, wherein the manner in which the match classifier operates to match object instances has been determined at least in part by a training process that automatically configures the match classifier using a set of possible object features.
7 Assignments
0 Petitions
Accused Products
Abstract
A camera system comprises an image capturing device, object detection module, object tracking module, and match classifier. The object detection module receives image data and detects objects appearing in one or more of the images. The object tracking module temporally associates instances of a first object detected in a first group of the images. The first object has a first signature representing features of the first object. The match classifier matches object instances by analyzing data derived from the first signature of the first object and a second signature of a second object detected in a second image. The second signature represents features of the second object derived from the second image. The match classifier determine whether the second signature matches the first signature. A training process automatically configures the match classifier using a set of possible object features.
622 Citations
60 Claims
-
1. A camera system comprising:
-
an image capturing device having a field of view and producing image data representing multiple images of the field of view; an object detection module connected to the image capturing device and receiving the image data, the object detection module being operable to detect objects appearing in one or more of the multiple images; an object tracking module connected to the object detection module and operable to temporally associate instances of a first object detected in a first group of the multiple images, the first object having a first signature representing features of the first object derived from the images of the first group; and a match classifier connected to the object tracking module for matching object instances, the match classifier being operable to match object instances by analyzing data derived from the first signature of the first object and a second signature of a second object, the second object being detected in a second image distinct from the images of the first group, and the second signature representing features of the second object derived from the second image, wherein the match classifier analyzes the first set of data to determine whether or not the second signature matches the first signature, wherein the manner in which the match classifier operates to match object instances has been determined at least in part by a training process that automatically configures the match classifier using a set of possible object features. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39)
-
-
40. A method of tracking an object captured by a camera system, the method comprising:
-
capturing first and second images of a field of view of the camera system; detecting a first object captured in the first image and a second object captured in the second image; producing a first signature of the first object and a second signature of the second object, the first signature representing a first set of features of the first object and the second signature representing a second set of features of the second object; producing data derived from the first and second signatures, the data corresponding to a first subset of features selected from the first set and a second subset of features selected from the second set, wherein a training process automatically determines the features of the first and second sets that are to be selected for inclusion in the first and second subsets; and analyzing the data to determine whether the second object is an instance of the first object. - View Dependent Claims (41, 42, 43, 44, 45, 46, 47, 48, 49, 50)
-
-
51. A method of generating index elements of objects in images captured by a camera system, the method comprising:
-
capturing a first group of multiple images of an object in a field of view of the camera system; detecting the object in the first group of multiple images; generating a first set of single-frame signatures of the object, the single-frame signatures of the first set corresponding to features of the object derived from the multiple images of the first group; producing a first average signature of the object, the first average signature being an average of the single-frame signatures of the first set, and the first average signature being a first index element of the object; producing a cumulative signature of the object, the cumulative signature being a weighted average of the single-frame signatures of the first set; capturing a second image of the object; detecting the object in the second image; generating a second single-frame signature derived from the second image; updating the cumulative signature by weighing the second single-frame signature and averaging the weighted second single-frame signature with the cumulative signature; and determining whether to accept or reject the updated cumulative signature and the first average signature as a match, wherein the first average signature is updated based on the second single-frame signature when the updated cumulative signature and the first average signature are accepted as a match, and a second average signature of the object is produced based on the second single-frame signature when the updated cumulative signature and the first average signature are rejected as a match, the second average signature being a second index element of the object. - View Dependent Claims (52, 53)
-
-
54. A method of searching data to identify images of an object captured by a camera system, the method comprising:
-
capturing a first object in an image of a field of view of the camera system, the first object having a first signature representing features of the first object; displaying an image of the first object on a display; accepting user input indicative of a selection of the first object; making determinations as to whether the first signature matches one or more signatures of a group that correspond to a set of objects captured in images of the field of view; and sending a notification when a second signature of a second object of the set matches the first signature. - View Dependent Claims (55, 56, 57, 58)
-
-
59. A camera system, comprising:
-
an image capturing device having a field of view and producing image data representing multiple images of the field of view; an object detection module connected to the image capturing device and receiving the image data, the object detection module being operable to detect objects appearing in one or more of the multiple images; a user interface connected to the image capturing device, the user interface including a display for displaying objects detected by the object detection module and an input device operable to select objects detected by the object detection module in response to user commands; a match classifier operable to match objects detected by the object detection module; an object tracking module connected to the match classifier and the object detection module, the object tracking module being operable to temporally associate instances of objects detected by the object detection module, wherein the object tracking module is operable to call on the match classifier to determine whether or not to associate instances of objects; and a search module connected to the match classifier and the user interface, the search module being operable to retrieve stored images of objects selected by the input device, the search module being operable to call on the match classifier to locate a stored image of a selected object. - View Dependent Claims (60)
-
Specification