Video object classification with object size calibration
First Claim
Patent Images
1. A camera system comprising:
- video analytics for processing image data representing an image of a field of view projected on an image plane of an image capturing device, the video analytics comprising;
an object classification module including an object classifier that is operable to classify objects captured in the field of view based on the image data, wherein the object classifier is operable to classify objects as members or non-members of an object class, wherein the object classifier includes a stage corresponding to a feature/transformation combination, and wherein the feature/transformation combination corresponding to a feature extracted from the image data and a discriminant function for mapping the feature to a scalar value, the feature being selected from a set of possible features and the discriminant function being selected from a set of possible discriminant functions, the feature and the discriminant function being selected so as to maximize object classification performance of the object classifier; and
a calibration module connected to the object classification module for estimating representative sizes of members of the object class, the representative sizes corresponding to different regions of the image plane, wherein the calibration module is operable to automatically update the representative sizes in response to classifications performed by the object classifier during live operation, and the calibration module is operable to supply information representing the updated representative sizes to the object classifier to improve its object classification performance.
6 Assignments
0 Petitions
Accused Products
Abstract
A camera system comprises an image capturing device and an object classification module connected to the image capturing device. The object classification module is operable to determine whether or not an object in an image is a member of an object class. The object classification module includes multiple decision steps configured in a cascade configuration, wherein at least one of the multiple decision steps is operable to (a) accept an object as a member of the object class, (b) reject an object as a member of the object class, and (c) call on a next step to determine whether or not an object is a member of the object class.
-
Citations
20 Claims
-
1. A camera system comprising:
-
video analytics for processing image data representing an image of a field of view projected on an image plane of an image capturing device, the video analytics comprising; an object classification module including an object classifier that is operable to classify objects captured in the field of view based on the image data, wherein the object classifier is operable to classify objects as members or non-members of an object class, wherein the object classifier includes a stage corresponding to a feature/transformation combination, and wherein the feature/transformation combination corresponding to a feature extracted from the image data and a discriminant function for mapping the feature to a scalar value, the feature being selected from a set of possible features and the discriminant function being selected from a set of possible discriminant functions, the feature and the discriminant function being selected so as to maximize object classification performance of the object classifier; and a calibration module connected to the object classification module for estimating representative sizes of members of the object class, the representative sizes corresponding to different regions of the image plane, wherein the calibration module is operable to automatically update the representative sizes in response to classifications performed by the object classifier during live operation, and the calibration module is operable to supply information representing the updated representative sizes to the object classifier to improve its object classification performance. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method of automatically calibrating a camera system, the method comprising:
-
receiving image data representing an image of a scene, the image corresponding to an image plane on which the scene is projected; detecting a first object in the image, an image of the first object being detected at a location of the image plane, the image of the first object having a size corresponding to the location; extracting a feature from the image data, the feature being selected from a set of possible features and corresponding to a feature/transformation combination; providing a discriminant function for mapping the feature to a scalar value, the discriminant function being selected from a set of possible discriminant functions, the feature and the discriminant function being selected so as to maximize object classification performance of an object classifier; classifying, with the object classifier, the first object as a first member of an object class; calculating a parameter of a size function for the image plane based on the size of the first object; and updating the parameter of the size function in response to detection and classification of a second member of the object class. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19)
-
-
20. A camera system comprising:
-
video analytics for processing image data representing an image of a field of view projected on an image plane of an image capturing device, the video analytics comprising; an object classification module including an object classifier that is operable to classify objects captured in the field of view based on the image data, wherein the object classifier is operable to classify objects as members or non-members of an object class, wherein the object classifier includes a stage corresponding to a feature/transformation combination, and wherein the feature/transformation combination corresponding to a feature extracted from the image data and a discriminant function for mapping the feature to a scalar value, the feature being selected from a set of possible features and the discriminant function being selected from a set of possible discriminant functions, the feature and the discriminant function being selected so as to maximize object classification performance of the object classifier; and a calibration module connected to the object classification module for estimating representative sizes of members of the object class, the representative sizes corresponding to different regions of the image plane, wherein the calibration module is operable to automatically update the representative sizes in response to classifications performed by the object classifier during in-field operation, a confidence parameter is associated with classifications of objects by the classification module, and the confidence parameter is determined at least in part based on the representative size of the associated object.
-
Specification