Video object classification with object size calibration
First Claim
Patent Images
1. A camera system comprising:
- video analytics for processing image data representing an image of a field of view projected on an image plane of an image capturing device, the video analytics comprising;
an object classification module including an object classifier that is operable to classify objects captured in the field of view based on the image data, wherein the object classifier is operable to classify objects as members of one object class among a plurality of object classes or a member of an unknown object class;
a calibration module connected to the object classification module for estimating representative sizes of objects, the representative sizes corresponding to different regions of the image plane, wherein the calibration module is operable to automatically update the representative sizes of objects classified as members of the object class in response to classifications performed by the object classifier during live operation, and wherein the calibration module is operable to supply information representing the updated representative sizes to the object classifier to improve its object classification performance; and
a temporal object classification module connected to the calibration module that is operable to change the classification of an object classified to the unknown object class to the object class based on a threshold.
3 Assignments
0 Petitions
Accused Products
Abstract
A camera system comprises an image capturing device, and connected to it are an object classification module and a calibration module. The object classification module is operable to determine whether or not an object in an image is a member of an object class, and the calibration module is operable to estimate representative sizes of the object. The object classification module may determine a confidence parameter that is used by the calibration module, or conversely, the calibration module may produce a size that is used by the classification module.
-
Citations
21 Claims
-
1. A camera system comprising:
-
video analytics for processing image data representing an image of a field of view projected on an image plane of an image capturing device, the video analytics comprising; an object classification module including an object classifier that is operable to classify objects captured in the field of view based on the image data, wherein the object classifier is operable to classify objects as members of one object class among a plurality of object classes or a member of an unknown object class; a calibration module connected to the object classification module for estimating representative sizes of objects, the representative sizes corresponding to different regions of the image plane, wherein the calibration module is operable to automatically update the representative sizes of objects classified as members of the object class in response to classifications performed by the object classifier during live operation, and wherein the calibration module is operable to supply information representing the updated representative sizes to the object classifier to improve its object classification performance; and a temporal object classification module connected to the calibration module that is operable to change the classification of an object classified to the unknown object class to the object class based on a threshold. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A method of automatically calibrating a camera system, the method comprising:
-
receiving image data representing an image of a scene, the image corresponding to an image plane on which the scene is projected; detecting a first object in the image, an image of the first object being detected at a location of the image plane, the image of the first object having a size corresponding to the location; classifying the first object as a first member of an object class among a plurality of object classes or as a first member of an unknown object class; when the first object is classified as a first member of the object class, calculating a parameter of a size function for the image plane based on the size of the first object; when the first object is classified as a first member of the unknown object class, changing the classification of the first object from the unknown object class to the object class based on a temporal threshold; and updating the parameter of the size function in response to detection and classification of a second member of the object class. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
-
21. A camera system comprising:
-
video analytics for processing image data representing an image of a field of view projected on an image plane of an image capturing device, the video analytics comprising; an object classification module including an object classifier that is operable to classify objects captured in the field of view based on the image data, wherein the object classifier is operable to classify objects as members of one object class among a plurality of object classes or a member of an unknown object class; a calibration module connected to the object classification module for estimating representative sizes of objects, the representative sizes corresponding to different regions of the image plane, wherein the calibration module is operable to automatically update the representative sizes of objects classified as members of the object class in response to classifications performed by the object classifier during in-field operation, a confidence parameter is associated with classifications of objects by the classification module, and the confidence parameter is determined at least in part based on the representative size of the associated object; and a temporal object classification module connected to the calibration module that is operable to change the classification of an object classified to the unknown object class to the object class based on a threshold.
-
Specification