Method of searching data to identify images of an object captured by a camera system

• US 10,339,379 B2
• Filed: 11/03/2017
• Issued: 07/02/2019
• Est. Priority Date: 03/03/2008
• Status: Active Grant

• Current Assignee: Motorola Solutions, Inc.
• Original Assignee: Avigilon Analytics Corporation (Motorola Solutions, Inc.)
• Inventors: Saptharishi, Mahesh, Lisin, Dimitri A.
• Primary Examiner(s): Strege, John B
• Application Number:
  US15/802,936
• Publication Number:
  US 20180060656A1
• Time in Patent Office: 606 Days
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A camera system comprises an image capturing device, object detection module, object tracking module, and match classifier. The object detection module receives image data and detects objects appearing in one or more of the images. The object tracking module temporally associates instances of detected objects, each of which has a signature representing features of the detected object. The match classifier matches object instances by analyzing data derived from the signatures. The match classifier determines whether the signatures match.

Claims

1. A system comprising:

a display;

an input device;

a processor communicatively coupled to the display and the input device; and

a memory communicatively coupled to the processor and having stored thereon computer program code that is executable by the processor, wherein the computer program code, when executed by the processor, causes the processor to;

receive image data representing a first object in an image of a field of view of a camera system, the first object having a first signature representing features of the first object;

display an image of the first object on the display;

accept input from the input device indicative of a selection of the first object;

make determinations as to whether the first signature matches one or more signatures of a group that correspond to a set of objects captured in images of the field of view; and

send a notification indicating a match between the first signature and a second signature of a second object of the set.

2. The system of claim 1, in which the notification includes displaying an image of the second object on the display.

3. The system of claim 1, in which the camera system comprises first and second image capturing devices connected to one another and the display, the first and second image capturing devices having, respectively, a first field of view and a second field of view, the field of view of the camera system corresponding to the first field of view and the second field of view in combination, wherein the image of the first object is captured with the first image capturing device and a second image of the second object is captured with the second image capturing device.

4. The system of claim 1, in which the first object includes a fast signature representing a simplified version of the first signature, and the objects of the set include fast signatures representing simplified versions of the group of signatures, wherein the computer program code, when executed by the processor, further compares the fast signature of the first object with the fast signatures of the objects of the set prior to making determinations as to whether the signatures of the group match the first signature.

5. The system of claim 1, wherein the computer program code, when executed by the processor, further retrieves the group of signatures from a database.

6. The system of claim 1, wherein the computer program code, when executed by the processor, further sends the notification when the second signature matches the first signature and when a selected rules violation is associated with the second object.

7. The system of claim 1, in which a rule violation is associated with each of the objects of the set.

8. A non-transitory computer readable medium having stored thereon computer program code that is executable by a processor and that, when executed by the processor, causes the processor to:

receive image data representing a first object in an image of a field of view of a camera system, the first object having a first signature representing features of the first object;

display an image of the first object on the display;

accept input from the input device indicative of a selection of the first object;

make determinations as to whether the first signature matches one or more signatures of a group that correspond to a set of objects captured in images of the field of view; and

send a notification indicating a match between the first signature and a second signature of a second object of the set.

9. The non-transitory computer readable medium of claim 8, in which the notification includes displaying an image of the second object on the display.

10. The non-transitory computer readable medium of claim 8, in which the camera system comprises first and second image capturing devices connected to one another and the display, the first and second image capturing devices having, respectively, a first field of view and a second field of view, the field of view of the camera system corresponding to the first field of view and the second field of view in combination, wherein the image of the first object is captured with the first image capturing device and a second image of the second object is captured with the second image capturing device.

11. The non-transitory computer readable medium of claim 8, in which the first object includes a fast signature representing a simplified version of the first signature, and the objects of the set include fast signatures representing simplified versions of the group of signatures, wherein the computer program code, when executed by the processor, further compares the fast signature of the first object with the fast signatures of the objects of the set prior to making determinations as to whether the signatures of the group match the first signature.

12. The non-transitory computer readable medium of claim 8, wherein the computer program code, when executed by the processor, further retrieves the group of signatures from a database.

13. The non-transitory computer readable medium of claim 8, wherein the computer program code, when executed by the processor, further sends the notification when the second signature matches the first signature and when a selected rules violation is associated with the second object.

14. The non-transitory computer readable medium of claim 8, in which a rule violation is associated with each of the objects of the set.