Method of generating index elements of objects in images captured by a camera system

• US 9,076,042 B2
• Filed: 02/18/2014
• Issued: 07/07/2015
• Est. Priority Date: 03/03/2008
• Status: Active Grant

• Current Assignee: Motorola Solutions, Inc.
• Original Assignee: Avo Usa Holding 2 Corporation (Motorola Solutions, Inc.)
• Inventors: Saptharishi, Mahesh, Lisin, Dimitri A.
• Primary Examiner(s): STREGE, JOHN B
• Application Number:
  US14/183,154
• Publication Number:
  US 20140176727A1
• Time in Patent Office: 504 Days
• Field of Search: 382/103, 348/143, 348/169
• US Class Current: 1/1
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A camera system comprises an image capturing device, object detection module, object tracking module, and match classifier. The object detection module receives image data and detects objects appearing in one or more of the images. The object tracking module temporally associates instances of a first object detected in a first group of the images. The first object has a first signature representing features of the first object. The match classifier matches object instances by analyzing data derived from the first signature of the first object and a second signature of a second object detected in a second image. The second signature represents features of the second object derived from the second image. The match classifier determine whether the second signature matches the first signature. A training process automatically configures the match classifier using a set of possible object features.

Claims

1. A method of generating index elements of objects in images captured by a camera system, the method comprising:

capturing a first group of multiple images of an object in a field of view of the camera system;

detecting the object in the first group of multiple images;

generating a first set of single-frame signatures of the object, the single-frame signatures of the first set corresponding to features of the object derived from the multiple images of the first group;

producing a first average signature of the object, the first average signature being an average of the single-frame signatures of the first set, and the first average signature being a first index element of the object;

producing a cumulative signature of the object, the cumulative signature being a weighted average of the single-frame signatures of the first set;

capturing a second image of the object;

detecting the object in the second image;

generating a second single-frame signature derived from the second image;

updating the cumulative signature by weighing the second single-frame signature and averaging the weighted second single-frame signature with the cumulative signature; and

determining whether to accept or reject the updated cumulative signature and the first average signature as a match, wherein the first average signature is updated based on the second single-frame signature when the updated cumulative signature and the first average signature are accepted as a match, and a second average signature of the object is produced based on the second single-frame signature when the updated cumulative signature and the first average signature are rejected as a match, the second average signature being a second index element of the object.

2. The method of claim 1, further comprising:

rejecting the updated cumulative signature and the first average signature as a match; and

storing the first and second index elements of the object in a database.

3. The method of claim 2, in which the first average signature represents a first view of the object, and the second average signature represents a second view of the object.