Video surveillance system with connection probability computation that is a function of object size

• US 20050105764A1
• Filed: 08/12/2004
• Published: 05/19/2005
• Est. Priority Date: 11/17/2003
• Status: Abandoned Application

• Current Assignee: Vidient Systems, Inc. (Agilence Incorporated)
• Original Assignee: Vidient Systems, Inc. (Agilence Incorporated)
• Inventors: Gong, Yihong, Han, Mei, Tao, Hai
• Application Number:
  US10/917,063
• Publication Number:
  US 20050105764A1
• Time in Patent Office: Days
• US Class Current: 382/100
• CPC Class Codes: G01S 5/16 using electromagnetic waves other than radio waves
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A video surveillance system uses rule-based reasoning and multiple-hypothesis scoring to detect predefined behaviors based on movement through zone patterns. Trajectory hypothesis spawning allows for trajectory splitting and/or merging and includes local pruning to managed hypothesis growth. Hypotheses are scored based on a number of criteria, illustratively including at least one non-spatial parameter. Connection probabilities computed during the hypothesis spawning process are based on a number of criteria, illustratively including object size. Object detection and probability scoring is illustratively based on object class.

Claims

1. A method for use in a video surveillance system in which at least one set of trajectories for objects being tracked in an area under surveillance are computed, the method comprising

identifying objects present-in said area under surveillance at a current point in time, and

computing connection probabilities each associated with a respective object/trajectory pair, each object/trajectory pair comprising a particular one of said identified objects and a particular trajectory computed for a previous point in time, each connection probability being indicative of a likelihood that said particular trajectory is the actual trajectory of said particular object and each connection probability being a function of a measure of the similarity of the size of said particular object and the size of an object that terminates said particular trajectory.

2. The method of claim 1 wherein said each connection probability is a further function of a measure of the similarity in appearance between said particular object and an object that terminates said particular trajectory.

3. The method of claim 2 wherein said similarity in appearance is a function of a histogram distributions of said particular object and said object that terminates said particular trajectory.

4. The method of claim 2 wherein said each connection probability is a further function of the distance between said particular object and an object that terminates said particular trajectory.

5. The method of claim 3 wherein said each connection probability is a further function of the distance between said particular object and an object that terminates said particular trajectory.

6. The method of claim 1 wherein said objects are identified from at least one video image of said area under surveillance and wherein said identifying includes identifying a region of said image that appears to be an object in a predetermined object class.

7. The method of claim 2 wherein said objects are identified from at least one video image of said area under surveillance and wherein said identifying includes identifying a region of said image that appears to be an object in a predetermined object class.

8. The method of claim 3 wherein said objects are identified from at least one video image of said area under surveillance and wherein said identifying includes identifying a region of said image that appears to be an object in a predetermined object class.

9. The method of claim 4 wherein said objects are identified from at least one video image of said area under surveillance and wherein said identifying includes identifying a region of said image that appears to be an object in a predetermined object class.

10. The method of claim 1 further comprising identifying one or more sets of said object/trajectory pairs, the object/trajectory pairs of each set being selected as a function of said computed connection probabilities.

20. A tangible medium on which are stored instructions that are executable by a processor to carry out the method defined by claim 1.

11. A method for use in a video surveillance system in which at least one hypothesis has been developed, said hypothesis comprising a hypothesized set of trajectories of a set of objects hypothesized to have been moving through an area under surveillance at a particular point in time, said objects being in a particular object class, the method comprising

identifying objects in said particular object class moving through said area at a subsequent point in time, and

computing connection probabilities each associated with a respective object/trajectory pair, each object/trajectory pair comprising a particular one of said identified objects and a particular trajectory of said hypothesis, each connection probability being indicative of a likelihood that said particular trajectory is the actual trajectory of said particular object,

each connection probability for each said pair being a function of one or more measures of the similarity between the particular object of that pair and the object to which the particular trajectory was previously extended,

said one or more measures of similarity including a similarity in size between said particular object and said object to which the particular trajectory was extended.

12. The method of claim 11 wherein said one or more measures of similarity includes a measure of the similarity in appearance, independent of size, between said particular object and said object to which said particular trajectory was extended.

13. The method of claim 11 wherein particular object class is human beings.

14. The method of claim 11 further comprising developing one or more further hypotheses, each of said further hypotheses comprising selected sets of trajectory/object pairs, at least ones of said sets of trajectory/object pairs comprising a trajectory of said one hypothesis extended to at least one of the identified objects, said selected sets of trajectory/object pairs being selected as a function of said computed connection probabilities.

15. An electronic surveillance system of a type in which at least one set of trajectories for objects being tracked in an area under surveillance are computed, the system being adapted to

identify objects present in said area under surveillance at a current point in time, and

compute connection probabilities each associated with a respective object/trajectory pair, each object/trajectory pair comprising a particular one of said identified objects and a particular trajectory computed for a previous point in time, each connection probability being indicative of a likelihood that said particular trajectory is the actual trajectory of said particular object and each connection probability being a function of a measure of the similarity of the size of said particular object and the size of an object that terminates said particular trajectory.

16. The system claim 15 wherein said each connection probability is a further function of a measure of the similarity in appearance between said particular object and an object that terminates said particular trajectory.

17. The system of claim 16 wherein said similarity in appearance is a function of a histogram distributions of said particular object and said object that terminates said particular trajectory.

18. The method of claim 17 wherein said each connection probability is a further function of the distance between said particular object and an object that terminates said particular trajectory.

19. The method of claim 16 wherein said objects are identified from at least one video image of said area under surveillance and wherein said identifying includes identifying a region of said image that appears to be an object in a predetermined object class.