Directional object detection

• US 9,449,398 B2
• Filed: 10/16/2015
• Issued: 09/20/2016
• Est. Priority Date: 11/15/2012
• Status: Active Grant

• Current Assignee: Motorola Solutions, Inc.
• Original Assignee: Avigilon Analytics Corporation
• Inventors: Saptharishi, Mahesh, Marman, Douglas H.
• Primary Examiner(s): Harold, Jefferey
• Assistant Examiner(s): Rahman, Mustafizur
• Application Number:
  US14/885,499
• Publication Number:
  US 20160203615A1
• Time in Patent Office: 340 Days
• Field of Search: 348/135, 348/143, 348/142, 348/149, 348/153, 348/154, 348/156, 348/158, 348/169, 348/222.1, 348/565, 382/103, 382/107, 382/154, 382/166, 382/282, 715/700, 715/764, 345/419, 345/652
• US Class Current: 1/1
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 2207/30242 Counting objects in image
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/49 Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 13/2491 Intrusion detection systems, i.e. where the body of an intruder causes the interference with the electromagnetic field
• CPC Class Codes: G08G 1/0133 for classifying traffic situation
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source
• CPC Class Codes: H04N 7/188 : Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

Video analytics is used to track an object of interest represented in video data representing the field of view of a scene observed by a video camera. A multidimensional virtual beam is used to detect whether the tracked object of interest is continually present in a detection zone within the field view of the scene. An occurrence of an event is signaled when the tracked object of interest is continually present in the detection zone during a period beginning when the tracked object of interest enters the detection zone and ending when the tracked object of interest leaves the detection zone through the opposite side, after having completely crossed through the detection zone. Use of a virtual beam detection zone reduces false alarms as compared to the numbers of incidences of false alarms of traditional detection methods, while adding several features and benefits.

Claims

1. A method of monitoring whether an object of interest is passing through an area within a field of view of a scene observed by a video camera, the method comprising:

receiving video data representing the field of view of the scene observed by the video camera;

using video analytics to track an object of interest represented in the video data;

configuring a detection zone within the area, the detection zone having at least two sides;

signaling an occurrence of an event when the tracked object of interest is continually present in the detection zone during a period beginning when the tracked object of interest enters the detection zone on one side and ending when the tracked object of interest leaves the detection zone from a different side; and

determining a direction the tracked object of interest traveled through the detection zone by determining which side of the detection zone the tracked object of interest entered and which side of the detection zone the tracked object exited.

2. The method of claim 1, wherein the one side and the different side are positioned opposite to each other and thereby define opposite sides of the detection zone.

3. The method of claim 1, wherein the detection zone corresponds to a volume superimposed on a two-dimensional image represented by the video data.

4. The method of claim 1, wherein the detection zone corresponds to a volume of space oriented in a three-dimensional representation of the scene observed by the video camera.

5. The method of claim 1, wherein the signaling of an occurrence of an event is performed for an object of interest exhibiting a specified physical characteristic.

6. The method of claim 5, wherein the physical characteristic comprises at least one of a color of the object of interest, a shape of the object of interest, or a size of the object of interest.

7. The method of claim 5, wherein the physical characteristic is a speed of motion of the object of interest.

8. The method of claim 5, wherein the physical characteristic is a height of the object of interest.

9. The method of claim 5, wherein the detection zone corresponds to a volume of space and thereby defines a virtual beam detection zone that is superimposed on an image represented by the video data, and wherein the physical characteristic is a height of the object of interest within the virtual beam detection zone.

10. The method of claim 5, wherein the detection zone corresponds to a volume of space and thereby defines a virtual beam detection zone that is superimposed on an image represented by the video data, and wherein the height of the object of interest is capable of being configured by a height value set by a user.

11. The method of claim 1, wherein the object of interest is of a specified type.

12. The method of claim 1, wherein the object of interest is one of a number of objects of interest, and wherein the signaling of an occurrence of an event is performed upon determination of a specified number of tracked objects of interest.

13. The method of claim 1, further comprising monitoring passage of time, and wherein the signaling of an occurrence of an event is performed after detection of a specified period of time elapsed from a time the object of interest entered through the one side and left through the different side of the detection zone.

14. The method of claim 1, further comprising monitoring an output signal of an external sensor, and wherein the signaling of an occurrence of an event is performed upon indication of a predetermined value of the output signal of the external sensor.

15. The method of claim 1, wherein the object of interest is one of multiple objects of interest, and further comprising performing a count of the multiple objects of interest.

16. The method of claim 15, wherein the count of the multiple objects of interest is based on the determined direction of each of the multiple objects of interest.

17. The method of claim 15, wherein the count of the multiple objects of interest is based on the determined direction of each of the multiple objects of interest, in which the multiple objects of interest are people present in a retail establishment, and further comprising using the count of people to monitor retail establishment customer traffic patterns.

18. The method of claim 15, wherein the count of the multiple objects of interest is based on the determined direction of each of the multiple objects of interest, in which the multiple objects of interest are vehicles present in a specified region of vehicle travel, and further comprising using the count of vehicles to monitor vehicle traffic patterns in the specified region.

19. The method of claim 1, further comprising assigning the detection zone to follow the tracked object of interest as it moves at least within the field of view of the scene observed by the video camera.

20. The method of claim 19, wherein the scene observed by the video camera is a vehicle parking site and the tracked object of interest is a vehicle.

21. The method of claim 19, wherein the scene observed by the video camera is a hospital facility and the tracked object of interest is a person or hospital equipment.

22. The method of claim 1, wherein the object of interest is of a specified type, and further comprising automatically assigning the detection zone to encompass the specified object of interest when it appears in the field of view of the scene observed by the video camera.

23. The method of claim 1, wherein the video data representing the object of interest correspond to image pixels, and wherein the video analytics determines whether the object of interest enters or leaves the detection zone by determining whether an image pixel representing the object of interest is present in the detection zone.

24. The method of claim 23, wherein the image pixel is centrally located within the object of interest.

25. The method of claim 1, wherein the video data representing the object of interest correspond to at least one image pixel contained within a bounding box, and wherein the video analytics determines whether the object of interest enters or leaves the detection zone by determining whether an edge of the bounding box is present in the detection zone.

26. The method of claim 1, wherein one side or the different side of the detection zone is configured to be a certain distance from a ground reference to enable detection of a particular portion of the object of interest.

27. The method of claim 1, further comprising;

configuring a second detection zone, the second detection zone including a third side and a fourth side; and

signaling an occurrence of a second event when the tracked object of interest or another tracked object of interest is continually present in the detection zone during a second period beginning when the tracked object of interest or the another tracked object of interest enters the detection zone on the third side or fourth side and ending when the tracked object of interest or the another tracked object of interest leaves the detection zone from the third side or fourth side.

28. The method of claim 27, wherein the third side comprises the one side, and wherein the fourth side comprises the different side.

29. The method of claim 1, wherein configuring the detection zone further comprises receiving a selection of a distance been the one side and the different side, wherein the distance corresponds to a sensitivity of detection.

30. A video surveillance system, comprising:

at least one video camera configured to monitor whether an object of interest is passing through a detection zone within a field of view of a scene observed by the at least one video;

a computer system connected to the at least one video camera, and wherein the computer system further comprises;

a memory; and

a processor, wherein the memory comprises instructions, that when executed by the processor, cause the processor to;

receive video data representing the field of view of the scene observed by the at least one video camera;

track an object of interest represented in the video data using video analytics;

configure the detection zone to include a first side and a second side positioned opposite to each other and thereby defining opposite sides of the detection zone; and

signal an occurrence of an event when the tracked object of interest is continually present in the detection zone during a period beginning when the tracked object of interest enters the detection zone on the first side or the second side and ending when the tracked object of interest leaves the detection zone from the opposite side; and

determining a direction the tracked object of interest traveled through the detection zone by determining which side of the detection zone the tracked object of interest entered and which side of the detection zone the tracked object of interest exited.

31. The video surveillance system of claim 30, wherein the at least one video camera and the computer are integrated.

32. A non-transitory computer readable medium storing instruction, that when executed by a processor, cause the processor to perform the operations of:

receiving video data representing a field of view of a scene observed by a video camera;

using video analytics to track an object represented in the video data;

configuring a detection zone within the field of view including a first side and a second side positioned opposite to each other and thereby defining opposite sides of the detection zone;

signaling an occurrence of an event when the tracked object is continually present in the detection zone during a period beginning when the tracked object enters the detection zone on the first side or the second side and ending when the tracked object leaves the detection zone from the opposite side; and

determining a direction the tracked object traveled through the detection zone by determining which side of the detection zone the tracked object entered and which side of the detection zone the tracked object exited.