Master-slave automated video-based surveillance system

• US 20080117296A1
• Filed: 01/23/2008
• Published: 05/22/2008
• Est. Priority Date: 02/21/2003
• Status: Abandoned Application

• Current Assignee: ObjectVideo Incorporated (Alarm.com Holdings, Inc.)
• Original Assignee: ObjectVideo Incorporated (Alarm.com Holdings, Inc.)
• Inventors: Haering, Niels, Zhang, Zhong, Yin, Weihong, Egnal, Geoffrey, Lipton, Alan, Chosak, Andrew, Venetianer, Peter
• Application Number:
  US12/010,269
• Publication Number:
  US 20080117296A1
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A video surveillance system comprises a first sensing unit; a second sensing unit; and a communication medium connecting the first sensing unit and the second sensing unit. The first sensing unit provides information about a position of a target to the second sensing unit via the communication medium, and the second sensing unit uses the position information to locate the target.

Claims

1. A method, comprising:

obtaining image information about a scene, the image information comprising an image sequence including a plurality of images of the scene;

processing the image information to detect an object in the scene;

processing the object to determine if the object is a target;

locating the target in the images in the image sequence;

determining a classification for the target based on the image information;

generating statistics about each image in the image sequence based on an appearance of the target in that respective image and the classification of the target;

determining at least one image in the image sequence that indicates identifying information for the target based on the classification of the target and the statistics to obtain a best shot image; and

storing the best shot image.

2. The method of claim 1, wherein the classification is one of human, animal, vehicle or default.

3. The method of claim 2, wherein generating statistics comprises measuring at least one of skin tone pixels of the target, a trajectory of the target or a size of the target when the classification of the target is human.

4. The method of claim 2, wherein the identifying information includes a face when the classification of the target is human.

5. The method of claim 2, wherein generating statistics comprises measuring at least one of a trajectory of the target or a size of the target when the classification of the target is vehicle.

6. The method of claim 2, wherein the identifying information includes a license plate when the classification of the target is vehicle.

7. The method of claim 2, wherein the identifying information includes make or model information when the target classification is vehicle.

8. The method of claim 3, wherein determining the best shot image comprises selecting the image including the most skin tone pixels.

9. The method of claim 3, wherein determining the best shot image comprises selecting the image having a trajectory towards the sensing device.

10. The method of claim 6, wherein determining further comprises selecting the image including the license plate information as the best shot image.

11. The method of claim 4, wherein determining further comprises selecting the image including the face as the best shot image.

12. The method of claim 7, wherein determining further comprises selecting the image including the make or model information as the best shot image.

13. The method of claim 1, further comprising:

determining when the target violates a predetermined condition; and

determining the best shot image of the target when the target violates the predetermined condition.

14. The method of claim 1, wherein locating the target comprises performing a template matching process.

15. The method of claim 1, wherein locating the target further comprises performing a frame differencing process.

16. The method of claim 1, further comprising performing with a plurality of slave sensing units and providing respective best shot images of the slave sensing units to a master sensing unit over a communication medium that connects the master sensing unit to the slave sensing units;

determining with the master sensing unit which of the best shot images from the slave sensing units is optimal; and

directing the slave sensing unit with the optimal best shot image to follow the target.

17. The method of claim 1, wherein a master sensing unit is connected over a communication medium to a plurality of slave sensing units and further comprising:

determining with the master sensing unit which of the slave sensing units may provide the best shot image to obtain a selected slave sensing unit; and

directing the selected slave sensing unit to follow the target to obtain the best shot image, wherein the selected slave sensing unit performs the method of claim 1 to obtain the best shot image.

18. The method of claim 16, wherein directing the slave sensing unit comprises providing position information about the target from the master sensing unit to the slave sensing unit.

19. The method of claim 16, wherein directing the slave sensing unit comprises providing the images from the image sequence of the master sensing unit to the slave sensing unit.

20. The method of claim 16, further comprising following the target with the slave sensing unit based on instructions from the master sensing unit.

21. The method of claim 16, further comprising following the target with the slave sensing unit independent of instructions from the master sensing unit.

22. The method of claim 16, further comprising following the target with the slave sensing unit based on 1) instructions from the master sensing unit and 2) instructions generated with the slave sensing unit.

23. The method of claim 16, further comprising:

generating visual cues from the images using the slave sensing unit;

locating the target in a field of view with the slave based on the visual cues;

moving the slave sensing unit to track the target.

24. The method of claim 23, wherein the visual cues include at least one of target motion, color, or edge detection.

25. The method of claim 23, wherein locating the target comprises using template matching.

26. The method of claim 23, wherein moving the slave comprises changing a position, orientation, zoom or focus of the slave.

27. The method of claim 1, further comprising a plurality of masters.

28. A video sensing system, comprising:

a sensor device obtaining image information about a scene, the image information comprising an image sequence including a plurality of images of the scene;

a segmentation module processing the image information and detecting an object in the scene;

a target tracker module processing the object to determine if the object is a target;

a classification module determining a classification for the target based on the image information; and

a vision module generating statistics about each image in the image sequence based on an appearance of the target in that respective image and the classification of the target and determining at least one image in the image sequence that indicates identifying information for the target based on the classification of the target and the statistics to obtain a best shot image.

29. The system of claim 28, wherein the video sensing system is a slave sensing unit and further comprising a plurality of slave sensing units coupled to a master sensing unit via a communication medium, the slave sensing unit providing their best shot images to the master sensing unit over the communication medium, the master sensing unit including a best shot identification module determining which of the best shot images from the slave sensing units is optimal and a response module directing the slave sensing unit with the optimal best shot image to follow the target.

30. The system of claim 29, wherein the classification is one of human, animal, vehicle or default.

31. The system of claim 30, wherein the statistics include at least one of skin tone pixels of the target, a trajectory of the target or a size of the target when the classification of the target is human.

32. The system of claim 30, wherein the vision module locates a target image region a face based on the statistics when the classification of the target is human

33. The system of claim 30, wherein the statistics include at least one of a trajectory of the target or a size of the target when the classification of the target is vehicle.

34. The system of claim 30, wherein the vision module locates a target image region including a license plate based on the statistics when the classification of the target is vehicle.

35. The system of claim 30, wherein the vision module locates a target image region including make or model information based on the statistics when the target classification is vehicle.

36. The system of claim 31, wherein the best image identification module selects the image including the most skin tone pixels as the best shot image.

37. The system of claim 33, wherein the best image identification module selects the image having a trajectory towards the sensing device as the best shot image.

38. The system of claim 28, further comprising:

an inference module determining when the target violates a predetermined condition, wherein the vision module determines the best shot image when the target violates the predetermined condition.

39. The system of claim 28, wherein the video sensing system comprises a slave sensing unit and the vision module of the slave sensing unit generates visual cues from the images;

locates the target in a field of view of the slave based on the visual cues; and

further comprises a response module that directs movement of the slave sensing unit to track the target.

40. The system of claim 28, wherein the vision sensing system further comprises a master sensing unit and a slave sensing unit connected by a communication medium, the master sensing unit providing the images to the slave sensing unit via the communication medium, the slave sensing unit including a slave vision module to generate visual cues from the images from the master sensing unit;

locate the target in a field of view of the slave based on the visual cues and a response module that directs movement of the slave sensing unit to track the target.

41. The system of claim 39, wherein the visual cues include at least one of target motion, color, or edge detection.

42. The system of claim 39, wherein the vision module locates the target using template matching

43. The system of claim 39, wherein the response module directs movement of the slave sensing unit by changing a position, orientation, zoom or focus.

44. The system of claim 28, further comprising a plurality of masters.

45. The system of claim 28, further comprising a plurality of slaves.