Surveillance systems and methods to monitor, recognize, track objects and unusual activities in real time within user defined boundaries in an area

• US 20120188370A1
• Filed: 11/04/2011
• Published: 07/26/2012
• Est. Priority Date: 01/23/2011
• Status: Active Grant

• Current Assignee: James Bordonaro
• Original Assignee: James Bordonaro
• Inventors: Bordonaro, James
• Granted Patent: US 8,908,034 B2
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system

Abstract

A surveillance system and method that utilize computer vision technology and background subtraction to monitor, recognize, and track objects or unusual activities within user specified boundaries. The system and method comprises at least one camera and at least one computer with a software program showing one or multiple windows of camera'"'"'s field of views in real time. The program allows users to define one or multiple boundaries within any window. The program further utilizes background subtraction technique to establish normal “home-position” of objects within defined boundaries. The program compares current image of the objects against the normal “home-position” to determine/calculate the difference of pixel intensity values. If the difference is beyond the predetermine threshold, the program will flag the movement of the object and give off alert.

Claims

1. A system for monitoring, recognizing, and tracking objects comprising:

a. at least one cameras installed within and/or around a house and/or a commercial building; and

b. a central server including at least one local CPU comprising a computer and a program/software installed on the computer, which show one or multiple windows of camera(s)'"'"' field of views in real time on a display device (e.g. computer screen), each field of view from an individual camera, the central server receives data transmitted from the cameras, the program allows users to define one or multiple boundaries within one and/or multiple windows of camera(s) field of view.

2. The system for monitoring, recognizing, and tracking objects of claim 1 further comprising at least one reflective marker installed on the ground along the perimeter of a property or a border.

3. The system for monitoring, recognizing, and tracking objects of claim 1 further comprising at least one color coded mobile unit that are worn by recipients for identification purpose, the recipients are one of children, elderly and/or sick, and/or handicapped people, and pets, and the combination thereof;

the mobile units are colored collars for pets and/or colored wrist bands and/or T-shirts for children and/or elderly and/or sick, and/or handicapped people;

the collars worn by pets may include a radio receiver.

4. The system for monitoring, recognizing, and tracking objects of claim 3 wherein the mobile units worn by objects further including photonic elements that can recognize the reflective markers along the boundaries (perimeters) of a property and calculate the distance;

if the objects are determined to be too close to the boundary, then a flag for warning and possible voice warning would be transmitted to the recipients;

a warning shock can be implemented on the pets if necessary;

an alert can be sent to the users.

5. The system for monitoring, recognizing, and tracking objects of claim 1, wherein the cameras and the program utilize face detection technology to automatically zoom in and highlight a person'"'"'s face.

6. The system for monitoring, recognizing, and tracking objects of claim 1, wherein the cameras may be fixed focal length cameras, varying focal length camera, and/or IR camera, and/or the combination thereof.

7. The system for monitoring, recognizing, and tracking objects of claim 1 further comprising a local and/or wide area network system with facial scanning capability to store and establish personnel face database of in house/in office/in building/in firm.

8. The system for monitoring, recognizing, and tracking objects of claim 1, wherein the program allows for manually drawing specific single or multiple boundaries within the window of the camera'"'"'s field of view on the screen within program set itself while viewing actual external property boundary or internal building floor layout in real time to define specific window boundaries;

the boundaries (perimeters) are drawn by using a mouse and/or digitizing pointer;

the program allows for viewing a defined single and/or multiple boundaries within any window of camera'"'"'s field of view.

9. The system for monitoring, recognizing, and tracking objects of claim 1 wherein the program further establishing normal ‘

home-position’

for each of the objects to be monitored within boundaries and comparing current image with the normal ‘

home-position’

of the objects to determine whether the objects have been moved or not based on pixel intensity difference.

10. The system for monitoring, recognizing, and tracking objects of claim 1 further comprising voice recognition components.

11. The system for monitoring, recognizing, and tracking objects of claim 1 wherein the program including a size parameter and color parameter of the monitored objects for recognition.

12. The system for monitoring, recognizing, and tracking objects of claim 1 further comprising hardware (motherboard inputs, connectors) to connect and act as a gateway to work together with existing cameras to process their video information accordingly.

13. A method for monitoring, recognizing, and tracking objects comprising steps of:

a. setting up a local home base computer system and/or a central processing server where at least one computer and software program for monitoring, recognizing, and tracking objects are installed;

b. setting up one or multiple cameras within and/or around a residential house and/or a commercial building;

c. users defining boundaries for objects living and/or non living, moving and/or standing objects within windows of camera(s)'"'"' field of view;

d. establishing normal ‘

home-position’

for the objects living and/or non living, moving and /or standing objects within the boundaries;

e. setting up thresholds for pixel intensity changes;

f. comparing current image against the normal ‘

home position’ and

determine/calculate difference of pixel intensity values between the two;

g. flagging objects movement within the boundaries if pixel intensity changes are beyond the predetermined threshold; and

h. sending signals to a local home base computer system for program control or a central processing server for multiple interfacing and potential monitoring of the objects.

14. The method for monitoring, recognizing, and tracking objects of claim 13 wherein the users can define a single or multiple boundaries in any shape within any window by using a mouse and/or digitizing pointer.

15. The method for monitoring, recognizing, and tracking objects of claim 13 further comprising a step of giving off warning sounds if the objects are moving outside a predetermined boundaries and/or sending a shock if the object is a pet.

16. The method for monitoring, recognizing, and tracking objects of claim 13 further comprising a step of scanning face of family members or company employees to establish personnel face recognition database so that the family members or company employees may walk freely within specified defined area without need of carrying ID badges.

17. The method for monitoring, recognizing, and tracking objects of claim 13 further comprising a step of counting traffic of people and vehicles in different settings, and distinguish large vehicles from small ones.

18. The method for monitoring, recognizing, and tracking objects of claim 13 further comprising a step of identifying an object that is approaching boundary by utilizing known computer vision methods, such as feature point detection and/or template-based tracking.

19. The method for monitoring, recognizing, and tracking objects of claim 13 further comprising a step of recognizing objects utilizing computer vision CAD model.

20. A system for monitoring, recognizing, and tracking objects comprising:

(a) a software installed on the computer, which show multiple videos from individual cameras in real time;

(b) at least one cameras, utilized at each side of a house or building, each camera can recognize maximum 50 meters in general and at low cost base;

(c) at least one reflective markers placed (through various means on the ground along the perimeter;

(d) at least one mobile Unit utilized to help transmit data to the central server (local CPU) including photonic elements incorporated on the mobile unit that recognizes the marks along perimeter and calculates the distances;

if distances are determined to be within specification, then a flag for warning and possible voice warning would be transmitted to the recipients;

a warning shock can be implemented on the pets if necessary;

an alert can be sent to the users.