REAL-TIME VIDEO IMAGE ANALYSIS FOR PROVIDING SECURITY

• US 20120229647A1
• Filed: 01/01/2012
• Published: 09/13/2012
• Est. Priority Date: 03/08/2011
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Calman, Matthew A., Ross, Erik Stephen
• Granted Patent: US 8,922,657 B2
• Time in Patent Office: Days
• US Class Current: 348/158
• CPC Class Codes: G08B 13/19615 wherein said pattern is defined by the user
• CPC Class Codes: G08B 13/19621 Portable camera
• CPC Class Codes: G08B 17/10 Actuation by presence of smoke or gases , e.g. automatic alarm devices for analysing flowing fluid materials by the use of optical means
• CPC Class Codes: G08B 21/0423 detecting deviation from an expected pattern of behaviour or schedule
• CPC Class Codes: G08B 21/0476 Cameras to detect unsafe condition, e.g. video cameras
• CPC Class Codes: G08B 21/24 Reminder alarms, e.g. anti-loss alarms
• CPC Class Codes: G08B 25/005 Alarm destination chosen according to a hierarchy of available destinations, e.g. if hospital does not answer send to police station
• CPC Class Codes: G08B 29/181 due to failing power supply

Abstract

System, method, and computer program product are provided for using real-time video analysis to provide the user of mobile devices with security, no matter the user'"'"'s location. Through the use of real-time vision object recognition objects, logos, artwork, products, locations, and other features that can be recognized in the real-time video stream and frequented locations of the user can be established. In this way, a baseline layout of the frequented location is determined, such that the objects and individuals typically in the frequented area are recognized. The system may continue to take real-time video images of the frequented location, such that if a variation in the baseline layout occurs, the change may be alerted. In this way, a security compromise, such as a break-in to a user'"'"'s home may be detected by the system and thus the system may notify the user or the appropriate authorities.

Claims

1. A method for providing security to a user, the method comprising:

receiving a captured first image of an area frequented by the user;

building a directory of data relating to the area frequented by the user, wherein the directory comprises information regarding objects and individuals within the area frequented by the user, wherein the directory of data is built using the captured first image of the area frequented by the user;

receiving a captured second image of the area frequented by the user subsequent to the directory of data being built;

recognizing variations between the directory of data and the captured second images with respect to the objects and the individuals within the area frequented by the user, through the use of a processor device; and

presenting indicators associated with the variations, via the mobile device of the user, wherein the indicators provide a recommended security action based on the variations between the directory of data and the captured second image.

2. The method of claim 1, wherein presenting the indicators associated with the variations further comprises superimposing the indicators associated with the variations over real-time video that is capture by the mobile device of an area frequented by the user, wherein the location of the objects and the individuals within the area frequented by the user, other than the variations, correspond to the directory of data relating to the area frequented by the user.

3. The method of claim 1, wherein the directory of data comprises information regarding the objects that are normally found within the area frequented by the user.

4. The method of claim 1, wherein the directory of data comprises information regarding the individuals that are normally found within the area frequented by the user.

5. The method of claim 1, wherein the receiving the captured second image of the area frequented by the user comprises real-time imaging of the area frequented by the user.

6. The method of claim 1, wherein the receiving the captured second image of the area frequented by the user comprises receiving real-time images of the area frequented by the user continuously while the mobile device is in the area frequented by the user.

7. The method of claim 1, wherein presenting an indicator associated with the variation comprises displaying the indicator on a display of the mobile device.

8. The method of claim 1, wherein presenting an indicator associated with the variation comprises superimposing the indicator over real-time video that is captured by the mobile device.

9. The method of claim 1, wherein the indicator is selectable by the user.

10. The method of claim 1, wherein the indicator, upon being selected, provides information regarding the variation based on security information related to the area frequented by the user.

11. A system for providing security to a user, comprising:

a memory device;

a communication device;

a processing device operatively coupled to the memory device and the communication device, wherein the processing device is configured to execute computer-readable program code to;

receive a captured first image of an area frequented by the user;

build a directory of data relating to the area frequented by the user, wherein the directory comprises information regarding objects and individuals within the area frequented by the user, wherein the directory of data is built using the captured first image of the area frequented by the user;

receive, via a mobile device, a captured second image of the area frequented by the user subsequent to the directory of data being built;

recognize variations between the directory and the captured second images with respect to the objects and the individuals within the area frequented by the user, through the use of a processor device; and

present indicators associated with the variations a recommended security action based on the variations between the directory of data and the captured second image.

12. The system of claim 11, wherein presenting the indicators associated with the variations comprises superimposing the indicators associated with the variations over real-time video that is capture by the mobile device of an area frequented by the user, wherein the location of the objects and the individuals within the area frequented by the user, other than the variations, correspond to the directory of data relating to the area frequented by the user.

13. The system of claim 11, wherein the directory comprises information regarding the objects that are normally found within the area frequented by the user.

14. The system of claim 11, wherein the directory comprises information regarding the individuals that are normally found within the area frequented by the user.

15. The system of claim 11, wherein the receiving the captured second image of the area frequented by the user comprises real-time imaging of the area frequented by the user.

16. The system of claim 11, wherein the receiving the captured second image of the area frequented by the user comprises receiving real-time images of the area frequented by the user continuously while the mobile device is in the area frequented by the user.

17. The system of claim 11, wherein presenting an indicator associated with the variation comprises displaying the indicator on a display of the mobile device.

18. The system of claim 11, wherein presenting an indicator associated with the variation comprises superimposing the indicator over real-time video that is captured by the mobile device.

19. The system of claim 11, wherein the indicator is selectable by the user.

20. The system of claim 11, wherein the indicator, upon being selected, provides information regarding the variation based on security information related to the area frequented by the user.

21. A computer program product for providing landscaping design recommendations, the computer program product comprising at least one non-transitory computer-readable medium having computer-readable program code portions embodied therein, the computer-readable program code portions comprising:

an executable portion configured for receiving a captured first image of an area frequented by the user;

an executable portion configured for building a directory of data relating to the area frequented by the user, wherein the directory comprises information regarding objects and individuals within the area frequented by the user, wherein the directory of data is built using the captured first image of the area frequented by the user;

an executable portion configured for receiving, via a mobile device a captured second image of the area frequented by the user subsequent to the directory of data being built;

an executable portion configured for recognizing variations between the directory and the captured second images with respect to the objects and the individuals within the area frequented by the user, through the use of a processor device; and

an executable portion configured for presenting indicators associated with the variations, via the mobile device of the user, a recommended security action based on the variations between the directory of data and the captured second image.

22. The computer program product of claim 21, wherein presenting the indicators associated with the variations comprises superimposing the indicators associated with the variations over real-time video that is capture by the mobile device of an area frequented by the user, wherein the location of the objects and the individuals within the area frequented by the user, other than the variations, correspond to the directory of data relating to the area frequented by the user.

23. The computer program product of claim 21, wherein the directory comprises information regarding the objects that are normally found within the area frequented by the user.

24. The computer program product of claim 21, wherein the directory comprises information regarding the individuals that are normally found within the area frequented by the user.

25. The computer program product of claim 21, wherein the receiving the captured second image of the area frequented by the user comprises real-time imaging of the area frequented by the user.

26. The computer program product of claim 21, wherein the receiving the captured second image of the area frequented by the user comprises receiving real-time images of the area frequented by the user continuously while the mobile device is in the area frequented by the user.

27. The computer program product of claim 21, wherein presenting an indicator associated with the variation comprises displaying the indicator on a display of the mobile device.

28. The computer program product of claim 21, wherein presenting an indicator associated with the variation comprises superimposing the indicator over real-time video that is captured by the mobile device.

29. The computer program product of claim 21, wherein the indicator is selectable by the user.

30. The computer program product of claim 21, wherein the indicator, upon being selected, provides information regarding the variation based on security information related to the area frequented by the user.