VIDEO ANALYTICS FOR BANKING BUSINESS PROCESS MONITORING

• US 20080074496A1
• Filed: 09/20/2007
• Published: 03/27/2008
• Est. Priority Date: 09/22/2006
• Status: Abandoned Application

• Current Assignee: ObjectVideo Incorporated (Alarm.com Holdings, Inc.)
• Original Assignee: ObjectVideo Incorporated (Alarm.com Holdings, Inc.)
• Inventors: Scanlon, W. A., Chosak, Andrew J., Myers, Gary W., Yu, Li, Haering, Niels, Zhang, Zhong, Brewer, Paul C., Venetianer, Peter L., Lipton, Alan J., Hu, Yongtong, Yin, Wei Hong, Cutting, Robert A.
• Application Number:
  US11/858,496
• Publication Number:
  US 20080074496A1
• Time in Patent Office: Days
• US Class Current: 348/150
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system

Abstract

A system for video monitoring at least one banking business process may comprise a video analytics engine to process video of a bank area obtained by a video camera and to generate video primitives regarding the video; a user interface to define at least one activity of interest regarding the bank area being viewed, wherein each activity of interest identifies a rule and/or a query regarding the bank area being viewed; and an activity inference engine to process the video primitives according to a banking business process, based on each activity of interest from the user interface to determine if any activity of interest occurred in the video.

Claims

1. A system for video monitoring at least one banking business process comprising:

a video analytics engine to process video of a bank area obtained by a video camera and to generate video primitives regarding the video;

a user interface to define at least one activity of interest regarding the bank area being viewed, wherein each activity of interest identifies a rule and/or a query regarding the bank area being viewed; and

an activity inference engine to process the video primitives according to a banking business process, based on each activity of interest from the user interface to determine if any activity of interest occurred in the video.

2. The system of claim 1, wherein the video analytics engine and the activity inference engine are resident within at least one of:

the same device or separate devices, or wherein at least one of the video analytics engine and the activity inference engine is resident in the video camera.

3. The system of claim 1, wherein the video analytics engine operates in at least one of a real-time mode, or an off-line mode.

4. The system of claim 1, wherein the video primitives comprise at least one of a time video primitive, a blob video primitive, a target video primitive, an environmental video primitive, a flow-control video primitives, and/or a special purpose video primitive for a banking business process, the special purpose video primitive including at least one of:

a basket run video primitive, a high-value item stealing video primitive, a reaching primitive, a tide filter video primitive, an omni-directional video primitive, and/or a motion histogram video primitive.

5. The system of claim 1, wherein each activity of interest comprises at least one rule element and at least one combinator.

6. The system of claim 1, further comprising:

an alert interface engine coupled to the activity inference engine to generate an alert; and

a report generation engine coupled to the alert interface engine to generate a report based on one or more alerts received from the alert interface engine.

7. The system of claim 1, wherein the at least one banking business process comprises at least one of:

physical security, public safety, loss prevention, and/or business intelligence data gathering.

8. The system of claim 7, wherein the physical security banking business process comprises detection of at least one of:

intrusion, vandalism, unauthorized access to a secure bank area, illegal number of people in a secure area, suspicious behavior around cars in a parking lot, suspicious behavior around an automated teller machine (ATM), a change in the appearance of an ATM, camera tampering, a customer reaching over the teller station and grabbing money;

a person holding a gun, and/or employees violating internal processes.

9. The system of claim 7, wherein the public safety banking business process comprises detection of at least one of:

people slipping and/or falling on bank property, people or vehicles moving at excessive speed on bank property, an assault, an abduction, an obstruction of a safety exit, an illegally parked vehicle, high density crowding, an abandoned package, and/or a vehicle proceeding in the wrong direction in a drive-through teller window.

10. The system of claim 7, wherein the intelligence data monitoring banking business process comprises at least one of:

tracking people through the bank area to determine a number of people entering and/or exiting the bank area, tracking people in the bank area to determine where the people stay in the bank area, monitoring a queue length, monitoring bank cleanliness, monitoring an unattended delivery, and/or monitoring banking employee-customer interactions.

11. The system of claim 1, further comprising:

an external primitive generator to convert external information into external primitives;

wherein the user interface defines at least one activity of interest regarding the bank area being viewed and the external information;

wherein each activity of interest identifies a rule and/or a query regarding the bank area being viewed and its relationship to the external information; and

wherein the activity inference engine additionally processes the external primitives, according to the banking business process, based on each activity of interest to determine if any activity of interest occurred in the video in combination with the external information.

12. The system of claim 11, wherein the at least one banking business process comprises at least one of:

physical security, public safety, loss prevention, and/or business intelligence data gathering.

13. The system of claim 12, wherein the physical security banking business process comprises detection of at least one of:

suspicious behavior around an ATM, and/or a suspicious transaction by a bank teller.

14. The system of claim 1, wherein each activity of interest defines a rule and/or a query selectively identified by a user regarding the bank area being viewed.

15. The system of claim 1, further comprising:

an alert interface to create alerts; and

a data combination and inference engine adapted to combine external data from an external data source with an alert from the alert interface to infer combined events based on a set of rules and queries, wherein the combining is done in parallel with the video processing, and to generate at least one of;

a combination alert, or a report.

16. A method for video monitoring at least one banking business process comprising:

obtaining video of a bank area from a video camera;

processing the video obtained from the video camera and generating video primitives regarding the video;

defining at least one activity of interest regarding the bank area being viewed, wherein each activity of interest identifies a rule and/or a query regarding the bank area being viewed; and

processing the video primitives according to a banking business process, based on at least one activity of interest regarding the bank area being viewed to determine if any activity of interest occurred in the video, wherein the at least one activity of interest defines a rule and/or a query selectively identified by a user regarding the bank area being viewed;

creating an alert when an activity of interest occurs;

combining external data from an external data source with the alert and inferring combined events based on a set of rules and queries, wherein the combining is done in parallel with the video processing; and

generating at least one of;

a combination alert, and/or a report.

17. The method of claim 16, further comprising:

converting external information into external primitives;

wherein defining at least one activity of interest includes defining at least one activity of interest regarding the bank area being viewed and the external information, wherein each activity of interest identifies a rule and/or a query regarding the bank area being viewed and its relationship to the external information; and

wherein processing the video primitives includes processing the video primitives and the external primitives, according to a banking business process, based on each activity of interest to determine if any activity of interest occurred in the video in combination with the external information.

18. A computer-readable medium comprising software for video monitoring at least one banking business process, which when executed by a computer system, cause the computer system to perform operations comprising a method of:

processing video of a bank area obtained by a video camera and generating video primitives regarding the video;

defining at least one activity of interest regarding the bank area being viewed, wherein each activity of interest identifies a rule and/or a query regarding the bank area being viewed;

processing the video primitives according to a banking business process, based on at least one activity of interest regarding the bank area being viewed to determine if any activity of interest occurred in the video, wherein the at least one activity of interest defines a rule and/or a query selectively identified by a user regarding the bank area being viewed;

creating an alert when an activity of interest occurs;

combining external data from an external data source with the alert and inferring combined events based on a set of rules and queries, wherein the combining is done in parallel with the video processing; and

generating at least one of;

a combination alert, and/or a report.

19. The computer-readable medium of claim 18, the operations further comprising:

converting external information into external primitives;

wherein defining at least one activity of interest includes defining at least one activity of interest regarding the bank area being viewed and the external information, wherein each activity of interest identifies a rule and/or a query regarding the bank area being viewed and its relationship to the external information; and

wherein processing the video primitives includes processing the video primitives and the external primitives, according to a banking business process, based on each activity of interest to determine if any activity of interest occurred in the video in combination with the external information.

20. An apparatus for video monitoring at least one banking business process comprising:

a video analytics engine to process video of a bank area obtained by a video camera and to generate video primitives regarding the video;

an activity inference engine to process the video primitives from the video analytics engine according to a banking business process, based on at least one activity of interest regarding the bank area being viewed to determine if any activity of interest occurred in the video, wherein each activity of interest defines a rule and/or a query selectively identified by a user regarding the bank area being viewed; and

a data combination and inference engine adapted to combine external data from an external data source with an alert to infer combined events based on a set of rules and queries, wherein the combining is done in parallel with the video processing, and to generate at least one of;

combination alerts, and/or reports.

21. The apparatus of claim 20, wherein the video analytics engine is resident within a chip, a chip set, or chips.

22. The apparatus of claim 20, wherein the video analytics engine and the activity inference engine are both resident within a chip, a chip set, or chips.

23. The apparatus of claim 20, further comprising:

an external primitive engine to convert external information into external primitives; and

wherein the activity inference engine processes the video primitives and the external primitives, according to a banking business process, based on each activity of interest regarding the bank area being viewed and the external information, wherein each activity of interest identifies a rule and/or a query regarding the bank area being viewed and its relationship to the external information, to determine if any activity of interest occurred in the video in combination with the external information.