SYSTEM AND METHOD FOR PATTERN BASED THRESHOLDING APPLIED TO VIDEO SURVEILLANCE MONITORING

• US 20090189983A1
• Filed: 01/25/2008
• Published: 07/30/2009
• Est. Priority Date: 01/25/2008
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chen, Xiaoping, Brumfield, Sara Carlstead, Marshburn, Tara Leigh, Tipton, Sandra Lee
• Granted Patent: US 8,659,657 B2
• Time in Patent Office: Days
• US Class Current: 348/159
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream

Abstract

A system, method, and program product is provided that configures video handlers pertaining to a dependent individual. Configuring includes setting alert thresholds. Visual locations are configured. Visual images that pertain to caregivers of the dependent individual are configured. Video streams are received from video sources. Video streams are compared to configured locations to classify the dependent individual'"'"'s location. Video stream is analyzed to determine whether the dependent individual is alone or with others. If with others, a list of known persons is determined by comparing the video streams with the configured visual images. The configured video handlers are initiated based on the inputs of the location and the people present with the dependent individual. Video handlers trigger alerts when thresholds are reached. Alerts include performing actions to protect the dependent individual from harm.

Claims

1. A computer-implemented method comprising:

configuring a plurality of video handlers that pertain to a dependent individual, wherein the configuring of one or more of the video handlers includes setting an alert threshold;

configuring a plurality of visual locations, wherein one or more of the visual locations correspond to a habitat of the dependent individual;

configuring one or more of visual images that pertain to one or more caregivers of the dependent individual;

receiving one or more video streams from one or more video sources directed to the dependent individual;

classifying, based on comparing the video streams with the configured plurality of visual locations, a location of the dependent individual;

determining, based on analyzing the video streams with the configured plurality of visual images, whether the dependent individual is alone;

in response to determining that the dependent individual is not alone, classifying one or more of the people present with the dependent individual as one or more of the configured caregivers or as an unknown person;

initiating one or more of the video handlers based on the classified location, the determination, and the classified people present with the dependent individual; and

triggering, by one of the initiated video handlers, an alert that includes performing at least one action intended to protect the dependent individual.

2. The method of claim 1 further comprising:

configuring one or more of visual object images that pertain to one or more physical objects; and

classifying, based on comparing the video streams with the configured plurality of visual object images, one or more physical objects that are in proximity to the dependent individual, wherein the initiating includes initiating at least one of the video handlers based in part by the one or more physical objects classified as being in proximity to the dependent individual.

3. The method of claim 2 wherein the video handlers include a physical aggression video handler, a water proximity video handler, an inappropriate touching video handler, an unattended dependent individual video handler, a dangerous object video handler, and an unknown person video handler.

4. The method of claim 1 wherein the configuring of at least one of the video handlers includes selecting the action corresponding to the alert threshold and wherein the triggering of the configured video handler with the action setting includes performing the selected action.

5. The method of claim 4 wherein the action is selected from the group consisting of contacting law enforcement, sounding an audible alarm, contacting a managing caregiver, and contacting a fire department.

6. The method of claim 1 further comprising:

configuring a plurality of audio handlers that pertain to the dependent individual, wherein the configuring of one or more of the audio handlers includes setting an alert threshold;

configuring one or more of voice identities that pertain to one or more caregivers of the dependent individual;

configuring one or more audible samples that pertain to one or more inanimate objects;

receiving one or more audio streams from one or more audio sources directed to the dependent individual;

classifying, based on comparing the audio streams with the configured plurality of audible samples, one or more objects in proximity to the dependent individual;

classifying one or more of the people present with the dependent individual by comparing the voice identities with the audio streams;

initiating one or more of the audio handlers based on the proximity of the inanimate object; and

triggering, by one of the initiated audio handlers, a second alert that includes performing at least one second action intended to protect the dependent individual.

7. The method of claim 6 further comprising:

maintaining a log of the initiated video handlers and the initiated audio handlers, wherein the log includes a timestamp when the initiated video and audio handlers were initiated, a list of one or more classified locations where the dependent individual was located, a list of one or more objects in proximity to the dependent individual, and a list of one or more people in proximity to the dependent individual.

8. A information handling system comprising:

one or more processors;

a memory accessible by at least one of the processors;

a nonvolatile storage device accessible by at least one of the processors;

one or more video input devices that provide one or more digital video streams accessible by the one or more processors;

one or more audio input devices that provide one or more digital audio streams accessible by the one or more processors;

a set of instructions stored in the memory and executed by at least one of the processors in order to perform actions of;

configuring a plurality of video handlers that pertain to a dependent individual, wherein the configuring of one or more of the video handlers includes setting an alert threshold;

configuring a plurality of visual locations, wherein one or more of the visual locations correspond to a habitat of the dependent individual;

configuring one or more of visual images that pertain to one or more caregivers of the dependent individual;

receiving the digital video streams from the one or more video input devices, wherein the digital video streams are directed to the dependent individual;

classifying, based on comparing the digital video streams with the configured plurality of visual locations, a location of the dependent individual;

determining, based on analyzing the digital video streams with the configured plurality of visual images, whether the dependent individual is alone;

in response to determining that the dependent individual is not alone, classifying one or more of the people present with the dependent individual as one or more of the configured caregivers or as an unknown person;

initiating one or more of the video handlers based on the classified location, the determination, and the classified people present with the dependent individual; and

triggering, by one of the initiated video handlers, an alert that includes performing at least one action intended to protect the dependent individual.

9. The information handling system of claim 8 wherein the set of instructions, when executed, cause at least one of the processors to perform further actions comprising:

configuring one or more of visual object images that pertain to one or more physical objects; and

classifying, based on comparing the video streams with the configured plurality of visual object images, one or more physical objects that are in proximity to the dependent individual, wherein the initiating includes initiating at least one of the video handlers based in part by the one or more physical objects classified as being in proximity to the dependent individual.

10. The information handling system of claim 9 wherein the video handlers include a physical aggression video handler, a water proximity video handler, an inappropriate touching video handler, an unattended dependent individual video handler, a dangerous object video handler, and an unknown person video handler.

11. The information handling system of claim 8 wherein the configuring of at least one of the video handlers includes selecting the action corresponding to the alert threshold and wherein the triggering of the configured video handler with the action setting includes performing the selected action.

12. The information handling system of claim 11 wherein the action is selected from the group consisting of contacting law enforcement, sounding an audible alarm, contacting a managing caregiver, and contacting a fire department.

13. The information handling system of claim 8 wherein the set of instructions, when executed, cause at least one of the processors to perform further actions comprising:

configuring a plurality of audio handlers that pertain to the dependent individual, wherein the configuring of one or more of the audio handlers includes setting an alert threshold;

configuring one or more of voice identities that pertain to one or more caregivers of the dependent individual;

configuring one or more audible samples that pertain to one or more inanimate objects;

receiving one or more audio streams from one or more audio sources directed to the dependent individual;

classifying, based on comparing the audio streams with the configured plurality of audible samples, one or more objects in proximity to the dependent individual;

classifying one or more of the people present with the dependent individual by comparing the voice identities with the audio streams;

initiating one or more of the audio handlers based on the proximity of the inanimate object; and

triggering, by one of the initiated audio handlers, a second alert that includes performing at least one second action intended to protect the dependent individual.

14. The information handling system of claim 13 wherein the set of instructions, when executed, cause at least one of the processors to perform further actions comprising:

maintaining a log of the initiated video handlers and the initiated audio handlers, wherein the log includes a timestamp when the initiated video and audio handlers were initiated, a list of one or more classified locations where the dependent individual was located, a list of one or more objects in proximity to the dependent individual, and a list of one or more people in proximity to the dependent individual.

21. The computer program product of claim 14 wherein the receiving, retrieving, and transmitting are each performed by a backup proxy software application running on the VIOS, and wherein;

the receiving further including receiving the backup request through a communication channel managed by a hypervisor software application, wherein the backup request includes a backup initialization message and a management datagram, wherein the datagram identifies the virtual nonvolatile storage to be backed up;

the retrieving further including retrieving the data included in the nonvolatile storage identified in the management datagram; and

the transmitting further including;

initiating a backup session with the backup server, the initiating including sending one or more authentication keys from the client to the backup server; and

transmitting the retrieved data from the VIOS to the backup server after the initiating.

22. The computer program product of claim 14 further comprising functional descriptive material that causes the data processing system to perform additional actions that include:

establishing a communication channel between a software-based virtual network adapter running on the client and a software-based shared network adapter running on the VIOS, wherein the communication channel is managed by a hypervisor software application, and wherein the client, the VIOS and the hypervisor software application are executed by a computer system;

receiving, from the client, one or more authentication keys at the VIOS software-based shared network adapter,

establishing a connection between the software-based shared network adapter and a physical network adapter, wherein the hypervisor software application manages the physical network adapter, and wherein the physical network adapter connects the computer system to the computer network; and

transmitting, by the hypervisor software application, the authentication keys through the computer network to the backup server.

24. The computer program product of claim 14 further comprising functional descriptive material that causes the data processing system to perform additional actions that include:

sending the backup request from a backup software application running on the client to the VIOS; and

initializing a backup proxy software application running on the VIOS in response to receiving the backup request, wherein the backup proxy software application performs the retrieving and the transmitting.

25. The computer program product of claim 14 further comprising functional descriptive material that causes the data processing system to perform additional actions that include:

initiating a backup session with the backup server by sending an initiation request from the client to the backup server;

creating, at the client, the backup request, wherein the backup request includes a special management datagram that includes one or more authentication keys used in the backup session;

sending the backup request from the client to the VIOS;

transmitting the retrieved data from the VIOS to the backup server, the transmitting including;

creating one or more backup data packets using the retrieved data and the authentication keys included in the special management datagram; and

transmitting the backup data packets from the VIOS to the backup session initiated with the backup server.

26. The computer program product of claim 14 further comprising functional descriptive material that causes the data processing system to perform additional actions that include:

receiving a plurality of backup requests, including the backup request, from a plurality of VIOS clients, including the client of the VIOS, wherein the plurality of backup requests correspond to a plurality of virtual nonvolatile storage areas that include the virtual nonvolatile storage;

transmitting one or more sets of authentication keys corresponding to one or more of the plurality of backup requests from one or more of the plurality of clients;

establishing a plurality of backup sessions with one or more backup servers, that include the backup server, wherein one or more of the backup sessions are established using one or more of the sets of authentication keys;

retrieving a plurality of data sets from one or more nonvolatile storage devices, wherein one of the data sets includes the data and wherein one of the nonvolatile storage devices is the nonvolatile storage device; and

transmitting the data sets to the one or more backup servers via the computer network.

15. A computer program product stored in a computer readable medium, comprising functional descriptive material that, when executed by an information handling system, causes the information handling system to perform actions that include:

configuring a plurality of video handlers that pertain to a dependent individual, wherein the configuring of one or more of the video handlers includes setting an alert threshold;

configuring a plurality of visual locations, wherein one or more of the visual locations correspond to a habitat of the dependent individual;

configuring one or more of visual images that pertain to one or more caregivers of the dependent individual;

receiving one or more video streams from one or more video sources directed to the dependent individual;

classifying, based on comparing the video streams with the configured plurality of visual locations, a location of the dependent individual;

determining, based on analyzing the video streams with the configured plurality of visual images, whether the dependent individual is alone;

in response to determining that the dependent individual is not alone, classifying one or more of the people present with the dependent individual as one or more of the configured caregivers or as an unknown person;

initiating one or more of the video handlers based on the classified location, the determination, and the classified people present with the dependent individual; and

triggering, by one of the initiated video handlers, an alert that includes performing at least one action intended to protect the dependent individual.

16. The computer program product of claim 15 further comprising functional descriptive material that causes the data processing system to perform additional actions that include:

configuring one or more of visual object images that pertain to one or more physical objects; and

classifying, based on comparing the video streams with the configured plurality of visual object images, one or more physical objects that are in proximity to the dependent individual, wherein the initiating includes initiating at least one of the video handlers based in part by the one or more physical objects classified as being in proximity to the dependent individual.

17. The computer program product of claim 16 wherein the video handlers include a physical aggression video handler, a water proximity video handler, an inappropriate touching video handler, an unattended dependent individual video handler, a dangerous object video handler, and an unknown person video handler.

18. The computer program product of claim 15 wherein the configuring of at least one of the video handlers includes selecting the action corresponding to the alert threshold and wherein the triggering of the configured video handler with the action setting includes performing the selected action.

19. The computer program product of claim 18 wherein the action is selected from the group consisting of contacting law enforcement, sounding an audible alarm, contacting a managing caregiver, and contacting a fire department.

20. The computer program product of claim 15 further comprising functional descriptive material that causes the data processing system to perform additional actions that include:

configuring a plurality of audio handlers that pertain to the dependent individual, wherein the configuring of one or more of the audio handlers includes setting an alert threshold;

configuring one or more of voice identities that pertain to one or more caregivers of the dependent individual;

configuring one or more audible samples that pertain to one or more inanimate objects;

receiving one or more audio streams from one or more audio sources directed to the dependent individual;

classifying, based on comparing the audio streams with the configured plurality of audible samples, one or more objects in proximity to the dependent individual;

classifying one or more of the people present with the dependent individual by comparing the voice identities with the audio streams;

initiating one or more of the audio handlers based on the proximity of the inanimate object;

triggering, by one of the initiated audio handlers, a second alert that includes performing at least one second action intended to protect the dependent individual; and

maintaining a log of the initiated video handlers and the initiated audio handlers, wherein the log includes a timestamp when the initiated video and audio handlers were initiated, a list of one or more classified locations where the dependent individual was located, a list of one or more objects in proximity to the dependent individual, and a list of one or more people in proximity to the dependent individual.

23. The computer program product of claim 16 further comprising functional descriptive material that causes the data processing system to perform additional actions that include:

establishing a command-request queue between a software-based virtual client storage adapter running on the client and a software-based virtual storage adapter running on the VIOS, wherein the command-request queue is managed by the hypervisor software application; and

establishing a storage connection between the software-based virtual storage adapter running on the VIOS and a physical nonvolatile storage adapter that connects the computer system to a nonvolatile storage device where the virtual nonvolatile storage is stored, wherein the hypervisor software application manages the physical nonvolatile storage adapter.