SYSTEM AND METHOD FOR SITE ABNORMALITY RECORDING AND NOTIFICATION

• US 20130030875A1
• Filed: 07/29/2011
• Published: 01/31/2013
• Est. Priority Date: 07/29/2011
• Status: Abandoned Application

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: LEE, Kuo-Chu, LIU, Lipin, OZDEMIR, Hasan Timucin, YU, Jannite
• Application Number:
  US13/193,962
• Publication Number:
  US 20130030875A1
• Time in Patent Office: Days
• US Class Current: 705/7.38
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06Q 10/06311 Scheduling, planning or task assignment for a person or group
• CPC Class Codes: G06Q 10/0633 Workflow analysis
• CPC Class Codes: G06Q 10/0639 Performance analysis of employees; Performance analysis of enterprise or organisation operations
• CPC Class Codes: G06Q 30/0211 Determining the effectiveness of discounts or incentives
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06Q 30/0271 Personalized advertisement
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 50/12 Hotels or restaurants

Abstract

Method of notifying a user of site abnormalities via an application configured to access an event server having a first sensor abnormality detector connected to a first sensor, for detecting first abnormal behavior of first sub-events sensed by the first sensor, the first abnormal behavior corresponding to a first abnormal behavior value, a second sensor abnormality detector connected to a second sensor, for detecting second abnormal behavior of second sub-events sensed by the second sensor of a type different from the first sensor, the second abnormal behavior corresponding to a second abnormal behavior value, a correlator for correlating the first and second abnormal behavior values and logging correlated values as a composite event, a data store, the application having a viewer configured to show, on the device, data associated with a plurality of composite events, the viewer further configured to display the plurality of composite events in a temporal order.

Claims

1. A method of notifying a user of site abnormalities via an application, the application configured to access an event server, the event server having:

a first sensor abnormality detector connected to a first sensor, for detecting first abnormal behavior of first sub-events sensed by the first sensor, the first abnormal behavior corresponding to a first abnormal behavior value representing the degree of the first abnormal behavior compared to statistical distributions determined from the first sub-events sensed by the first sensor;

a second sensor abnormality detector connected to a second sensor, for detecting second abnormal behavior of second sub-events sensed by the second sensor of a type different from the first sensor, the second abnormal behavior corresponding to a second abnormal behavior value representing the degree of the second abnormal behavior compared to statistical distributions determined from the second sub-events sensed by the second sensor;

a correlator for correlating the first and second abnormal behavior values and logging correlated values as a composite event, the composite event corresponding to at least one said first sub-event and at least one said second sub-event;

a data store configured to store data associated with the first sensor and the second

sensor, and data associated with the composite event;

the method comprising;

receiving a request for the application from a device remote from the event server;

transmitting the application to the device; and

accessing the event server, the application having a viewer configured to show, on the device, data associated with a plurality of composite events, the viewer further configured to display the plurality of composite events in a temporal order.

2. The method according to claim 1, wherein the viewer is further configured to display, within each composite event, first sub-event data and second sub-event data associated with the second sensor.

3. The method according to claim 2, wherein the first sub-event data is identified using a first icon type, and wherein the second sub-event data is identified using a second icon type different from the first icon type.

4. The method according to claim 1, wherein the viewer further includes a list, the list comprising first and second sub-events.

5. The method according to claim 1, wherein each composite event is differently color coded by the viewer.

6. The method according to claim 1, wherein the viewer further includes a map of the site configured to show a location of each composite event in relation to the site.

7. The method according to claim 1, wherein the application is configured to access a plurality of networked event servers.

8. The method according to claim 1, further comprising:

selecting a displayed composite event; and

displaying data associated with the selected displayed composite event, the data including at least one of recorded first sub-events sensed by the first sensor and recorded second sub-events sensed by the second sensor.

9. The method according to claim 8, wherein the data further includes metadata of at least one of recorded first sub-events sensed by the first sensor and recorded second sub-events sensed by the second sensor.

10. The method according to claim 1, wherein data associated with the first sensor and data associated with the second sensor includes metadata, the metadata including at least one of date, time, location, quality and keyword.

11. The method according to claim 1, wherein:

the first sensor is one of a camera, point-of-sale terminal, unified communication device, customer relations manager, sound recorder, access control point, motion detector, biometric sensor, speed detector, temperature sensor, gas sensor and location sensor; and

the second sensor is another of a camera, POS terminal, unified communication device, customer relations manager, sound recorder, access control point, motion detector, biometric sensor, speed detector, temperature sensor, gas sensor and location sensor.

12. The method according to claim 1, wherein the viewer is further configured to backtrack and display the plurality of composite events in a temporal order.

13. The method according to claim 1, wherein:

at least one of the first sub-events and the second sub-events comprise key and non-key sub events; and

the non-key sub events are correlated as a composite event based on back-tracking key-sub events to non-key sub events.

14. A system for notifying a user of site abnormalities, the system comprising:

an event server comprising;

a first sensor abnormality detector connected to a first sensor, for detecting first abnormal behavior of first sub-events sensed by the first sensor, the first abnormal behavior corresponding to a first abnormal behavior value;

a second sensor abnormality detector connected to a second sensor, for detecting second abnormal behavior of first sub-events sensed by the second sensor of a type different from the first sensor, the second abnormal behavior corresponding to a second abnormal behavior value;

a correlator for correlating the first and second abnormal behavior values and logging the correlated values as a composite event, the composite event corresponding to at least one said first sub-event and at least one said second sub-event; and

a data store configured to store data associated with the first sensor and the second sensor, and data associated with the composite event; and

an interface configured to show data associated with a plurality of the composite events, the interface comprising a viewer configured to display the plurality of composite events in temporal order.

15. At least one non-transitory computer-readable medium readable by a computer for notifying a user of site abnormalities, the at least one non-transitory computer-readable medium comprising:

a first sensor abnormality detecting code segment that, when executed, detects first abnormal behavior of first sub-events sensed by a first sensor, the first abnormal behavior corresponding to a first abnormal behavior value;

a second sensor abnormality detecting code segment that, when executed, detects second abnormal behavior of second sub-events sensed by a second sensor of a type different from the first sensor, the second abnormal behavior corresponding to a second abnormal behavior value;

a correlating code segment that, when executed, correlates the first abnormal behavior value and the second abnormal behavior value and logs the correlated value as a composite event, the composite event corresponding to at least one said first sub-event and at least one said second sub-event; and

a data storing code segment that, when executed, stores data associated with the first sensor and the second sensor, and data being associated with the composite event;

a displaying code segment that, when executed, displays data associated with a plurality of composite events; and

a viewing code segment that, when executed, displays the plurality of composite events in a temporal order.

16. A method of managing a plurality of queues at a site, the method comprising:

detecting, using a video imager, each face of a plurality of customers each in a queue of the plurality of queues, based on face data corresponding to a face value of a unique face;

transmitting the face data to a customer table processor and a queue statistics processor;

determining, using the face value and the customer table processor, how long each customer has been in a respective queue of the plurality of queues;

determining, based on how long each customer has been in the respective queues, an average waiting time for each queue of the plurality of queues.

17. The method of managing a plurality of queues at a site of claim 16, wherein said determining the average waiting time for each queue further comprises using cashier performance data.

18. A method of personalized marketing, comprising:

detecting, using at least one video imager of a plurality of video imagers located throughout a site, a unique customer based on a customer face at the site based on face data corresponding to a face value of a unique face;

creating an image relating to advertised items to be displayed to the customer based on characteristics of the detected unique customer;

tracking, using a trajectory of the customer determined by the plurality of video imagers, the detected unique customer throughout the site;

determining, using data corresponding to the tracked detected unique customer, areas of the site visited by the unique customer; and

correlating the areas of the site visited by the unique customer with the advertised items.

19. The method of personalized marketing of claim 18, further comprising altering the created image based on correlating the areas of the site visited by the unique customer with the advertised items.

20. The method of personalized marketing of claim 18, further comprising providing the unique customer with an incentive based on correlating the areas of the site visited by the unique customer with the advertised items.