SECURITY-MONITORING IMPLEMENTING CUSTOMER RECOGNITION VIA AN AUGMENTED REALITY DISPLAY

• US 20150294322A1
• Filed: 04/11/2014
• Published: 10/15/2015
• Est. Priority Date: 04/11/2014
• Status: Abandoned Application

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Grigg, David M., Starbuck, Richard Andrew, Hanson, Carrie Anne, Jones, Alicia C.
• Application Number:
  US14/250,972
• Publication Number:
  US 20150294322A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06Q 10/0635 Risk analysis of enterprise or organisation activities
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Systems, apparatus, and computer program products are provided for security-monitoring at a place of business by automatically determining which individuals within a business location, such as a retail store, banking center or the like, are established customers of the business. Such a determination of established customer status is conducted without requiring any action on behalf of the individuals/customers and may be accomplished proximate in time to the individuals arriving at the business location. Once the established customers have been determined, the present invention provides for attaching customer identifiers to the established customers appearing within a live video stream displayed by the security-monitoring system to thereby create an augmented reality environment within the display.

Claims

1. A system for monitoring security at a business location implementing customer recognition and identification of established customers within a business location, the apparatus comprising:

one or more security-monitoring apparatus including a memory, a processor in communication with the memory, an image-capturing device in communication with the processor and a display in communication with the processor and configured to display a live video stream captured by the image-capturing device; and

a customer recognition and identification module stored in the memory, executable by the processor and configured to;

receive, from the image-capturing device, the live video stream of the business location occupied by one of more individuals

determine which of the individuals within the live video stream are established customers of the business, and

present, within the display, one or more customer identifiers within the live video stream, wherein each of the identifiers attaches to a corresponding established customer and follows the corresponding established customer as they move within the live video stream.

2. The system of claim 1, wherein the customer recognition and identification module is further configured to determine which of the individuals within the live video stream are established customers by:

capturing, by the image-capturing device, a facial image of the individuals;

determining one or more matches between the facial images of the individuals and facial images of established customers by comparing characteristics of the facial images of the individuals to a database of facial images of established customers; and

identifying one or more individuals within the view as established customers based on the one or more determined matches.

3. The system of claim 1, wherein the customer recognition and identification module is further configured to determine which of the individuals within the live video stream are established customers by:

receiving an electronic communication from mobile communication devices in possession of corresponding individuals displayed within the live video stream, wherein the electronic communication is communicated from the mobile communication device (1) absent user input and (2) based on the mobile communication device being located within boundaries of the business location; and

determining that the individual in possession of the mobile communication device is an established customer based on information in the electronic communication.

4. The system of claim 3, wherein the customer recognition and identification module is further configured to determine which of the individuals within the live video stream are established customers by receiving the electronic communication, wherein the electronic communication is a token that identifies the individual in possession of the mobile communication device as the established customer.

5. The system of claim 3, wherein the customer recognition and identification module is further configured to determine the location of the mobile communication devices that have been determined to be in possession of the established customers, and wherein the customer identifiers are presented, within the display of the security-monitoring apparatus, proximate to the location of the mobile communication devices.

6. The system of claim 1, wherein the customer recognition and identification module is further configured to provide the user selectable access to display, on the display of the security-monitoring apparatus, of customer profile information associated with each of the established customer.

7. The system of claim 6, wherein the customer recognition and identification module is further configured to provide the user selectable access to display, on the display of the security-monitoring apparatus, of the customer profile information, wherein the customer profile information includes risk-related data associated with the established customer.

8. The system of claim 6, wherein the customer recognition and identification module is further configured to provide the user selectable access to display, on the display of the security-monitoring apparatus, of the customer profile information including at least one of customer status, customer affinity, accounts held by the established customer at the business or products purchased at the business by the established customer.

9. A method for monitoring security at a business location implementing customer recognition and identification established customers within a business location, the method comprising:

receiving, from an image-capturing device included in a security-monitoring apparatus, a live video stream of the business location occupied by one of more individuals;

determining, by a computing device processor, which of the individuals within the live video stream are established customers of the business; and

presenting, within a display of the security-monitoring apparatus, one or more customer identifiers within the live video stream, wherein each of the identifiers attaches to a corresponding established customer and follows the corresponding established customer as they move within the live video stream.

10. The method of claim 9, wherein determining which of the individuals within the video stream are established customers further comprises:

capturing, by a computing device processor, a facial image of one or more of the individuals from the live video stream;

determining, by a computing device, one or more matches between the facial images of the individuals and facial images of established customers by comparing characteristics of the facial images of the individuals to a database of facial images of established customers; and

identifying, by a computing device, one or more individuals within the view as established customers based on the one or more determined matches.

11. The method of claim 9, wherein determining which of the individuals within the live video stream are established customers further comprises:

receiving, by a computing device processor, an electronic communication from mobile communication devices in possession of corresponding individuals within the view, wherein the electronic communication is a token that identifies the individual in possession of the mobile communication device as the established customer and is communicated from the mobile communication device (1) absent user input and (2) based on the mobile communication device being located within boundaries of the business location; and

determining, by a computing device processor, that the individual in possession of the mobile communication device is an established customer based on information in the electronic communication.

12. The method of claim 11, further comprising determining, by a computing device processor, the location of the mobile communication devices determined to be in possession of the established customers and wherein presenting, within the display of the security-monitoring apparatus, the one or more customer identifiers further comprises presenting, within the display of the security-monitoring apparatus, the one or more customer identifiers proximate to the location of the mobile communication devices.

13. The method of claim 9, further comprising providing, by a computing device processor, selectable access to display, on the display of the security-monitoring apparatus, of customer profile information associated with each of the established customer, wherein the customer profile information includes risk-related information.

14. The method of claim 9, further comprising providing, by a computing device processor, selectable access to display, on the OHMD, of customer profile information associated with each of the established customer, wherein the customer profile information includes at least one of customer status, customer affinity, accounts held by the established customer at the business or products purchased at the business by the established customer.

15. A computer program product comprising:

a non-transitory computer-readable medium comprising;

a first set of codes for causing a computer to capture, by an image-capturing device included with a security-monitoring system, live video stream of a business location occupied by one of more individuals;

a second set of codes for causing a computer to determine which of the individuals displayed within the live video stream are established customers of a business; and

a third set of codes for causing a computer to present, within a display of the security-monitoring apparatus, one or more customer identifiers within the live video stream, wherein each of the identifiers attaches to a corresponding established customer and follows the corresponding established customer as they move within the live video stream.

16. The computer program product of claim 15, wherein the second set of codes is further configured to cause the computer to (1) capture a facial image of one or more of the individuals in the live video stream, (2) determine one or more matches between the facial images of the individuals and facial images of established customers by comparing characteristics of the facial images of the individuals to a database of facial images of established customers, and (3) identify one or more individuals within the live video stream as established customers based on the one or more determined matches.

17. The computer program product of claim 15, wherein the second set of codes is further configured to cause the computer to (1) receive an electronic communication from mobile communication devices in possession of corresponding individuals within the live video stream, wherein the electronic communication is a token that identifies the individual in possession of the mobile communication device as the established customer and is communicated from the mobile communication device absent user input and based on the mobile communication device being located within boundaries of the business location, and (2) determine that the individual in possession of the mobile communication device is an established customer based on information in the electronic communication.

18. The computer program product of claim 17, further comprising a fourth set of codes for causing a computer to determine the location of the mobile communication devices determined to be in possession of the established customers and the third set of codes is further configured to cause the computer to present, within the display of the security-monitoring apparatus, the one or more customer identifiers proximate to the location of the mobile communication devices.

19. The computer program product of claim 15, wherein the third set of codes is further configured to cause the computer to provide selectable access to display, on the display of the security-monitoring apparatus, of customer profile information associated with each of the established customers, wherein the customer profile information includes risk-related information associated with the established customer.

20. The computer program product of claim 15, wherein the third set of codes is further configured to cause the computer to provide selectable access to display, on the display of the security-monitoring apparatus, of customer profile information associated with each of the established customers, wherein the customer profile information includes at least one of customer status, customer affinity, accounts held by the established customer at the business or products purchased at the business by the established customer.