Method and system for automated retail checkout using context recognition

• US 10,290,031 B2
• Filed: 07/02/2014
• Issued: 05/14/2019
• Est. Priority Date: 07/24/2013
• Status: Active Grant

• Current Assignee: Volitional Partners, Inc.
• Original Assignee: Volitional Partners, Inc.
• Inventors: Reid, Gregorio
• Primary Examiner(s): Fadok, Mark A
• Application Number:
  US14/322,204
• Publication Number:
  US 20150039458A1
• Time in Patent Office: 1,777 Days
• CPC Class Codes: A61B 5/112 Gait analysis
• CPC Class Codes: A61B 5/117 Identification of persons methods or arrangements for recognising patterns, e.g. fingerprints, G06F18/00, G06V40/00; identification of persons by analysing their voice or speech G10L17/00
• CPC Class Codes: A61B 5/1176 Recognition of faces
• CPC Class Codes: G06Q 20/20 Point-of-sale [POS] network systems
• CPC Class Codes: G06Q 20/40145 Biometric identity checks
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G07G 1/0036 Checkout procedures

Abstract

A gestural checkout system includes a sensor-equipped server programmed with a gestural context application that authenticates a customer'"'"'s identity upon entry to a retail store. The sensors include cameras. The sensors are identify products and detect gestures of the customer indicating a purchase decisions. Gestures include product pick-up, product movement and product-commit-to-container actions. For bulk items, an Implicit Gestural Scale communicates product identity and volumetric data wirelessly to the implicit gestural checkout. Recognition of shopper locomotion, past a line of demarcation near the exit, automatically authorizes electronic payment.

Claims

1. A method for enabling a customer having an identity to purchase goods from a retail store through the use of implicit gestures and a customer financial account, comprising:

providing a server in communication with the retail store, the retail store including a demarcation zone, for enabling check-out, wherein the server includes one or more processors, computer memory with software, the software being programmed for enabling operation of the server to communicate with a plurality of sensors;

providing a first and second plurality of sensors, in operable communication with the server, wherein the first plurality of sensors are optical sensors, and the second plurality of sensors are different from the first plurality of sensors;

sensing biometric information of the customer with the first plurality of sensors and converting at least some of the biometric information into topological variations, communicating the biometric information to the server to enable the server to authenticate customer identity;

tracking movement of the customer within the retail store with the second plurality of sensors;

recognizing gestures indicating a purchase decision;

tracking the purchase decision in an electronic shopping cart;

the topological variations are then animated within a gaming engine having a virtual camera, where the gaming engine'"'"'s virtual camera is used to capture multiple points-of-view from various locations around the customer, these points of view correspond to the perspectives taken from the first plurality of sensors;

and

enabling a checkout procedure when the customer is passing the demarcation zone by charging the customer financial account based on the purchase decision.

2. A method as set forth in claim 1, wherein the demarcation zone is positioned adjacent a store exit.

3. A method as set forth in claim 1, wherein the first plurality of sensors include optical sensors enable facial recognition and the server is programmed with facial recognition software to authenticate customer identity.

4. A method as set forth in claim 1, wherein the first plurality of sensors enable gait recognition and facial recognition, and the server is programmed with gait and facial recognition software to authenticate customer identity.

5. A method as set forth in claim 1, wherein the second plurality of sensors include acoustic sensors to track movement of the customer within the retail store and to recognize purchase decisions.

6. A method as set forth in claim 1, wherein each of the plurality of sensors communicate wirelessly with the server and are positioned in an array within the retail store.

7. A method as set forth in claim 1, wherein the customer has a hand, and the store has products placed on shelves, the step of recognizing implicit gestures includes optically recognizing movement of the hand to move a product from the shelf.

8. A method as set forth in claim 7, wherein the retail store provides shopping carts or the shopper brings their own shopping container, the step of recognizing implicit gestures includes 3D depth sensor/video recognition of movement of the product into a shopping container.

9. A method as set forth in claim 7, wherein the plurality of sensors detect the moved product to identify the product, the sensors communicate with the server to enable the server to determine a product price, the product price is recorded by the server.

10. A method as set forth in claim 9, wherein the first plurality of sensors detect multiple products moved by the customer to tally product prices and charge the customer financial account.

11. A system for enabling a customer having an identity to purchase goods from a retail store through the use of implicit gestures, a portable electronic device, and a customer financial account, comprising:

a server located within the retail store, wherein the server includes one or more processors, computer memory with software, the software being programmed for enabling operation of the server to communicate with a plurality of sensors;

a portable electronic device in operable communication with the server to allow a customer to accept or reject a purchase decision;

a first and second plurality of sensors in operable communication with the server for sensing customer biometric information and communicating the customer biometric information to the server to authenticate customer identity, and to associate the customer identity with a customer financial account;

the first and second plurality of sensors enable tracking movement within the retail store and recognizing gestures of the customer indicating a purchase decision;

the first and second plurality of sensors track the purchase decision indicated by a customer gesture, the customer gesture including picking up a product, moving the product and placing the product in a container, at least one of the first and second plurality of sensors detect topological variations in the product;

the topological variations are then animated within a gaming engine having a virtual camera, where the gaming engine'"'"'s virtual camera is used to capture multiple points-of-view from various locations around the product, these points of view correspond to the perspectives taken from the at least one of the first and second plurality of sensors, and

the server enables a checkout procedure when the customer is detected by the third plurality of sensors as placing the product in the container by communicating the purchase decision to the portable electronic device for customer approval.

12. The system set forth in claim 11, wherein the retail store has an exit with a demarcation zone, the step of communicating the purchase decision and charging the customer financial account is initiated upon movement of the customer in the demarcation zone.

13. The system set forth in claim 11, wherein the first plurality of sensors include optical sensors having facial recognition capability and the server is programmed with facial recognition software to authenticate customer identity.

14. The system set forth in claim 11, wherein the server tracks the purchase decision when the customer removes a product from a shelf and places the product into a container;

the server communicates the purchase decision to the portable electronic device, and

the step of communication enables the customer to display information pertaining to the product with the portable electronic device.

15. The system set forth in claim 11, wherein the server also tracks the purchase decision if the customer removes the product from the container and re-places the product on to the shelf.

16. The system set forth in claim 11, wherein the server tracks the purchase decision when the customer places the product into a pocket of the customer.

17. The system set forth in claim 11, wherein the server tracks the purchase decision when the customer carries the product by hand through a demarcation zone defined within the retail store.

18. The system set forth in claim 11, wherein the server associates financial data with the customer, and charges the financial account when the customer passes a demarcation zone defined within the retail store.

19. The system set forth in claim 11, wherein the server associates financial data with the customer, and charges the financial account when the customer exits the retail store.

20. The system set forth in claim 11, wherein the server associates financial data with the customer, and charges the financial account after the customer exits the retail store.

21. The system set forth in claim 11, wherein the server is programmed with software to detect probably theft events, and the server reports probable theft events upon detection to store security personnel for verification, wherein a theft event includes where a customer gestures to conceal an item.