Systems and methods for implementing retail processes based on machine-readable images and user gestures

• US 10,019,149 B2
• Filed: 11/28/2014
• Issued: 07/10/2018
• Est. Priority Date: 01/07/2014
• Status: Active Grant

• Current Assignee: Toshiba Global Commerce Solutions Holdings Corporation (Toshiba Corporation)
• Original Assignee: Toshiba Global Commerce Solutions Holdings Corporation (Toshiba Corporation)
• Inventors: Chirakan, Jason, Hanthorn, Douglas, Herring, Dean F., Singh, Ankit
• Primary Examiner(s): RUDY, ANDREW J
• Application Number:
  US14/555,749
• Publication Number:
  US 20150193115A1
• Time in Patent Office: 1,320 Days
• Field of Search: 705 268, 705 2681, 715716, 715800, 715810, 715848, 715863
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06Q 30/0641 Shopping interfaces

Abstract

Systems and methods for implementing retail processes based on machine-readable images and user gestures are disclosed. According to an aspect, a method includes capturing one or more images including a machine-readable image and a user hand gesture. The method also includes identifying the machine-readable image as being associated with a product. Further, the method includes determining whether the user hand gesture interacts with the machine-readable image in accordance with a predetermined gesture. The method also includes implementing a predetermined retail process in association with the product in response to determining that the user hand gesture interacts with the machine-readable image in accordance with the predetermined gesture.

Claims

1. A method comprising:

capturing, using an image capture device, one or more images including a machine-readable image and a user hand gesture;

identifying the machine-readable image as being associated with a product;

integrating the identified machine-readable image and the user hand gesture into an augmented reality interface;

identifying the user hand gesture as it interacts with the machine-readable image in a three-dimensional (3D) space, wherein the user hand gesture interaction occurs in the three dimensional space outside a same plane as the machine-readable image within the augmented reality interface;

determining whether the identified user hand gesture in 3D space is in accordance with a predetermined gesture; and

in response to determining that the identified user hand gesture in 3D space is in accordance with the predetermined gesture, executing a predetermined retail process in association with the product.

2. The method of claim 1, wherein the machine-readable image is one of a barcode, a two-dimensional code, a three-dimensional code, a portion of the product, and a product label, and wherein the machine-readable image represents data that identifies the product, and

wherein identifying the machine-readable image comprises interpreting the data to identify the product.

3. The method of claim 1, wherein the predetermined gesture comprises one of a swipe gesture and a point gesture with respect to the machine-readable image.

4. The method of claim 1, wherein the predetermined gesture comprises one or more fingers of a user gesturing with respect to the machine-readable image.

5. The method of claim 1, wherein the predetermined gesture comprises a tapping of the one or more fingers with respect to the machine-readable image.

6. The method of claim 1, wherein the predetermined gesture comprises drawing a geometric shape with the one or more fingers with respect to the machine-readable image.

7. The method of claim 1, wherein the predetermined gesture comprises a three-dimensional movement gesture with respect to the machine-readable image.

8. The method of claim 1, wherein the predetermined gesture comprises determining one or more fingers of a first hand and one or more fingers of a second hand gesturing with respect to the machine-readable image.

9. The method of claim 1, wherein the predetermined gesture comprises one or more fingers on a first hand moving relative to one or more fingers on a second hand for gesturing with respect to the machine-readable image.

10. The method of claim 1, further comprising determining predetermined user input into a computing device, and

wherein implementing the predetermined retail process comprises implementing the predetermined retail process based on the predetermined user input.

11. The method of claim 10, wherein the predetermined user input includes one or more of sound, another user gesture, and user input.

12. A computing device comprising:

an image capture device configured to capture one or more images including a machine-readable image and a user hand gesture; and

a retail process manager including at least a processor and memory configured to;

identify the machine-readable image as being associated with a product;

integrate the identified machine-readable image and the user hand gesture into an augmented reality interface;

identify the user hand gesture as it interacts with the machine-readable image in a three-dimensional (3D) space, wherein the user hand gesture interaction occurs in the three dimensional space outside a same plane as the machine-readable image within the augmented reality interface;

determine whether the identified user hand gesture is in accordance with a predetermined gesture;

and

execute a predetermined retail process in association with the product in response to determining that the user hand gesture is in accordance with the predetermined gesture.

13. The computing device of claim 12, wherein the machine-readable image is one of a barcode, a two-dimensional code, a three-dimensional code, a portion of the product, and a product label, and wherein the machine-readable image represents data that identifies the product, and

wherein the retail process manager is configured to interpret the data to identify the product.

14. The computing device of claim 12, wherein the retail process manager is configured to determine one of a swipe gesture and a point gesture with respect to the machine-readable image.

15. The computing device of claim 12, wherein the retail process manager is configured to determine whether one or more fingers of one or more hands of a user gesture with respect to the machine-readable image.

16. The computing device of claim 12, wherein the retail process manager is configured to determine a tapping of the one or more fingers with respect to the machine-readable image.

17. The computing device of claim 12, wherein the retail process manager is configured to determine a drawing of a geometric shape with the one or more fingers with respect to the machine-readable image.

18. The computing device of claim 12, wherein the retail process manager is configured to determine a three-dimensional movement gesture with respect to the machine-readable image.

19. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions readable by a computing device to cause the computing device to:

receive, by the computing device, one or more captured images including a machine-readable image and a user hand gesture;

identify, by the computing device, the machine-readable image as being associated with a product;

integrate the identified machine-readable image and the user hand gesture into an augmented reality interface;

identify the user hand gesture as it interacts with the machine-readable image in a three-dimensional (3D) space, wherein the user hand gesture interaction occurs in the three dimensional space outside a same plane as the machine-readable image within the augmented reality interface;

determine whether the identified user hand gesture is in accordance with a predetermined gesture;

and

execute a predetermined retail process in association with the product in response to determining that the user hand gesture is in accordance with the predetermined gesture.