Method and system for consumer transactions using voice or human based gesture actions

• US 10,043,209 B2
• Filed: 07/23/2012
• Issued: 08/07/2018
• Est. Priority Date: 11/19/2010
• Status: Active Grant

• Current Assignee: Mastercard International Incorporated (MasterCard Incorporated)
• Original Assignee: Mastercard International Incorporated (MasterCard Incorporated)
• Inventors: Cooke, Alan, Lyons, Garry, Cummins, Oran, Elder, Stephen, Ekselius, Lukas
• Primary Examiner(s): Pond, Robert M
• Application Number:
  US13/555,795
• Publication Number:
  US 20130066749A1
• Time in Patent Office: 2,206 Days
• Field of Search: 705 261- 272, 705 26
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers

Abstract

A method of initiating a consumer transaction using a human interaction device to read voice or human based gesture actions is disclosed. Video data is transmitted from a processing device to a display device. The video is monitoring for event data corresponding to a plurality of consumer products or services, and monitored event data is received in the processing device. A consumer is notified on the display device of an eligible consumer transaction. Voice or human based gesture actions are read with a human interaction device and are analyzed. If the voice or human based gesture actions conform to a predetermined set of requirements, then a consumer transaction for the plurality of consumer products or services is initiated.

Claims

1. A method for initiating a consumer transaction, comprising:

transmitting video data from a processing device to a video display device;

receiving, in the processing device, event data corresponding to a plurality of consumer products or services;

monitoring, in the processing device, the transmitted video data for an event corresponding to the received event data;

determining, by the processing device, that the event corresponding to the received event data is occurring;

notifying a consumer, via the video display device, of an eligible consumer transaction, in response to the determination;

reading, by a human interaction device and in a contactless manner, human based gesture actions;

analyzing, by the processing device, the human based gesture actions;

initiating a consumer transaction for one or more goods or services corresponding to the occurring event if the human based gesture actions conform to a predetermined first set of interaction requirements;

transmitting, to one of the video display device and a display of a consumer device, an indication that the consumer transaction has been initiated, wherein the indication comprises a transaction identifier corresponding to the consumer transaction initiated based upon the human based gesture actions, the transaction identifier being configured to enable additional transaction details to be retrieved from a remote server;

reading, by the human interaction device and in a contactless manner, an additional human based gesture action, wherein the additional human based gesture action comprises a symbolic gesture;

analyzing, by the processing device, the additional human based gesture action;

determining, by the processing device, that the additional human based gesture action corresponds to a first predetermined symbolic gesture of a set of predetermined symbolic gestures each corresponding to a respective transaction option; and

receiving an indication that completion of the consumer transaction has been initiated based on the transaction option corresponding to the first predetermined symbolic gesture.

2. The method of claim 1, further comprising:

reading, by the human interaction device and in a contactless manner, additional human based gesture actions;

analyzing the additional human based gesture actions;

receiving indications of selected transaction options from a user if the additional human based gesture actions conform to a predetermined second set of interaction requirements;

transmitting the indications to a payee device; and

receiving the indication that completion of the consumer transaction has been initiated.

3. The method of claim 2, wherein the selected transaction options include at least one option selected from the group consisting of quantity, quality, color, and size.

4. The method of claim 2, wherein the selected transaction options include selection of a funding source.

5. The method of claim 2, wherein the selected transaction options include user selected shipping details.

6. The method of claim 1, wherein the human interaction device includes a camera and/or a microphone.

7. The method of claim 1, wherein the video display device and the human interaction device are a single device.

8. The method of claim 1, wherein the processing device, the video display device, and the human interaction device are a single device.

9. The method of claim 1, wherein the event data is included in a vertical blanking interval of the transmitted video data.

10. The method of claim 1, further comprising:

reading, by the human interaction device and in a contactless manner, a second additional human based gesture action, wherein the second additional human based gesture action is a symbolic gesture;

analyzing the second additional human based gesture action;

determining, by the processing device, that the human based gesture action corresponds to a second predetermined symbolic gesture of a second set of predetermined symbolic gestures each corresponding to a respective consumer;

and

receiving the indication that completion of the consumer transaction has been initiated.

11. The method of claim 10, wherein each predetermined symbolic gesture in the second set of predetermined symbolic gestures corresponds to a signature for the respective consumer.

12. The method of claim 10, wherein the initiation of the completion of the consumer transaction is based on the first predetermined symbolic gesture and the second predetermined symbolic gesture.

13. The method of claim 10, wherein the additional human based gesture action is read before the second additional human based gesture action is read.

14. The method of claim 13, wherein the second predetermined symbolic gesture is a signature associated with a payer.

15. An electronic method for initiating a transaction, comprising:

transmitting video data from a processing device to a video display device;

receiving, la the processing device, event data corresponding to one or more consumer products or services;

monitoring, la the processing device, the transmitted video data for an event corresponding to the received event data;

determining, by the processing device, that the event corresponding to the received event data is occurring;

generating a notification, on the video display device, of an eligible consumer transaction in response to the determination;

receiving a selection of at least one of the one or more products or services;

providing transaction details for a specific transaction for the at least one product or service, wherein the transaction details are received from a remote server;

reading, with a human interaction device and in a contactless manner, a human based gesture action;

analyzing, by the processing device, the human based gesture action;

determining, by the processing device, that the human based gesture action corresponds to a first predetermined symbolic gesture of a set of predetermined symbolic gestures each corresponding to a respective consumer; and

initiating, based on a transaction option associated with the consumer corresponding to the first predetermined symbolic gesture, a consumer transaction for the selected at least one product or service.

16. The method of claim 15, wherein each predetermined symbolic gesture in the set of predetermined symbolic gestures corresponds to a signature for the respective consumer.

17. The method of claim 15, further comprising:

reading, by the human interaction device and in a contactless manner, an additional human based gesture action;

analyzing, by the processing device, the additional human based gesture action;

determining, by the processing device, that the additional human based gesture action corresponds to a second predetermined symbolic gesture of a second set of one or more predetermined symbolic gestures each corresponding to a respective transaction option; and

receiving an indication that completion of the consumer transaction has been initiated based on the transaction option associated with the second predetermined symbolic gesture.

18. A system for initiating a consumer transaction, comprising:

a display device;

a human interaction device configured to read, in a contactless manner, and transmit human based gesture actions; and

a processing device configured to at least;

receive video data,

transmit the video data to the display device,

receive event data corresponding to a plurality of consumer products or services,

analyze the transmitted video data for an event corresponding to the received event data,

determine that the event corresponding to the received event data is occurring,

receive and analyze the human based gesture actions read in a contactless manner and transmitted by the human interaction device,

compare the human based gesture actions with a predetermined set of requirements,

initiate the consumer transaction for one or more goods or services corresponding to the occurring event if the human based gesture actions meet the predetermined first set of interaction requirements,

transmit, to one of the display device and a display of a consumer device, an indication that the consumer transaction has been initiated, wherein the indication comprises a transaction identifier corresponding to the consumer transaction initiated based upon the human based gesture actions, the transaction identifier being configured to enable additional transaction details to be retrieved from a remote server, wherein the display device is configured to receive the video data from the processing device and display the received video data,

analyze an additional human based gesture action read and transmitted by the human interaction device,

determine that the additional human based gesture action corresponds to a first predetermined symbolic gesture of a set of predetermined symbolic gestures each corresponding to a respective transaction option, and

receive an indication that completion of the consumer transaction has been initiated based on the transaction option corresponding to the first predetermined symbolic gesture.

19. The system of claim 18, wherein

the human interaction device is further configured to read in a contactless manner and transmit additional human based gesture actions, and

the processing device is further configured to receive and analyze the additional human based gesture actions, receive indications of payer selected transaction options from a user if the additional human based gesture actions conform to a predetermined second set of interaction requirements, transmit the indications to a payee device, and receive the indication that completion of the consumer transaction has been initiated.

20. The system of claim 19, wherein the payer selected transaction options include at least one option selected from the group consisting of quantity, quality, color, and size.

21. The system of claim 19, wherein the payer selected transaction options include selection of a funding source.

22. The system of claim 19, wherein the payer selected transaction options include user selected shipping details.

23. The system of claim 18, wherein the human interaction device includes a camera and/or microphone.

24. The system of claim 18, wherein the display device and the human interaction device are a single device.

25. The system of claim 18, wherein the processing device, display device, and human interaction device are a single device.

26. The system of claim 18, wherein the event data is included in a vertical blanking interval of the video data.

27. The system of claim 18, wherein

the human interaction device is further configured to read in a contactless manner and transmit a second additional human based gesture action, wherein the second additional human based gesture action is a symbolic gesture, and

the processing device is further configured to

determine that the second additional human based gesture action corresponds to a second predetermined symbolic gesture of a second set of predetermined symbolic gestures each corresponding to a respective consumer

and

receive, via a receiver, the indication that completion of the consumer transaction has been initiated.

28. The system of claim 27, wherein each predetermined symbolic gesture in the second set of predetermined symbolic gestures corresponds to a signature for the respective consumer.

29. The system of claim 27, wherein the initiation of the completion of the consumer transaction is based on the first predetermined symbolic gesture and the second predetermined symbolic gesture.

30. The system of claim 27, wherein the additional human based gesture action is read before the second additional human based gesture action is read.

31. The system of claim 30, wherein the second predetermined symbolic gesture is a signature associated with a payer.

32. A transaction facilitating device, wherein the transaction facilitating device is part of an electronic financial transaction system, including a payee device, a pay code server, a display device, and a payer device, comprising:

a human interaction device configured to read, in a contactless manner, and transmit, human based gesture actions; and

a processing device configured to at least;

receive video data,

receive event data corresponding to a plurality of consumer products or services,

transmit the video data to the display device,

monitor the transmitted video data for an event corresponding to the received event data,

determine that the event corresponding to the received event data is occurring,

receive and analyze the human based gesture actions read in a contactless manner and transmitted by the human interaction device,

compare the human based gesture actions with a predetermined set of requirements,

determine that the human based gesture action corresponds to a first predetermined symbolic gesture of a set of predetermined symbolic gestures each corresponding to a respective consumer, and

receive an indication that completion of the consumer transaction for the selected at least one product or service has been initiated based on a transaction option associated with the consumer corresponding to the first predetermined symbolic gesture.