Method and system for consumer transactions using voice or human based gesture actions

• US 9,836,780 B2
• Filed: 11/18/2011
• Issued: 12/05/2017
• Est. Priority Date: 11/19/2010
• Status: Active Grant

• Current Assignee: Mastercard International Incorporated (MasterCard Incorporated)
• Original Assignee: Mastercard International Incorporated (MasterCard Incorporated)
• Inventors: Cooke, Alan, Lyons, Garry, Cummins, Oran, Elder, Stephen
• Primary Examiner(s): Pond, Rob
• Application Number:
  US13/299,896
• Publication Number:
  US 20120130866A1
• Time in Patent Office: 2,209 Days
• Field of Search: 705 261- 272, 705 26, 705 27
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers

Abstract

A method of initiating a consumer transaction using a human interaction device to read voice or human based gesture actions is disclosed. Video data is transmitted from a processing device to a display device. The video is monitoring for event data corresponding to a plurality of consumer products or services, and monitored event data is received in the processing device. A consumer is notified on the display device of an eligible consumer transaction. Voice or human based gesture actions are read with a human interaction device and are analyzed. If the voice or human based gesture actions conform to a predetermined set of requirements, then a consumer transaction for the plurality of consumer products or services is initiated.

Claims

1. A method for initiating a consumer transaction, comprising:

receiving, in a processing device and from an external device, video data, wherein the video data comprises at least first video data to be displayed;

transmitting the first video data from the processing device to a display device;

analyzing, by the processing device, the first video data for event data, the first event data originating from a pay code server;

receiving, in the processing device, first event data, wherein the first event data is associated with (i) at least one consumer product or service and (ii) the first video data;

transmitting, from the processing device and to the display device, a machine-readable pay code encoded with pay code data based upon the received first event data, wherein the machine-readable pay code is displayed on the display device and the pay code data indicates the at least one product or service is available for purchase;

responsive to a consumer device reading, via an optical device, the machine-readable pay code displayed on the display device to decode the encoded pay code data, initiating, by the processing device, the consumer transaction by transmitting, to the display device, an interactive notification associated with purchase information corresponding to the at least one product or service available for purchase, wherein the interactive notification is displayed on the display device;

reading, in a contactless manner and by a human interaction device, human based gesture actions responsive to the displayed interactive notification;

analyzing, by the processing device, the human based gesture actions;

determining, by the processing device, that the human based gesture actions conform to a predetermined second set of interaction requirements;

receiving, in the processing device, indications of payer selected transaction options based upon the human based gesture actions;

transmitting, electronically from the processing device, the indications to the pay code server; and

receiving, in the processing device, an indication that electronic financial transaction processing of payment from a payer to payee has been initiated.

2. The method of claim 1, wherein the human interaction device includes a camera and/or a microphone.

3. The method of claim 1, wherein the display device and the human interaction device are a single device.

4. The method of claim 1, wherein the processing device, the display device, and the human interaction device are a single device.

5. The method of claim 1, wherein the event data is included in a vertical blanking interval of the transmitted first video data.

6. The method of claim 1, wherein the payer selected transaction options include at least one option selected from the group consisting of quantity, quality, color, and size.

7. The method of claim 1, wherein the payer selected transaction options include selection of a funding source.

8. The method of claim 1, wherein the payer selected transaction options include user selected shipping details.

9. The method of claim 1, wherein the first event data is associated with a content of the first video data.

10. The method of claim 1, wherein the video data further comprises the first event data.

11. The method of claim 1, wherein the received event data is broadcast data.

12. An electronic financial transaction method, comprising:

receiving, in a processing device and from an external device, video data, wherein the video data comprises at least first video data to be displayed;

transmitting the first video data from the processing device to a display device;

monitoring, by the processing device, the first video data for event data;

receiving, in the processing device, first event data, wherein the first event data is associated with (i) at least one consumer product or service available for purchase and (ii) the first video data;

transmitting, from the processing device and to the display device, an interactive notification based upon the received first event data, wherein the notification is displayed on the display device and indicates the at least one product or service is available for purchase and prompts an interactive response;

reading, in a contactless manner and by a human interaction device, human gesture based actions responsive to the displayed notification;

analyzing, by the processing device, the human gesture based actions;

determining, by the processing device, that the human based gesture actions conform to a predetermined first set of interaction requirements, wherein the first set of interaction requirements are associated with a process for prompting communication between a payer and a pay code server; and

transmitting, responsive to the determining and by the processing device, to one of (i) the display device and (ii) a display of a payee device, a machine-readable pay code in which pay code data related to the at least one product or service available for purchase is encoded, wherein, responsive to the payer device reading, via an optical device, the machine-readable pay code displayed on one of;

(i) the display device and (ii) the display of the payee device, to decode the encoded pay code data, the decoded pay code data is configured to be transmitted by the payer device to a pay code server and enable transaction details related to the at least one product or service available for purchase to be acquired by the payer device.

13. The method of claim 12, wherein the machine-readable pay code is a bar code or a video watermark.

14. The method of claim 13, wherein the bar code is a QR bar code.

15. A system for initiating a consumer transaction, comprising:

a display device;

a human interaction device configured to read, in a contactless manner, and transmit human based gesture actions; and

a processing device configured to, at least;

receive video data, from an external device, wherein the received video data comprises at least first video data to be displayed;

transmit the first video data to a display device,

analyze the transmitted first video data for event data, the first event data originating from a pay code server,

receive first event data, wherein the first event data is associated with (i) at least one consumer product or service and (ii) the first video data,

transmit, to the display device, a machine-readable pay code encoded with pay code data based upon the received first event data, wherein the machine-readable pay code is to be displayed on the display device and the pay code data indicates the at least one product or service is available for;

responsive to a consumer device reading, via an optical device, the machine-readable pay code displayed on the display device to decode the encoded pay code data, initiate, by the processing device, the consumer transaction by transmitting, to the display device, an interactive notification associated with purchase information corresponding to the at least one product or service available for purchase, wherein the interactive notification is displayed on the display device;

wherein the human interaction device is further configured to read, in a contactless manner and transmit second human based gesture actions responsive to the displayed interactive notification, and the processing device is further configured to;

receive and analyze the human based gesture actions,

determine that the human based gesture actions conform to a predetermined set of interaction requirements,

receive indications of payer selected transaction options based upon the human based gesture actions,

electronically transmit the indications to the pay code server, and

receive an indication that electronic financial transaction processing of payment from a payer to payee has been initiated.

16. The system of claim 15, wherein the human interaction device includes a camera and/or microphone.

17. The system of claim 15, wherein the display device and the human interaction device are a single device.

18. The system of claim 15, wherein the processing device, display device, and human interaction device are a single device.

19. The system of claim 15, wherein the event data is included in a vertical blanking interval of the first video data.

20. The system of claim 15, wherein the payer selected transaction options include at least one option selected from the group consisting of quantity, quality, color, and size.

21. The system of claim 15, wherein the payer selected transaction options include selection of a funding source.

22. The system of claim 15, wherein the payer selected transaction options include user selected shipping details.

23. In an electronic financial transaction system, comprising a payee device, a pay code provider, a display device, and a payer device, a transaction facilitating device comprising:

a human interaction device configured to read, in a contactless manner, and transmit human based gesture actions; and

a processing device configured to, at least;

receive video data, from an external device, wherein the video data comprises at least first video data to be displayed;

transmit the first video data to the display device,

monitor the first video data for event data,

receive first event data, wherein the first event data is associated with (i) at least one consumer product or service and (ii) the first video data,

transmit, to the display device, a notification based upon the received first event data, wherein the notification is displayed on the display device and indicates the at least one product or service is available for purchase and prompts an interactive response;

receive and analyze the human based gesture actions, wherein the human based gesture actions are received from the human interaction device,

compare the human based gesture actions with a predetermined set of requirements,

determine that the human based gesture actions conform to the predetermined set of interaction requirements, wherein the first set of interaction requirements are associated with a process for prompting communication between a payer and a pay code server, and

transmit, responsive to the determining, to one of (i) the display device and (ii) a display of a payee device, a machine-readable pay code in which pay code data related to the at least one product or service is encoded, wherein

the display device is configured to receive the video data and the notification from the processing device and display the received video data and the received notification, and

responsive to the payer device reading, via an optical device, the machine-readable pay code displayed on one of;

(i) the display device and (ii) the display of the payee device, to decode the encoded pay code data, the payer device is configured to transmit to the pay code server the decoded pay code data to request the transaction details for the at least one product or service from the pay code server, and configured to display the transaction details received from the pay code server.