Voice-based interactive content and user interface

• US 10,152,975 B2
• Filed: 01/05/2015
• Issued: 12/11/2018
• Est. Priority Date: 05/02/2013
• Status: Active Grant

• Current Assignee: XappMedia, Inc.
• Original Assignee: XappMedia, Inc.
• Inventors: Higbie, Patrick B., Kelvie, John P., Myers, Michael M., Raines, Franklin D.
• Primary Examiner(s): Shah, Paras D
• Assistant Examiner(s): Ogunbiyi, Oluwadamilola M
• Application Number:
  US14/589,866
• Publication Number:
  US 20150120295A1
• Time in Patent Office: 1,436 Days
• Field of Search: 704235, 704246
• CPC Class Codes: G06Q 30/0203 Market surveys; Market polls
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A method, device, system, and computer medium for providing interactive advertising are provided. For example, a device may request an advertisement from a remote server, receive the advertisement, receive a response from a user who is listening and/or watching the advertisement, and transmit the response to the server for further action. The user may input a response by speaking. A server may receive an advertisement request from the device, select an advertisement based on pre-defined one or more criteria, transmit the selected advertisement to the device for play, receive from the device a response to the selected advertisement, and then perform an action corresponding to the received response.

Claims

1. A user device comprising:

a speech recognizer;

one or more processors;

a memory storing one or more programs comprising instructions, which when executed by the one or more processors, cause the device to;

play radio content that is streamed to a plurality of user devices from a first remote server, the radio content comprising one or more break times;

play interactive content during the one or more break times of the radio content, wherein the interactive content comprises a first interactive content and a second interactive content, the first interactive content being streamed to the plurality of user devices from a second remote server, and the second interactive content being streamed to the plurality of user devices from a third remote server;

receive first command-action correspondence data for the first interactive content from the second remote server, the first command-action correspondence data associating a set of first voice commands with a set of first actions;

receive second command-action correspondence data for the second interactive content from the third remote server, the second command-action correspondence data associating a set of second voice commands with a set of second actions different from the set of first actions;

in response to playing the first interactive content;

activate the speech recognizer and receive a user'"'"'s first voice command using the activated speech recognizer; and

perform a first action responding to the user'"'"'s first voice command according to the first command-action correspondence data; and

in response to playing the second interactive content;

activate the speech recognizer and receive a user'"'"'s second voice command using the activated speech recognizer; and

perform a second action responding to the user'"'"'s second voice command according to the second command-action correspondence data.

2. The device of claim 1, wherein the first command-action correspondence data is modifiable by the second remote server.

3. The device of claim 1, wherein the first action performed in response to receiving the user'"'"'s first voice command comprises initiating a phone call using voice-over-IP (VOIP).

4. The device of claim 1, wherein the first action performed in response to receiving the user'"'"'s first voice command comprises opening a webpage on a display of the user device.

5. The device of claim 1, wherein the first action performed in response to receiving the user'"'"'s first voice command comprises sending an email to a remote device.

6. The device of claim 1, wherein the first action performed in response to receiving the user'"'"'s first voice command comprises downloading an application from a remote device and installing the downloaded application on the user device.

7. The device of claim 1, comprising a mechanical input mechanism, and wherein the one or more programs further comprise instructions, which when executed by the one or more processors, cause the device to:

while the speech recognizer is activated, receive a user'"'"'s mechanical input using the mechanical input mechanism; and

in response to receiving the user'"'"'s mechanical input, perform an action responding to the user'"'"'s mechanical input according to the first command-action correspondence data.

8. The device of claim 1, wherein to play the radio content, a connection is established between the first remote server and the user device, and wherein the connection to the first remote server is switched with a connection to the second remote server immediately before a first break time starts in the radio content.

9. The device of claim 8, wherein after the first break time is over, the connection to the second remote server terminates and the connection to the first remote server is restored.

10. A server for providing interactive content to a plurality of user devices, the server comprising a memory storing one or more programs comprising instructions for the one or more processors, which when executed by the one or more processors, cause the server to:

broadcast radio content to a plurality of user devices, the radio content comprising a first break time and a second break time;

cause a second remote server to provide a first interactive content to the plurality of user devices during the first break time of the radio content;

cause a third remote server to provide a second interactive content to the plurality of user devices during the second break time of the radio content;

cause the second remote server to transmit first command-action correspondence data for the first interactive content to the plurality of user devices, the first command-action correspondence data associating a set of first voice commands with a set of first actions;

cause the third remote server to transmit second command-action correspondence data for the second interactive content, the second command-action correspondence data associating a set of second voice commands with a set of second actions different from the set of first actions;

cause the second remote server to receive a first voice command from a first user device from the plurality of user devices, in response to providing the first interactive content;

cause the first user device to perform a first action according to the first command-action correspondence data associating the first voice command with the first action;

cause the third remote server to receive a second voice command from the first user device, in response to providing the second interactive content;

cause the first user device to perform a second action according to the second command- action correspondence data associating the second voice command with the second action.

11. A method for providing interactive content, the method comprising:

at an electronic media playback device;

playing radio content that is streamed to a plurality of user devices from a first remote server, the radio content comprising one or more break times;

playing interactive content during the one or more break times of the radio content, wherein the interactive content comprises a first interactive content and a second interactive content, the first interactive content being streamed to the plurality of user devices from a second remote server, and the second interactive content being streamed to the plurality of user devices from a third remote server;

receiving first command-action correspondence data for the first interactive content from the second remote server, the first command-action correspondence data associating a set of first voice commands with a set of first actions;

receiving second command-action correspondence data for the second interactive content from the third remote server, the second command-action correspondence data associating a set of second voice commands with a set of second actions different from the set of first actions;

in response to playing the first interactive content;

activating a speech recognizer of the device and receiving a user'"'"'s first voice command using the activated speech recognizer; and

performing a first action responding to the user'"'"'s first voice command according to the first command-action correspondence data; and

in response to playing the second interactive content;

activating the speech recognizer and receive a user'"'"'s second voice command using the activated speech recognizer; and

performing a second action responding to the user'"'"'s second voice command according to the second command-action correspondence data.

12. The method of claim 11, wherein the first command-action correspondence data is modifiable by the second remote server.

13. The method of claim 11, wherein the first action performed in response to receiving the user'"'"'s first voice command comprises initiating a phone call using voice-over-IP (VOIP).

14. The method of claim 11, wherein the first action performed in response to receiving the user'"'"'s first voice command comprises opening a webpage on a display of the media playback device.

15. The method of claim 11, wherein the first action performed in response to receiving the user'"'"'s first voice command comprises sending a text message to a remote device associated with the first interactive content.

16. The method of claim 11, wherein the first action performed in response to receiving the user'"'"'s voice first command comprises downloading an application from a remote device associated with the first interactive content and installing the downloaded application on the media playback device.

17. The method of claim 11, further comprising:

while the speech recognizer is activated, receiving a user'"'"'s mechanical input using a mechanical input mechanism of the media playback device; and

in response to receiving the user'"'"'s mechanical input, performing an action responding to the user'"'"'s mechanical input according to the first command-action correspondence data.

18. The method of claim 11, wherein to play the radio content, a connection is established between the first remote server and the media playback device, and wherein the connection to the first remote server is switched with a connection to the second remote server immediately before a first break time starts in the radio content.

19. The method of claim 18, wherein after the first break time is over, the connection to the second remote server terminates and the connection to the first remote server is restored.

20. A non-transitory computer readable medium storing computer instructions, which when executed by an electronic media playback device, cause the device to:

play radio content that is streamed to a plurality of user devices from a first remote server, the radio content comprising one or more break times;

play interactive content during the one or more break times of the radio content, wherein the interactive content comprises a first interactive content and a second interactive content, the first interactive content being streamed to the plurality of user devices from a second remote server, and the second interactive content being streamed to the plurality of user devices from a third remote server;

receive first command-action correspondence data for the first interactive content from the second remote server, the first command-action correspondence data associating a set of first voice commands with a set of first actions;

receive second command-action correspondence data for the second interactive content from the third remote server, the second command-action correspondence data associating a set of second voice commands with a set of second actions different from the set of first actions;

in response to playing the first interactive content;

activate the speech recognizer and receive a user'"'"'s first voice command using the activated speech recognizer; and

perform a first action responding to the user'"'"'s first voice command according to the first command-action correspondence data; and

in response to playing the second interactive content;

activate the speech recognizer and receive a user'"'"'s second voice command using the activated speech recognizer; and

perform a second action responding to the user'"'"'s second voice command according to the second command-action correspondence data.

21. The medium of claim 20, wherein to play the radio content, a connection is established between the first remote server and the media playback device, and wherein the connection to the first remote server is switched with a connection to the second remote server immediately before a first break time starts in the radio content.

22. The medium of claim 21, wherein after the first break time is over, the connection to the second remote server terminates and the connection to the first remote server is restored.