SYSTEM AND METHOD FOR CONTROLLING INTERACTIVE VIDEO USING VOICE

• US 20130325466A1
• Filed: 05/10/2013
• Published: 12/05/2013
• Est. Priority Date: 05/10/2012
• Status: Abandoned Application

• Current Assignee: Clickberry, Inc.
• Original Assignee: Clickberry, Inc.
• Inventors: BABIN, ALEXEY
• Application Number:
  US13/892,240
• Publication Number:
  US 20130325466A1
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: H04N 21/858 Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot

Abstract

System for controlling interactive video using voice commands incorporates: a control module, a voice-to-text conversion module, a text comparison module, an interactive content overlay module, a dynamic content display module, and a content storage module. The control module is implemented as a mobile application executing on a suitable mobile device, which is configured to transmit voice commands received from the user to the server. The voice-to-text conversion module operates on the server and performs conversion of the user'"'"'s voice commands to text commands. The text comparison module is deployed on provider'"'"'s server and performs comparison of the words in the converted text commands received from the conversion module with the keywords stored in the interactive video file. The interactive content overlay module displays the interactive content corresponding to the user'"'"'s commands by overlaying it over the video content displayed to the user. The dynamic content display module dynamically displays the interactive content to the user. The content storage module controls the storing of the content on the server.

Claims

1. A computerized system for controlling interactive video using voice commands, the system comprising:

a. a control module deployed on a mobile device and configured to detect a voice command issued by a user and to transmit the detected user'"'"'s voice command to the server;

b. a voice-to-text conversion module deployed on the server and configured to perform conversion of the user'"'"'s voice command to a text command;

c. a text comparison module configured to perform comparison of the words in the converted text command received from the voice-to-text conversion module with keywords stored in an interactive video file;

d. an interactive content overlay module configured to display an interactive content corresponding to the user'"'"'s voice command by overlaying the interactive content over a video content displayed to the user;

e. a dynamic content display module configured to dynamically display the interactive content to the user; and

f. a content storage module configured to control storing of the interactive video file containing the interactive content.

2. The computerized system of claim 1, wherein the interactive video file comprises:

a. positional coordinates of an object in the video frame of the interactive video;

b. a time interval when the object appears in the video;

c. at least one keyword associated with the object;

d. a type of interactive action to be initiated upon the receipt of the command from the user; and

e. a content to be displayed to the user.

3. The computerized system of claim 1, wherein the keywords comprise content keywords associated with one or more objects in the interactive video file and command keywords associated with one or more actions which may be performed in connection with the interactive video.

4. The computerized system of claim 1, wherein the interactive content overlay module is configured to display the interactive content corresponding to the user'"'"'s voice command in a translucent manner.

5. The computerized system of claim 1, wherein the interactive content overlay module is configured to display the interactive content corresponding to the user'"'"'s voice command in a pop-up window.

6. The computerized system of claim 1, wherein the computerized system is configured to display a hint to the user regarding one or more actions which may be performed in connection with the interactive video.

7. The computerized system of claim 1, wherein the computerized system is configured to send email comprising the interactive content corresponding to the user'"'"'s voice command to the user.

8. A computer-implemented method for controlling interactive video using voice commands, the method comprising:

a. using a control module deployed on a mobile device and configured to detect a voice command issued by a user and to transmit the detected user'"'"'s voice command to the server;

b. using a voice-to-text conversion module deployed on the server and configured to perform conversion of the user'"'"'s voice command to a text command;

c. using a text comparison module configured to perform comparison of the words in the converted text command received from the voice-to-text conversion module with keywords stored in an interactive video file;

d. using an interactive content overlay module configured to display an interactive content corresponding to the user'"'"'s voice command by overlaying the interactive content over a video content displayed to the user;

e. using a dynamic content display module to dynamically display the interactive content to the user; and

f. using a content storage module to control storing of the interactive video file containing the interactive content.

9. The computer-implemented method of claim 8, wherein the interactive video file comprises:

a. positional coordinates of an object in the video frame of the interactive video;

b. a time interval when the object appears in the video;

c. at least one keyword associated with the object;

d. a type of interactive action to be initiated upon the receipt of the command from the user; and

e. a content to be displayed to the user.

10. The computer-implemented method of claim 8, wherein the keywords comprise content keywords associated with one or more objects in the interactive video file and command keywords associated with one or more actions which may be performed in connection with the interactive video.

11. The computer-implemented method of claim 8, wherein the interactive content corresponding to the user'"'"'s voice command is displayed in a translucent manner.

12. The computer-implemented method of claim 8, wherein the interactive content corresponding to the user'"'"'s voice command is displayed in a pop-up window.

13. The computer-implemented method of claim 8, further comprising displaying a hint to the user regarding one or more actions which may be performed in connection with the interactive video.

14. The computer-implemented method of claim 8, further comprising sending email comprising the interactive content corresponding to the user'"'"'s voice command to the user.

15. A non-transitory computer-readable medium embodying a set of instructions, which, when executed by one or more processors cause the one or more processors to perform a computer-implemented method for controlling interactive video using voice commands, the method comprising:

a. using a control module deployed on a mobile device and configured to detect a voice command issued by a user and to transmit the detected user'"'"'s voice command to the server;

b. using a voice-to-text conversion module deployed on the server and configured to perform conversion of the user'"'"'s voice command to a text command;

c. using a text comparison module configured to perform comparison of the words in the converted text command received from the voice-to-text conversion module with keywords stored in an interactive video file;

d. using an interactive content overlay module configured to display an interactive content corresponding to the user'"'"'s voice command by overlaying the interactive content over a video content displayed to the user;

e. using a dynamic content display module to dynamically display the interactive content to the user; and

f. using a content storage module to control storing of the interactive video file containing the interactive content.

16. The non-transitory computer-readable medium of claim 15, wherein the interactive video file comprises:

a. positional coordinates of an object in the video frame of the interactive video;

b. a time interval when the object appears in the video;

c. at least one keyword associated with the object;

d. a type of interactive action to be initiated upon the receipt of the command from the user; and

e. a content to be displayed to the user.

17. The non-transitory computer-readable medium of claim 15, wherein the keywords comprise content keywords associated with one or more objects in the interactive video file and command keywords associated with one or more actions, which may be performed in connection with the interactive video.

18. The non-transitory computer-readable medium of claim 15, wherein the interactive content corresponding to the user'"'"'s voice command is displayed in a translucent manner.

19. The non-transitory computer-readable medium of claim 15, wherein the interactive content corresponding to the user'"'"'s voice command is displayed in a pop-up window.

20. The non-transitory computer-readable medium of claim 15, wherein the method further comprises displaying a hint to the user regarding one or more actions, which may be performed in connection with the interactive video.