Voice/manual activated and integrated audio/video multi-media, multi-interface system

• US 9,462,340 B1
• Filed: 10/13/2011
• Issued: 10/04/2016
• Est. Priority Date: 10/13/2011
• Status: Active Grant

• Current Assignee: Heuroic LLC
• Original Assignee: Trevor Mathurin
• Inventors: Mathurin, Trevor
• Primary Examiner(s): Goodarzi, Nasser
• Assistant Examiner(s): PIERORAZIO, MICHAEL
• Application Number:
  US13/273,129
• Time in Patent Office: 1,818 Days
• Field of Search: 725/109
• US Class Current: 1/1
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: H04N 21/234336 by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
• CPC Class Codes: H04N 21/4227 Providing Remote input by a user located remotely from the client device, e.g. at work
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

An enhanced form of edited interactive audio and video content delivered through a subscriber based network system and accessed by several unique multimedia interface devices. These unique multimedia interface devices can also create and edit both user generated audio and video content into this enhanced form of edited interactive audio and video content. The present invention will incorporate both voice and manual activation as an embedded technology into all multi-media and user generated audio/video content.

Claims

1. A method for integrating voice activation into digital video data comprising:

retrieving digital pre-recorded or live broadcast video data that has been generated from an audio/video recording device, the digital pre-recorded or live broadcast video data including frames of video content; and

editing the digital pre-recorded or live broadcast video data at a later time of the generation of the digital pre-recorded or live broadcast video data, by digitally embedding a question and answer retrieval system into at least one frame of the video content, the question and answer retrieval system including a command file, wherein the command file is a file digitally embedded in the digital pre-recorded or live broadcast video data, the command file further programmed to contain or access from a digital data storage source at least one question and a corresponding answer pertaining to what can be seen or heard on said at least one frame of the video content by an end-viewer and enabling said command file to be accessible upon selection of said at least one frame of the video content by said end-viewer during play of the digital pre-recorded or live broadcast video data on an audio/video playing device are created during the editing, and the question and answer retrieval system accessible via the command file by speech recognition of a voice command provided in a format of a natural language question by said end-viewer upon selection of said at least one frame of the video content by said end-viewer during play of the digital pre-recorded or live broadcast video data on the audio/video playing device;

receiving, via the audio/video playing device upon selection of said at least one frame of the video content by said end-viewer, a given voice command provided in the format of a natural language question from the end-viewer to retrieve at least one question and a corresponding answer associated with said at least one frame of the video content from the question and answer retrieval system;

retrieving, via the question and answer retrieval system from selection of said at least one frame of the video content by said end-viewer, the at least one question and a corresponding answer associated with said at least one frame of the video content from the command file; and

providing, via the question and answer retrieval system from selection of said at least one frame of the video content by said end-viewer, the corresponding answer to said at least one question associated with said at least one frame of the video content visually or audibly to the end-viewer on the audio/video playing device.

2. The method of claim 1 comprising providing the end-viewer of said digital pre-recorded or live broadcast video data, the at least one question and the corresponding answer on at least one of a TV, a digital audio/video input device and a digital remote control, a touch screen digital audio/video control device, a digital stereo component device, and a computer.

3. The method of claim 1 comprising accessing an internet search process upon the end viewer of said digital pre-recorded or live broadcast video data accessing the at least one question and the corresponding answer.

4. The method of claim 1 comprising executing a purchase upon the end viewer of said digital pre-recorded or live broadcast video data accessing the at least one question and the corresponding answer.

5. The method of claim 1 comprising executing a related action upon the end viewer of said digital pre-recorded or live broadcast video data accessing the at least one question and the corresponding answer.

6. The method of claim 1 wherein the voice command is programmable and updateable.

7. The method of claim 1 wherein the at least one question and the corresponding answer include commands to access commercial and non-commercial references.

8. The method of claim 1 wherein said editing is applied to a plurality of forms of digital video data.

9. A method for integrating manual activation into digital video data comprising:

retrieving digital pre-recorded or live broadcast video data that has been generated from an audio/video recording device, the digital pre-recorded or live broadcast video data including frames of video content; and

editing the digital pre-recorded or live broadcast video data at a later time of the generation of the digital pre-recorded or live broadcast video data, by digitally embedding a question and answer retrieval system into at least one frame of the video content, the question and answer retrieval system including a command file, wherein the command file is a file digitally embedded in the digital pre-recorded or live broadcast video data, the command file further programmed to contain or access from a digital data storage source at least one question and a corresponding answer pertaining to what can be seen or heard on said at least one frame of the video content by an end-viewer and enabling said command file to be accessible upon selection of said at least one frame of the video content by said end-viewer during play of the digital pre-recorded or live broadcast video data on an audio/video playing device are created during the editing, and the question and answer retrieval system accessible via the command file by physical input of a manual command provided in a format of a natural language question by said end-viewer upon selection of said at least one frame of the video content by said end-viewer during play of the digital pre-recorded or live broadcast video data on the audio/video playing device;

receiving, via the audio/video playing device upon selection of said at least one frame of the video content by said end-viewer, a given manual command provided in the format of a natural language question from the end-viewer to retrieve at least one question and a corresponding answer associated with said at least one frame of the video content from the question and answer retrieval system;

retrieving, via the question and answer retrieval system from selection of said at least one frame of the video content by said end-viewer, the at least one question and a corresponding answer associated with said at least one frame of the video content from the command file; and

providing, via the question and answer retrieval system from selection of said at least one frame of the video content by said end-viewer, the corresponding answer to said at least one question associated with said at least one frame of the video content visually or audibly to the end-viewer on the audio/video playing device.

10. The method of claim 9 comprising providing the end-viewer of said digital pre-recorded or live broadcast video data the at least one question and the corresponding answer on at least one of a TV, a digital audio/video input device and a digital remote control, a touch screen digital audio/video control device, a digital stereo component device, and a computer.

11. The method of claim 9 comprising accessing an internet search process upon the end viewer of said digital pre-recorded or live broadcast video data accessing the at least one question and the corresponding answer.

12. The method of claim 9 comprising executing a purchase upon the end viewer of said digital pre-recorded or live broadcast video data accessing the at least one question and the corresponding answer.

13. The method of claim 9 comprising executing a related action upon the end viewer of said digital pre-recorded or live broadcast video data accessing the at least one question and the corresponding answer.

14. The method of claim 9 wherein the manual command is programmable and updateable.

15. The method of claim 9 wherein the at least one question and the corresponding answer include commands to access commercial and non-commercial references.

16. The method of claim 9 wherein said editing is applied to a plurality of forms of digital video data.

17. A system for integrating command activation into digital audio or video data, the system comprising:

a memory device having executable instructions stored therein; and

a processing device, in response to the executable instructions, operative to;

retrieve digital pre-recorded or live broadcast audio or video data that has been generated from an audio or video recording device, the digital pre-recorded or live broadcast audio or video data including frames of audio or video content, and

edit the digital pre-recorded or live broadcast audio or video data at a later time of the generation of the digital pre-recorded or live broadcast audio or video data by digitally embedding a question and answer retrieval system into at least one frame of the audio or video content, the question and answer retrieval system including a command file, wherein the command file is a file digitally embedded in the digital pre-recorded or live broadcast video data, the command file further programmed to contain or access from a digital data storage source at least one question and a corresponding answer pertaining to what can be seen or heard on said at least one frame of the audio or video content by an end-user and enabling said command file to be accessible upon selection of said at least one frame of the audio or video content by said end-user during play of the digital pre-recorded or live broadcast audio or video data on an audio/video playing device are created during the editing, and the question and answer retrieval system accessible via the command file by a command provided in a format of a natural language question by said end-user upon selection of said at least one frame of the audio or video content by the end-user during play of the digital pre-recorded or live broadcast audio or video data on the audio/video playing device,

the question and answer retrieval system is configured to receive, via the audio/video playing device upon selection of said at least one frame of the audio or video content by said end-user, a given command provided in the format of a natural language question from the end-user to retrieve at least one question and a corresponding answer associated with said at least one frame of the audio or video content from the question and answer retrieval system,

retrieve, via the question and answer retrieval system from selection of said at least one frame of the audio or video content by said end-user, the at least one question and a corresponding answer associated with said at least one frame of the audio or video content from the command file, and

provide, via the question and answer retrieval system from selection of said at least one frame of the audio or video content by said end-user, the corresponding answer to said at least one question associated with said at least one frame of the audio or video content audibly or visually to the end-user on the audio/video playing device.

18. The system of claim 17 wherein the question and answer retrieval system is operable by at least one of speech recognition of a voice command and physical input of a manual command.

19. An audio/video device for accessing commands embedded in digital audio or video data, the device comprising:

a memory device having executable instructions stored therein; and

a processing device, in response to the executable instructions, operative to;

retrieve digital pre-recorded or live broadcast audio or video data that has been generated from an audio or video recording device, the digital pre-recorded or live broadcast audio or video data including frames of audio or video content,

the digital pre-recorded or live broadcast audio or video data embedded with a question and answer retrieval system at a later time of the generation of the digital pre-recorded or live broadcast audio or video data, the question and answer retrieval system including a command file, wherein the command file is a file digitally embedded in the digital pre-recorded or live broadcast video data, the command file further programmed to contain or access from a digital data storage source at least one question and a corresponding answer pertaining to what can be seen or heard on said at least one frame of the audio or video content by an end-user and enabling said command file to be accessible upon selection of said at least one frame of the audio or video content by said end-user during play of the digital pre-recorded or live broadcast audio or video data on an audio/video playing device, and

the question and answer retrieval system accessible via the command file by providing a command in a format of a natural language question by said end-user upon selection of said at least one frame of the audio or video content by the end-user during play of the digital pre-recorded or live broadcast audio or video data on the audio/video playing device,

receive, via the audio/video playing device upon selection of said at least one frame of the audio or video content by said end-user, a given command provided in the format of a natural language question from the end-user to retrieve at least one question and a corresponding answer associated with said at least one frame of the audio or video content from the question and answer retrieval system,

retrieve, via the question and answer retrieval system from selection of said at least one frame of the audio or video content by said end-user, the at least one question and a corresponding answer associated with said at least one frame of the audio or video content from the command file; and

provide, via the question and answer retrieval system from selection of said at least one frame of the audio or video content by said end-user, the corresponding answer to said at least one question associated with said at least one frame of the audio or video content audibly or visually to the end-user on the audio/video playing device.

20. The system of claim 19 wherein the processing device is operative to receive the given command by at least one of speech recognition of a voice command and physical input of a manual command.

21. A system for integrating command activation into digital audio or video data, the system comprising:

a memory device having executable instructions stored therein; and

a processing device, in response to the executable instructions, operative to;

retrieve digital pre-recorded or live broadcast audio or video data that has been generated from an audio or video recording device, the digital pre-recorded or live broadcast audio or video data including frames of audio or video content, and

edit the digital pre-recorded or live broadcast audio or video data at a later time of the generation of the digital pre-recorded or live broadcast audio or video data by digitally embedding a request and response execution system into at least one frame of the audio or video content, the request and response execution system including a command file, wherein the command file is a file digitally embedded in the digital pre-recorded or live broadcast video data, the command file further programmed to contain or access from a digital data storage source at least one request and a corresponding response pertaining to what can be seen or heard on said at least one frame of the audio or video content by an end-user and enabling said command file to be accessible upon selection of said at least one frame of the audio or video content by said end-user during play of the digital pre-recorded or live broadcast audio or video data on an audio/video playing device are created during the editing, and the request and response execution system accessible via the command file by a command provided in a format of a natural language request by said end-user upon selection of said at least one frame of the audio or video content by the end-user during play of the digital pre-recorded or live broadcast audio or video data on the audio/video playing device,

the request and response execution system is configured to receive, via the audio/video playing device upon selection of said at least one frame of the audio or video content by said end-user, a given command provided in the format of a natural language request from the end-user to execute at least one request and a corresponding response associated with said at least one frame of the audio or video content from the request and response execution system,

execute, via the request and response execution system from selection of said at least one frame of the audio or video content by said end-user, the at least one request and a corresponding response associated with said at least one frame of the audio or video content from the command file, and

provide, via the request and response execution system from selection of said at least one frame of the audio or video content by said end-user, the corresponding response to said at least one request associated with said at least one frame of the audio or video content audibly or visually to the end-user on the audio/video playing device.

22. The system of claim 21 wherein the request and response execution system is operable by at least one of speech recognition of a voice command and physical input of a manual command.

23. An audio/video device for accessing commands embedded in digital audio or video data, the device comprising:

a memory device having executable instructions stored therein; and

a processing device, in response to the executable instructions, operative to;

retrieve digital pre-recorded or live broadcast audio or video data that has been generated from an audio or video recording device, the digital pre-recorded or live broadcast audio or video data including frames of audio or video content, the digital pre-recorded or live broadcast audio or video data embedded with a request and response execution system at a later time of the generation of the digital pre-recorded or live broadcast audio or video data,

the request and response execution system including a command file, wherein the command file is a file digitally embedded in the digital pre-recorded or live broadcast video data, the command file further programmed to contain or access from a digital data storage source at least one request and a corresponding response pertaining to what can be seen or heard on said at least one frame of the audio or video content by an end-user and enabling said command file to be accessible upon selection of said at least one frame of the audio or video content by said end-user during play of the digital pre-recorded or live broadcast audio or video data on an audio/video playing device, and the request and response execution system accessible via the command file by providing a command in a format of a natural language request by said end-user upon selection of said at least one frame of the audio or video content by the end-user during play of the digital pre-recorded or live broadcast audio or video data on the audio/video playing device,

receive, via the audio/video playing device upon selection of said at least one frame of the audio or video content by said end-user, a given command provided in the format of a natural language request from the end-user to execute at least one request and a corresponding response associated with said at least one frame of the audio or video content from the request and response execution system,

execute, via the request and response execution system from selection of said at least one frame of the audio or video content by said end-user, the at least one request and a corresponding response associated with said at least one frame of the audio or video content from the command file; and

provide, via the request and response execution system from selection of said at least one frame of the audio or video content by said end-user, the corresponding response to said at least one request associated with said at least one frame of the audio or video content audibly or visually to the end-user on the audio/video playing device.

24. The system of claim 23 wherein the processing device is operative to receive the given command by at least one of speech recognition of a voice command and physical input of a manual command.