Method and apparatus for enhancing voice recognition capabilities of voice recognition software and systems

• US 20030083872A1
• Filed: 10/17/2002
• Published: 05/01/2003
• Est. Priority Date: 10/25/2001
• Status: Abandoned Application

• Current Assignee: Lextron Systems, Inc.
• Original Assignee: Lextron Systems, Inc.
• Inventors: Kikinis, Dan
• Application Number:
  US10/273,443
• Publication Number:
  US 20030083872A1
• Time in Patent Office: Days
• US Class Current: 704/243
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features

Abstract

An enhanced voice recognition system has a central processing unit for processing and storing data input into the system; a microphone configured to the central processing unit for recording sound input; at least one camera configured to the central processing unit for recording image data input; and at least one software module for receiving, analyzing, and processing the input. In a preferred embodiment, the system uses tracked motion values from the image data processed by at least one software module to produce values that are used to enhance the accuracy of voice recognition.

Claims

1. An enhanced voice recognition system comprising:

a central processing unit for processing and storing data input into the system;

a microphone configured to the central processing unit for receiving audio input;

at least one camera configured to the central processing unit for receiving image data input; and

at least one software module for receiving, analyzing, and processing inputs;

characterized in that the system uses motion values from the image data to enhance the accuracy of voice recognition.

2. The system of claim 1 wherein the microphone and at least one camera are provided substantially at the end of a headset boom worn by the user.

3. The system of claim 1 wherein the microphone and at least one camera are provided substantially at the end of a pedestal-microphone.

4. The system of claim 1 where in the at least one camera includes a boom camera and at least one regular camera.

5. The system of claim 1 wherein the at least one software module includes voice recognition, image correction, motion tracking, motion value calculation, and text rendering based on comparison of motion values to text possibilities.

6. The system of claim 1 wherein the central processing unit enables a desktop computer.

7. The system of claim 1 further comprising:

a teleconferencing module;

a data link to a telecommunications network; and

a client application distributed to another central processing unit having access to the telecommunications network;

characterized in that the input image data is processed by the at least one software module and delivered as motion values to the teleconference module along with voice input, whereupon the motion values are attached to the voice data, transmitted over the telecommunications network, and processed by the distributed client application to enhance the quality of the transmitted voice data.

8. The system of claim 7 wherein the telecommunications network is the Internet network.

9. The system of claim 7 wherein the telecommunications network is a telephone network.

10. The system of claim 7 wherein the telecommunications network is a combination of the Internet network and a telephone network.

11. The system of claim 7 wherein the microphone and at least one camera are provided substantially at the end of a headset boom worn by the user.

12. The system of claim 7 wherein the microphone and at least one camera a provided substantially at the end of a pedestal-microphone.

13. The system of claim 7 where in the at least one camera includes a boom camera and at least one regular camera.

14. The system of claim 7 wherein the at least one software module includes voice recognition, image correction, motion tracking, combined motion value calculation, and text rendering based on comparison of motion values to text possibilities.

15. A software application for enhancing a voice recognition system comprising:

at least one imaging module associated with at least one camera for receiving image input;

at least one motion tracking module for tracking motion associated with facial positions of an image subject; and

,

at least one processing module for processing and comparing processed motion values with voice recognition possibilities;

characterized in that the application establishes motion points and tracks the motion thereof during a voice recognition session, and the tracked motion is resolved into motion values that are processed in comparison with voice recognition values to produce enhanced voice recognition results.

16. The software application of claim 15 including a whisper mode wherein motion tracking and resulting values are relied more on than voice processing to produce accurate results.

17. The software application of claim 15 further comprising a teleconferencing module.

18. The software application of claim 17 wherein the values resulting from motion tracking are attached to voice data transmitted in a teleconferencing session through the teleconferencing module.

19. The software application of claim 17 including a client application distributed to the receiving central processing unit of a receiving station of the teleconference call.

20. A method for enhancing voice recognition results in a voice recognition system comprising:

(a) providing at least one camera and image software for receiving pictures of facial characteristics of a user during a voice recognition session;

(b) establishing motion tracking points at strategic locations on or about the facial features in the image window;

(c) recording the delta movements of the tracking points;

(d) combining the tracked motion deltas of individual tracking points to produce one or more motion value;

(e) comparing the motion values to voice recognition values and refining text choices from a list of possibilities; and

(f) displaying the enhanced text commands or renderings.

21. The method of claim 20 wherein in step (a) the at least one camera includes a boom camera and at least one fixed camera.

22. The method of claim 20 wherein in step (a) the at least one camera is a boom camera mounted to a headset boom.

23. The method of claim 20 wherein in step (a) the at least one camera is a fixed camera.

24. The method of claim 20 wherein in step (b) the tracking points are associated with one or more of the upper and lower lips of the user, the eyes and eyebrows of the user, and along the mandible areas of the user.

25. The method of claim 20 wherein in step (e) the motion values are relied on more heavily than the voice recognition values.