Method and system for voice control of software applications

• US 7,421,390 B2
• Filed: 09/13/2002
• Issued: 09/02/2008
• Est. Priority Date: 09/13/2002
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Simpson, Nigel D.
• Primary Examiner(s): Edouard; Patrick N.
• Assistant Examiner(s): Yen; Eric
• Application Number:
  US10/244,131
• Publication Number:
  US 20040054539A1
• Time in Patent Office: 2,181 Days
• Field of Search: 704/275, 704/270
• US Class Current: 704/270
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 1/72451 according to schedules, e.g. using calendar applications
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00

Abstract

In one embodiment of the present invention, a voice control application transmits data to a voice server about a first execution state of an application program resident in the memory of an electronic device having a first graphical display. The voice control application also transmits an audio waveform encoding of a voice command defining a second execution state of the application program. The voice server performs a speech recognition process upon the audio waveform encoding and transmits a reply to the electronic device for causing the second execution state of the application program. The voice control program, in response to the response, automatically causes the second execution state of the application program having a second graphical display.

Claims

1. A system for voice control of software applications comprising:

an electronic device comprising;

a processor coupled to a bus,

a memory coupled to said bus,

a plurality of application programs, and

a voice control application resident in said memory and for causing said electronic device to transmit a message to a voice server,

wherein said message comprises a listing of said plurality of application programs and an audio waveform encoding of a voice command, and

wherein said voice command comprises a command to initiate an application program selected from said plurality of application programs; and

said voice server for;

creating a textual equivalent of said audio waveform encoding,

comparing said textual equivalent of said audio waveform encoding with a plurality of textual keywords in a command list associated with said plurality of application programs to determine said application program,

generating a list of operations for initiating said application program, and

transmitting a reply comprising said list of operations to said electronic device in response to said message.

2. The system as described in claim 1 wherein said electronic device is a portable electronic device.

3. The system as described in claim 1 wherein said voice control application is further for automatically creating said audio waveform encoding and automatically transmitting said data wirelessly to said voice server in response to said voice command.

4. The system as described in claim 1 wherein said list of operations comprises a series of user interface commands for initiating said application program.

5. The system as described in claim 1 wherein said list of operations comprises an application programming interface command for initiating said application program.

6. The system as described in claim 1 wherein said reply further comprises an annotated audio message associated with said list of operations.

7. The system as described in claim 6 wherein said annotated audio message comprises an audio waveform message.

8. A method for voice control of software applications on an electronic device comprising:

creating, by said electronic device, a first audio waveform encoding of a first voice command, wherein said first voice command comprises a command to initiate an application program selected from a plurality of application programs resident on said electronic device;

transmitting a first message to a voice server, wherein said first message comprises said first audio waveform encoding and a listing of said plurality of application programs resident on said electronic device;

performing, by said voice server, a speech recognition process upon said first audio waveform encoding, wherein said speech recognition process comprises;

creating a textual equivalent of said first audio waveform encoding,

comparing said textual equivalent of said first audio waveform encoding with a plurality of textual keywords in a command list associated with said plurality of application programs resident on said electronic device, and

determining said application program based upon said comparing;

sending, by said voice server, a first reply to said electronic device in response to said first message, wherein said first reply comprises a first list of operations for initiating said application program; and

initiating, by said electronic device, a first execution state of said application program using said first list of operations.

9. The method as recited in claim 8, wherein said electronic device is a portable electronic device and wherein transmitting said first message to said voice server comprises automatically transmitting said listing to said voice server wirelessly in response to said first voice command.

10. The method as recited in claim 8, wherein said first list of operations comprises a list of user interface commands for initiating said application program.

11. The method as recited in claim 8, wherein said first list of operations comprises an application programming interface command for initiating said application program.

12. The method as recited in claim 8, wherein said first reply further comprises an annotated audio message associated with said first list of operations.

13. The method as recited in claim 12, wherein said annotated audio message is an audio waveform message.

14. The method as recited in claim 8 further comprising:

creating, by said electronic device, a second audio waveform encoding of a second voice command, wherein said second voice command comprises a command to transition said application program from said first execution state to a second execution state;

transmitting, by said electronic device, a second message to said voice server, wherein said second message comprises said second audio waveform encoding of said second voice command and data describing said first execution state of said application program;

performing, by said voice server, said speech recognition process upon said second audio waveform encoding to determine said second execution state of said application program;

sending, by said voice server, a second reply to said electronic device in response to said second message, wherein said second reply comprises a second list of operations for transitioning said application program from said first execution state to said second execution state; and

transitioning, by said electronic device, said application program from said first execution state to said second execution state using said second list of operations.