Method and system for voice control of software applications

• US 20040054539A1
• Filed: 09/13/2002
• Published: 03/18/2004
• Est. Priority Date: 09/13/2002
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Simpson, Nigel D.
• Granted Patent: US 7,421,390 B2
• Time in Patent Office: Days
• US Class Current: 704/270.1
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 1/72451 according to schedules, e.g. using calendar applications
• CPC Class Codes: H04M 2250/74 with voice recognition means

Abstract

In one embodiment of the present invention, a voice control application transmits data to a voice server about a first execution state of an application program resident in the memory of an electronic device having a first graphical display. The voice control application also transmits an audio waveform encoding of a voice command defining a second execution state of the application program. The voice server performs a speech recognition process upon the audio waveform encoding and transmits a reply to the electronic device for causing the second execution state of the application program. The voice control program, in response to the response, automatically causes the second execution state of the application program having a second graphical display.

Claims

1. A system for voice control of software applications comprising:

a) an electronic device comprising;

a processor coupled to a bus;

a memory coupled to said bus;

a first application for displaying a first graphical user interface associated with a first execution state;

a second application for causing said electronic device to transmit data describing said first execution state of said first application and an audio waveform encoding of a voice command defining a second execution state of said first application to a voice server; and

b) wherein said voice server is for performing a speech recognition process upon said audio waveform encoding and based thereon determining a reply for causing said first application to enter said second execution state, and for transmitting said reply to said electronic device.

2. The system as described in claim 1 wherein said electronic device is a portable electronic device.

3. The system as described in claim 2 wherein said second application causes said first application to enter said second execution state and wherein said second application automatically creates said audio waveform encoding and automatically transmits said data wirelessly to said voice server in response to receiving said voice command.

4. The system as described in claim 1 wherein said speech recognition process is for creating a textual equivalent of said audio waveform encoding.

5. The system as described in claim 4 wherein said voice server is further for comparing said textual equivalent of said audio waveform encoding to a list of commands to determine said second execution state of said first application.

6. The system as described in claim 5 wherein said voice server determines said reply by creating a list of operations for causing said first application to transition from said first execution state to said second execution state.

7. The system as described in claim 6 wherein said list of operations comprises a series of commands for causing said first application to transition from said first execution state to said second execution state.

8. The system as described in claim 6 wherein said list of operations comprises an application programming interface command for causing said first application to transition from said first execution state to said second execution state.

9. The system as described in claim 1 wherein said reply further comprises an annotated audio message.

10. The system as described in claim 9 wherein said annotated audio message comprises an audio waveform message.

11. A system for voice control of software applications comprising:

a) an electronic device comprising;

a processor coupled to a bus;

a memory coupled to said bus;

a voice control application resident in said memory and for causing said electronic device to transmit data listing a plurality of application programs resident on said electronic device and an audio waveform encoding of a voice command and for automatically initiating a first application program on said electronic device in response to a reply; and

b) a voice server for accessing said data and for performing a speech recognition process upon said audio waveform encoding, said voice server also for determining said reply, and for transmitting said reply to said electronic device.

12. The system as described in claim 11 wherein said electronic device is a portable electronic device.

13. The system as described in claim 12 wherein said voice control application automatically creates said audio waveform encoding and automatically transmits said data wirelessly to said voice server in response to receiving said voice command.

14. The system as described in claim 11 wherein said speech recognition process is for creating a textual equivalent of said audio waveform encoding.

15. The system as described in claim 14 wherein said voice server is further for comparing said textual equivalent of said audio waveform encoding to a list of commands associated with said plurality of application programs resident on said electronic device to determine said first application program.

16. The system as described in claim 15 wherein said voice server determines said reply by creating a list of operations for initiating said first application program.

17. The system as described in claim 16 wherein said list of operations comprises a series of commands for initiating said first application program.

18. The system as described in claim 16 wherein said list of operations comprises an application programming interface command for initiating said first application program.

19. The system as described in claim 11 wherein said reply further comprises an annotated audio message.

20. The system as described in claim 19 wherein said annotated audio message comprises an audio waveform message.

21. A method for voice control of software applications on an electronic device comprising:

a) in response to a voice command, said electronic device creating an audio waveform encoding thereof;

b) transmitting a message to a voice server, said message comprising said audio waveform encoding and data listing a plurality of application programs resident on said electronic device;

c) automatically performing a speech recognition process upon said audio waveform encoding, wherein said c) is performed by said voice server;

d) sending a reply to said electronic device for initiating a first application program of said plurality of application programs resident on said electronic device, wherein said d) is performed by said voice server; and

e) automatically initiating a first execution state of said first application program in response to receiving said reply.

22. The method as recited in claim 21, wherein said electronic device is a portable electronic device and wherein said b) comprises automatically transmitting said data to said voice server wirelessly in response to said receiving of said voice command.

23. The method as recited in claim 21, wherein c) comprises creating a textual equivalent of said audio waveform encoding.

24. The method as recited in claim 23, wherein c) further comprises:

comparing said textual equivalent of said audio waveform encoding to a list of commands associated with said plurality of application programs resident on said electronic device; and

determining said first application program based upon said comparing.

25. The method as recited in claim 24, wherein said d) comprises creating a list of operations for initiating said first application program and sending said list of operations as said reply.

26. The method as recited in claim 24, wherein said d) comprises sending a list of controller commands for initiating said first application program.

27. The method as recited in claim 24, wherein said d) comprises sending an application programming interface command for initiating said first application program.

28. The method as recited in claim 21 further comprising sending an annotated audio message with said reply.

29. The method as recited in claim 28, wherein said annotated audio message is an audio waveform message.

30. The method as recited in claim 21 further comprising:

receiving another voice command on said electronic device and creating another audio waveform encoding of said another voice command;

transmitting another message comprising said another audio waveform encoding of said another voice command and data describing a second execution state of said first application program to said voice server;

receiving said another message and automatically performing said speech recognition process upon said another audio waveform encoding;

sending another reply to said electronic device for causing said second execution state of first application program; and

automatically causing said second execution state of said first application program in response to receiving said second reply.